00010000:00010000:3.0:1789431555.096778:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63521e13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.096818:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x0 (ffff90ce27a54300)
00010000:00010000:3.0:1789431555.096821:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431555.096828:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63521e13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.096834:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63521e13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.096851:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63521e1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.096857:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63521e1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.096864:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63521e1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.096869:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e74200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431555.096872:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63521e1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.096879:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63521e1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.096886:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x10cfb8f0 (ffff90ce0f6c6000)
00010000:00010000:3.0:1789431555.096889:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431555.096891:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63521e1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10098:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.096898:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63521e1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10098:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.096934:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb63521e0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79ec expref: 476 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.096949:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0c00/0xd8e438fb63521e21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79ec expref: 475 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.096957:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ab:0x0].0x0 (ffff90ce254b6f00)
00010000:00010000:3.0:1789431555.096959:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431555.096962:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bad0c00, rc 0)
00000100:00100000:3.0:1789431555.097080:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+475:14616:x1876351933271552:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 822us (2516us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.097089:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295288
00000100:00100000:3.0:1789431555.124585:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933272448
00000100:00100000:3.0:1789431555.124601:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933272448
00000100:00100000:3.0:1789431555.124678:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295290
00000100:00100000:3.0:1789431555.124692:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+474:14616:x1876351933272448:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431555.124730:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431555.124762:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63521e3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c79fa expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.124938:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3000/0xd8e438fb63521e44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.124956:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37475000/0xd8e438fb63521e2f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79f3 expref: 475 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.124971:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3000/0xd8e438fb63521e44 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100ab:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.125018:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37475000/0xd8e438fb63521e2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79f3 expref: 475 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.125035:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37475000/0xd8e438fb63521e2f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79f3 expref: 475 pid: 5847 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.126489:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3babce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894181888:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431555.130824:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63521e52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10099:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.130842:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63521e52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.130851:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63521e52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.130857:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ae59600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431555.130863:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63521e52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.130872:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63521e52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.130894:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0x3857f8dc (ffff90cf03e3dc00)
00010000:00010000:3.0:1789431555.130898:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431555.130904:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63521e52 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10099:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.130910:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63521e52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10099:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.130946:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63521e59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.130953:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63521e59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.130960:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63521e59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.130965:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ae59400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431555.130970:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63521e59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.130976:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63521e59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.130984:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0x586f5504 (ffff90cf04d11800)
00010000:00010000:3.0:1789431555.130987:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431555.130990:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63521e59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.130996:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63521e59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.131011:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521e60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a53:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.131021:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521e60 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a53:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.131026:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521e60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a53:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.131030:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b275600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431555.131033:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521e60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a53:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.131039:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521e60 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a53:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.131046:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a53:0x0].0x0 (ffff90cf04d11500)
00010000:00010000:3.0:1789431555.131073:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:3.0:1789431555.131076:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521e60 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a53:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.131082:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521e60 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a53:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.134265:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.142665:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933272704
00000100:00100000:3.0:1789431555.142681:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933272704
00000100:00100000:3.0:1789431555.142753:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933272832
00000100:00100000:3.0:1789431555.142756:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933272832
00000100:00100000:3.0:1789431555.142798:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295291
00000100:00100000:3.0:1789431555.142818:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+474:14617:x1876351933272704:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431555.142850:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431555.142879:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63521e67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7a01 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.142965:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521e75 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.142982:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521e75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.142996:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521e75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143013:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63521e83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10099:0x0].0xb65fef2a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143022:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63521e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143029:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63521e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143180:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63521e91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1009d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143189:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63521e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1009d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143196:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63521e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1009d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431555.143237:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1009d:0x0]: returning size 260096
00000004:00200000:3.0:1789431555.143242:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431555.143264:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63521e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1009d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143276:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63521e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1009d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143562:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521e75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143568:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521e75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143574:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521e75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143578:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ace00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431555.143581:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521e75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143587:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521e75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143595:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0x0 (ffff90ce15f0ee00)
00010000:00010000:3.0:1789431555.143597:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431555.143600:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521e75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143605:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521e75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143614:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63521e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143620:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63521e83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143626:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63521e83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143631:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431555.143633:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63521e83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143639:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63521e83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143645:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0xb65fef2a (ffff90ce0f6c6000)
00010000:00010000:3.0:1789431555.143647:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431555.143649:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63521e83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10099:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143654:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63521e83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10099:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143679:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63521e67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a01 expref: 475 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143691:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63521e91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1009d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a01 expref: 474 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.143698:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1009d:0x0].0x0 (ffff90ce15f0e500)
00010000:00010000:3.0:1789431555.143700:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431555.143702:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37e74a00, rc 0)
00000100:00100000:3.0:1789431555.143727:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+474:14617:x1876351933272704:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 921us (1382us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.143734:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295291
00000100:00100000:3.0:1789431555.154728:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431555.161406:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521e9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1009d:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.161415:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521e9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1009d:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431555.161442:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1009d:0x0]: returning size 260096
00010000:00010000:3.0:1789431555.161647:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63521e98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a0f expref: 476 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.161666:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521e9f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1009d:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a0f expref: 475 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.161675:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1009d:0x0].0x0 (ffff90ce15f0e500)
00010000:00010000:3.0:1789431555.161677:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431555.161680:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b275600, rc 0)
00000100:00100000:3.0:1789431555.161710:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+475:14617:x1876351933273088:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12408us (12703us total) trans 4295120618 rc 0/0
00000100:00100000:3.0:1789431555.161717:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295293
00000100:00100000:3.0:1789431555.172370:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.175640:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933273856
00000100:00100000:3.0:1789431555.175651:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933273856
00010000:00010000:3.0:1789431555.175695:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521e9f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x1009d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a0f expref: 478 pid: 12181 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.175741:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16325
00000100:00100000:3.0:1789431555.175751:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+478:2347:x1876351933273856:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431555.175767:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431555.175775:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521e9f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x1009d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a0f expref: 478 pid: 12181 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.175799:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521e9f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1009d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a0f expref: 478 pid: 12181 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.175825:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1009d:0x0].0x0 (ffff90ce15f0e500)
00010000:00010000:3.0:1789431555.175832:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e600/0xd8e438fb63521ebb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1009d:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.175844:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e600/0xd8e438fb63521ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1009d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.175853:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e600/0xd8e438fb63521ebb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1009d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.175879:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431555.175946:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+478:2347:x1876351933273856:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 195us (541us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.175955:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16325
00010000:00010000:3.0:1789431555.176016:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521e9f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1009d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a0f expref: 477 pid: 12181 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.176034:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce03d48380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894182272:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431555.176095:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e600/0xd8e438fb63521ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1009d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.176109:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e600/0xd8e438fb63521ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1009d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.176115:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e600/0xd8e438fb63521ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1009d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431555.176176:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1009d:0x0]: returning size 260096
00000004:00200000:3.0:1789431555.176182:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431555.176209:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e600/0xd8e438fb63521ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1009d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.176248:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2ec00/0xd8e438fb63521eb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1009d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a1d expref: 477 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.176265:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e600/0xd8e438fb63521ebb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1009d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a1d expref: 476 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.176273:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1009d:0x0].0x0 (ffff90ce15f0e500)
00010000:00010000:3.0:1789431555.176276:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431555.176278:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb2e600, rc 0)
00000100:00100000:3.0:1789431555.176313:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+476:14617:x1876351933273600:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9483us (9726us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.176333:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295295
00000100:00100000:3.0:1789431555.187096:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.207264:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933274496
00000100:00100000:3.0:1789431555.207281:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933274496
00000100:00100000:3.0:1789431555.213043:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.217250:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.227230:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.227290:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.232584:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.242693:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.242771:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.247016:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933275904
00000100:00100000:3.0:1789431555.247029:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933275904
00000100:00100000:3.0:1789431555.247117:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12258
00000100:00100000:3.0:1789431555.247128:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+482:14616:x1876351933275904:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431555.247864:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+481:14616:x1876351933275904:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 733us (997us total) trans 4295120623 rc 0/0
00000100:00100000:3.0:1789431555.247873:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12258
00000100:00100000:3.0:1789431555.254575:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.258995:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933276416
00000100:00100000:3.0:1789431555.259009:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933276416
00000100:00100000:3.0:1789431555.259097:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295302
00000100:00100000:3.0:1789431555.259110:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+482:14616:x1876351933276416:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431555.259190:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431555.259212:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63521ef3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a2b expref: 482 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.259227:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a57:0x0].0x0 (ffff90cf04d11800)
00010000:00010000:3.0:1789431555.259236:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431555.259263:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63521f63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.259280:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63521f63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.259291:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63521f63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.259306:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63521f6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.259321:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63521f6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.259330:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63521f6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.259473:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521f71 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a57:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.259481:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521f71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.259489:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521f71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431555.260182:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1181, 64 off83840
00000004:00080000:3.0:1789431555.260197:0:12181:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3013291147568ns, next at 3014291143284ns, rc = 0
00010000:00010000:3.0:1789431555.260270:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63521f78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a57:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260283:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63521f78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260292:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63521f78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260305:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63521f78 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260312:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63521f78 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260319:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63521f78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260336:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431555.260378:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521f71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260386:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521f71 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260393:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521f71 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260399:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b275600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431555.260403:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521f71 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260412:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521f71 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260424:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a57:0x0].0x0 (ffff90ce0f6c6e00)
00010000:00010000:3.0:1789431555.260427:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431555.260432:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521f71 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260442:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63521f71 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260462:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63521f63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260470:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63521f63 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260475:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63521f63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260480:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e74a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431555.260483:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63521f63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260489:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63521f63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260497:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x0 (ffff90ce27a54300)
00010000:00010000:3.0:1789431555.260499:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431555.260502:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63521f63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.260508:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63521f63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431555.260518:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bcc9f589 reply state 000000004eff2642 transno 4295120625 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63521f6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.260528:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431555.260647:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+483:14616:x1876351933276416:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1536us (2074us total) trans 4295120625 rc 0/0
00000100:00100000:3.0:1789431555.260657:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295302
00000100:00100000:3.0:1789431555.267501:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933276544
00000100:00100000:3.0:1789431555.267520:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933276544
00000100:00100000:3.0:1789431555.267678:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8095
00000100:00100000:3.0:1789431555.267692:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+115:2347:x1876351933276544:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431555.267717:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431555.267748:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb63521f7f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7a55 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431555.267795:0:14497:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431555.267831:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ee:0x0].0x0 since=3013s v=(0 0)
00010000:00010000:3.0:1789431555.267836:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ee:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431555.267848:0:14497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb63521f7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a55 expref: 116 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.267871:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb63521f7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a55 expref: 116 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.267886:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7acc00, rc 0)
00000100:00100000:3.0:1789431555.267978:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+116:2347:x1876351933276544:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 290us (2091us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.267986:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8095
00000100:00100000:3.0:1789431555.274396:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933276928
00000100:00100000:3.0:1789431555.274415:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933276928
00000100:00100000:3.0:1789431555.279439:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.285007:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933277184
00000100:00100000:3.0:1789431555.285022:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933277184
00000100:00100000:3.0:1789431555.288237:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933277440
00000100:00100000:3.0:1789431555.288251:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933277440
00010000:00010000:3.0:1789431555.290378:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431555.290387:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63521fbe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.290395:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb2e000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431555.290398:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63521fbe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.290405:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63521fbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.290469:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a58:0x0].0x0 (ffff90cf08772800)
00010000:00010000:3.0:1789431555.290472:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431555.290476:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63521fbe lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.290482:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63521fbe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.290503:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431555.290504:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431555.290507:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431555.300796:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933278080
00000100:00100000:3.0:1789431555.300811:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933278080
00000100:00100000:3.0:1789431555.300853:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295308
00000100:00100000:3.0:1789431555.300862:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+485:14617:x1876351933278080:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431555.300875:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431555.300889:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63521ff6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7a78 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.301030:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521ffd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1009b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.301044:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb6352071b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1009b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7291 expref: 486 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.301085:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0c00/0xd8e438fb63521fda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1009b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a6a expref: 486 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.301093:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521ffd lrc: 5/0,1 mode: --/CW res: [0x200000401:0x1009b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.301131:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0c00/0xd8e438fb63521fda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1009b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a6a expref: 486 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.301144:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0c00/0xd8e438fb63521fda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1009b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a6a expref: 486 pid: 12775 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.301158:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894182400:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431555.301232:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb6352071b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1009b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7291 expref: 486 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.301241:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb6352071b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1009b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7291 expref: 486 pid: 12775 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.301250:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e96680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894182528:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431555.301268:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf030e9780 going to sleep for 11 seconds
00010000:00010000:3.0:1789431555.305867:0:12181:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@0000000054149aa2 x1876351894182400) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0c00/0xd8e438fb63521fda lrc: 1/0,0 mode: --/PR res: [0x200000401:0x1009b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a6a expref: 486 pid: 12775 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.305898:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0c00/0xd8e438fb63521fda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1009b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a6a expref: 486 pid: 12775 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.305920:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894182400:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431555.305935:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e96680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894182528:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431555.305964:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1009b:0x0].0x0 (ffff90ce254b6500)
00010000:00010000:3.0:1789431555.305972:0:12181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521ffd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1009b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.305983:0:12181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521ffd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1009b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.305993:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521ffd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1009b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.309706:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521ffd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1009b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.309717:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521ffd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1009b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431555.309747:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1009b:0x0]: returning size 260096
00010000:00010000:3.0:1789431555.309972:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63521ff6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a78 expref: 486 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.309999:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521ffd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1009b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a78 expref: 485 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.310008:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1009b:0x0].0x0 (ffff90ce254b6500)
00010000:00010000:3.0:1789431555.310010:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431555.310013:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ace00, rc 0)
00000100:00100000:3.0:1789431555.310076:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+485:14617:x1876351933278080:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9215us (9502us total) trans 4295120628 rc 0/0
00000100:00100000:3.0:1789431555.310085:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295308
00000100:00100000:3.0:1789431555.310900:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933278464
00000100:00100000:3.0:1789431555.310911:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933278464
00000100:00100000:3.0:1789431555.310965:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295309
00000100:00100000:3.0:1789431555.310975:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+485:14616:x1876351933278464:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431555.310997:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431555.311000:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431555.311024:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37474000/0xd8e438fb63521fa2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10098:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a63 expref: 485 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.311039:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x0 (ffff90ce27a54300)
00010000:00010000:3.0:1789431555.311043:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431555.311088:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb6352200b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7a7f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.311217:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63522012 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.311237:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63522012 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.311247:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63522012 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.311263:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63522019 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.311270:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63522019 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.311277:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63522019 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:3.0:1789431555.311894:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4ee:0x0], index 1: 0
00010000:00010000:3.0:1789431555.312169:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63522020 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.312184:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63522020 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.312195:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63522020 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.312230:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63522012 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.312237:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63522012 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.312249:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63522012 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.312255:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e74200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431555.312260:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63522012 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.312269:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63522012 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.312280:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x0 (ffff90ce27a54300)
00010000:00010000:3.0:1789431555.312284:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431555.312289:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63522012 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.312295:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63522012 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431555.312309:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f8c5dd42 reply state 000000008deef6a6 transno 4295120629 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63522019 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.312319:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431555.312356:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb6352200b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a7f expref: 487 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.312373:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63522020 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a7f expref: 486 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.312381:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a59:0x0].0x0 (ffff90ce0f6c6e00)
00010000:00010000:3.0:1789431555.312383:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431555.312386:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b274400, rc 0)
00000100:00100000:3.0:1789431555.312460:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+487:14616:x1876351933278464:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1486us (1629us total) trans 4295120629 rc 0/0
00000100:00100000:3.0:1789431555.312469:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295309
00000100:00100000:3.0:1789431555.322611:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933278592
00000100:00100000:3.0:1789431555.322624:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933278592
00000100:00100000:3.0:1789431555.322677:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295310
00000100:00100000:3.0:1789431555.322687:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+486:14617:x1876351933278592:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431555.322719:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431555.322738:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb6352202e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1009b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7a86 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.322849:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0c00/0xd8e438fb63522035 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1009b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.322864:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521ffd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1009b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a78 expref: 487 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.322874:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0c00/0xd8e438fb63522035 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1009b:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.322914:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521ffd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1009b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a78 expref: 487 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.322928:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521ffd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1009b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a78 expref: 487 pid: 12181 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.322945:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e96680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894182656:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431555.323069:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf030e9b40 going to sleep for 11 seconds
00010000:00010000:3.0:1789431555.329011:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63521ffd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1009b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a78 expref: 487 pid: 12181 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.329039:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e96680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894182656:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431555.330238:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0c00/0xd8e438fb63522035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1009b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.330753:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933278976
00000100:00100000:3.0:1789431555.330762:0:14499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933278976
00000100:00100000:3.0:1789431555.331030:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8097
00000100:00100000:3.0:1789431555.331042:0:14499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+106:14616:x1876351933278976:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431555.331079:0:14499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431555.331101:0:14499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000edad4ed/0xd8e438fb63522043 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7a94 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.331136:0:14499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f909f98a/0xd8e438fb6352203c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a8d expref: 107 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.331147:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ee:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431555.331152:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ee:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431555.331158:0:14499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000edad4ed/0xd8e438fb63522043 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a94 expref: 107 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.331194:0:14499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f909f98a/0xd8e438fb6352203c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a8d expref: 107 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.331214:0:14499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f909f98a/0xd8e438fb6352203c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a8d expref: 107 pid: 8217 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.331230:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:14499:1876351894182784:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431555.331295:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf030e9b40 going to sleep for 11 seconds
00000100:00100000:3.0:1789431555.335041:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:14499:1876351894182784:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431555.335108:0:14499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000edad4ed/0xd8e438fb63522043 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a94 expref: 107 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.335135:0:14499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf18a57600, rc 0)
00000100:00100000:3.0:1789431555.335214:0:14499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+107:14616:x1876351933278976:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4173us (4560us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.335225:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8097
00000100:00100000:3.0:1789431555.355458:0:6715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce03d4ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6715:1876351894182912:192.168.203.4@tcp:105:
00010000:00010000:3.0:1789431555.355482:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431555.355569:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+106:2348:x1876351933279104:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 16940us (17178us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.355578:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16329
00010000:00010000:3.0:1789431555.377649:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431555.379857:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933280384
00000100:00100000:3.0:1789431555.379869:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933280384
00010000:00010000:3.0:1789431555.379919:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612c00/0xd8e438fb6352206d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100f2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7aa2 expref: 491 pid: 5847 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.379972:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16331
00000100:00100000:3.0:1789431555.379983:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+491:2347:x1876351933280384:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431555.380003:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431555.380011:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612c00/0xd8e438fb6352206d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100f2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7aa2 expref: 491 pid: 5847 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.380027:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612c00/0xd8e438fb6352206d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100f2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7aa2 expref: 491 pid: 5847 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.380089:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612c00/0xd8e438fb6352206d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100f2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7aa2 expref: 491 pid: 5847 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.380105:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100f2:0x0].0x0 (ffff90ce15f08500)
00010000:00010000:3.0:1789431555.380111:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59e00/0xd8e438fb63522082 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100f2:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.380122:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59e00/0xd8e438fb63522082 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.380132:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59e00/0xd8e438fb63522082 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.396527:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933280768
00000100:00100000:3.0:1789431555.396541:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933280768
00000100:00100000:3.0:1789431555.396612:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295315
00000100:00100000:3.0:1789431555.396622:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+489:14616:x1876351933280768:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431555.396653:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431555.396680:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb635220a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7ab7 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.396817:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635220ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.396834:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b000/0xd8e438fb6350ca0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c11fd expref: 490 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.396843:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb6352209e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ab0 expref: 490 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.396851:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635220ac lrc: 5/0,1 mode: --/CW res: [0x200000401:0x100ad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.396894:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb6352209e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ab0 expref: 490 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.396909:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb6352209e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ab0 expref: 490 pid: 12181 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.396924:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e96680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894183296:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431555.397034:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b000/0xd8e438fb6350ca0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c11fd expref: 490 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.397043:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b000/0xd8e438fb6350ca0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c11fd expref: 490 pid: 5847 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.397082:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894183424:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431555.397108:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf030e9b40 going to sleep for 11 seconds
00010000:00010000:3.0:1789431555.407129:0:12775:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@00000000050de0a5 x1876351894183296) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb6352209e lrc: 1/0,0 mode: --/PR res: [0x200000401:0x100ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ab0 expref: 490 pid: 12181 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.407161:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb6352209e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ab0 expref: 490 pid: 12181 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.407183:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e96680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894183296:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431555.407198:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894183424:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431555.407230:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ad:0x0].0x0 (ffff90ce03dbb700)
00010000:00010000:3.0:1789431555.407237:0:12775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635220ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.407247:0:12775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635220ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.407258:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635220ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.409098:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933280896
00000100:00100000:3.0:1789431555.409109:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933280896
00010000:00010000:3.0:1789431555.409159:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b000/0xd8e438fb6350ca0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c11fd expref: 490 pid: 5847 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.409206:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16333
00000100:00100000:3.0:1789431555.409217:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+490:2348:x1876351933280896:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431555.409237:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431555.409245:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b000/0xd8e438fb6350ca0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c11fd expref: 490 pid: 5847 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.409262:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b000/0xd8e438fb6350ca0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c11fd expref: 490 pid: 5847 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.409291:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b000/0xd8e438fb6350ca0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c11fd expref: 490 pid: 5847 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.409321:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ad:0x0].0x0 (ffff90ce03dbb700)
00010000:00010000:3.0:1789431555.409327:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635220ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.409348:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635220ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.409358:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635220ac lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100ad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.409393:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431555.409460:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+489:2348:x1876351933280896:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 244us (660us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.409469:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16333
00000100:00100000:3.0:1789431555.447619:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16335
00000100:00100000:3.0:1789431555.447631:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a054e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+494:2347:x1876351933281664:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431555.447641:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431555.447648:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635220ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100ad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ab7 expref: 494 pid: 12775 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.447659:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635220ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ab7 expref: 494 pid: 12775 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.447673:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635220ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100ad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ab7 expref: 494 pid: 12775 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.447689:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ad:0x0].0x0 (ffff90ce03dbb700)
00010000:00010000:3.0:1789431555.447694:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb635220c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100ad:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.447703:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb635220c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.447711:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb635220c1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.447740:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431555.447763:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a054e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+493:2347:x1876351933281664:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 136us (916us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.447770:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16335
00000100:00100000:3.0:1789431555.476609:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.493374:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933282816
00000100:00100000:3.0:1789431555.493380:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933282816
00000100:00100000:3.0:1789431555.493426:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14314
00000100:00100000:3.0:1789431555.493435:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+494:2347:x1876351933282816:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431555.493451:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431555.493478:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352211c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ada expref: 494 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.493496:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ad:0x0].0x0 (ffff90ce03dbb700)
00010000:00010000:3.0:1789431555.493502:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431555.493572:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+493:2347:x1876351933282816:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 139us (375us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.493580:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14314
00000100:00100000:3.0:1789431555.499910:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.508858:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.520326:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.524721:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.530996:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933283456
00000100:00100000:3.0:1789431555.531011:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933283456
00000100:00100000:3.0:1789431555.531131:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14315
00000100:00100000:3.0:1789431555.531144:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e8a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+493:2350:x1876351933283456:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431555.531165:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431555.531200:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37474000/0xd8e438fb6352215b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7aef expref: 493 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.531224:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100f5:0x0].0x0 (ffff90cf22548700)
00010000:00010000:3.0:1789431555.531230:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431555.531300:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e8a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+492:2350:x1876351933283456:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 159us (428us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.531319:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14315
00000100:00100000:3.0:1789431555.535156:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.546874:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.553664:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.553756:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.558457:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.558496:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.563720:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431555.564595:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1400/0xd8e438fb635221a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100f5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.564604:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1400/0xd8e438fb635221a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100f5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.564642:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933284864
00000100:00100000:3.0:1789431555.564646:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933284864
00000100:00100000:3.0:1789431555.564715:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12263
00000100:00100000:3.0:1789431555.564724:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+496:14616:x1876351933284864:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431555.600642:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933285376
00000100:00100000:3.0:1789431555.600656:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933285376
00000100:00100000:3.0:1789431555.600761:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12265
00000100:00100000:3.0:1789431555.600774:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+496:14616:x1876351933285376:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431555.601159:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+497:14616:x1876351933285376:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 386us (630us total) trans 4295120639 rc 0/0
00000100:00100000:3.0:1789431555.601168:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12265
00000100:00100000:3.0:1789431555.621137:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933285632
00000100:00100000:3.0:1789431555.621152:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933285632
00000100:00100000:3.0:1789431555.621230:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295329
00000100:00100000:3.0:1789431555.621243:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+497:14616:x1876351933285632:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431555.621435:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431555.621469:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635221bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7b19 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.621622:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635221c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10a59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.621641:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63522020 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10a59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a7f expref: 498 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.621653:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635221c4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10a59:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.621699:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63522020 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a7f expref: 498 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.621715:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63522020 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10a59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a7f expref: 498 pid: 5847 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.621731:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e94000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894184576:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431555.622161:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf11d04600 going to sleep for 11 seconds
00010000:00010000:3.0:1789431555.632160:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63522020 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a7f expref: 498 pid: 5847 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.632178:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e94000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894184576:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431555.632205:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635221c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10a59:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.632215:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635221c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10a59:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.632221:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635221c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10a59:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431555.632247:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10a59:0x0]: returning size 29253
00010000:00010000:3.0:1789431555.636776:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635221bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b19 expref: 501 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.639709:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635221c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10a59:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b19 expref: 498 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.639729:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a59:0x0].0x0 (ffff90ce0f6c6e00)
00010000:00010000:3.0:1789431555.639732:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431555.639737:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf18a56200, rc 0)
00000100:00100000:3.0:1789431555.639911:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+498:14616:x1876351933285632:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 18668us (18926us total) trans 4295120640 rc 0/0
00000100:00100000:3.0:1789431555.639922:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295329
00000100:00100000:3.0:1789431555.641605:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.650162:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.650241:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.651488:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933286144
00000100:00100000:3.0:1789431555.651508:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933286144
00000100:00100000:3.0:1789431555.651586:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295332
00000100:00100000:3.0:1789431555.651598:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+499:14616:x1876351933286144:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431555.651632:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431555.651659:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635221f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10a59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7b2e expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.651768:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56c00/0xd8e438fb635221fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.651802:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635221c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10a59:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b19 expref: 500 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.651814:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56c00/0xd8e438fb635221fc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10a59:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.651862:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635221c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10a59:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b19 expref: 500 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.651879:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635221c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10a59:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b19 expref: 500 pid: 12775 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.651894:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894184704:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431555.652004:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3a815300 going to sleep for 11 seconds
00000100:00100000:3.0:1789431555.679691:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+500:14617:x1876351933286272:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 25367us (29436us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.679707:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12266
00000100:00100000:3.0:1789431555.687602:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894184832:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431555.687654:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431555.687704:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894185344:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431555.687729:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431555.687746:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894185856:0@lo:6:osp-syn-1-0.0
00000100:00100000:3.0:1789431555.687766:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431555.687814:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894186368:0@lo:6:osp-syn-1-0.0
00000100:00100000:3.0:1789431555.687838:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431555.687865:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3]
00000100:00100000:3.0:1789431555.687872:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894185216:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431555.687897:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431555.687922:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf087a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894185728:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431555.687952:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431555.687975:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894186240:0@lo:6:osp-syn-1-0.0
00000100:00100000:3.0:1789431555.687999:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431555.688024:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894186752:0@lo:6:osp-syn-1-0.0
00000100:00100000:3.0:1789431555.688090:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431555.688144:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894184960
00000100:00100000:3.0:1789431555.688152:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894184960
00000100:00100000:3.0:1789431555.688206:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894185472
00000100:00100000:3.0:1789431555.688210:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894185472
00000100:00100000:3.0:1789431555.688234:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894185088
00000100:00100000:3.0:1789431555.688238:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894185088
00000100:00100000:3.0:1789431555.688262:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894185600
00000100:00100000:3.0:1789431555.688266:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894185600
00000100:00100000:3.0:1789431555.688287:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894184832
00000100:00100000:3.0:1789431555.688290:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894184832
00000100:00100000:3.0:1789431555.688314:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894185344
00000100:00100000:3.0:1789431555.688317:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894185344
00000100:00100000:3.0:1789431555.688336:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894185856
00000100:00100000:3.0:1789431555.688338:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894185856
00000100:00100000:3.0:1789431555.688368:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894186368
00000100:00100000:3.0:1789431555.688371:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894186368
00000100:00100000:3.0:1789431555.688384:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894185216
00000100:00100000:3.0:1789431555.688386:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894185216
00000100:00100000:3.0:1789431555.688395:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894185728
00000100:00100000:3.0:1789431555.688398:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894185728
00000100:00100000:3.0:1789431555.688412:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894186240
00000100:00100000:3.0:1789431555.688415:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894186240
00000100:00100000:3.0:1789431555.688425:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894186752
00000100:00100000:3.0:1789431555.688427:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894186752
00000100:00100000:3.0:1789431555.688446:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8098
00000100:00100000:3.0:1789431555.688456:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf087a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3311:x1876351894184960:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:3.0:1789431555.688488:0:14469:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1242 count 1
00010000:00010000:3.0:1789431555.688516:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63522226 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.688540:0:14469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007d2dcbad/0xd8e438fb6351f850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6dcf expref: 115 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.688550:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4da:0x0].0x0 since=6s v=(0 0)
00010000:00010000:3.0:1789431555.688556:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4da:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431555.688561:0:14469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63522226 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.688595:0:14469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007d2dcbad/0xd8e438fb6351f850 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6dcf expref: 115 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.688612:0:14469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007d2dcbad/0xd8e438fb6351f850 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6dcf expref: 115 pid: 6698 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.688628:0:14469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a044000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14469:1876351894186880:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431555.688681:0:14469:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3a8159c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431555.688701:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8099
00000100:00100000:3.0:1789431555.688708:0:14472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf087a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3311:x1876351894185472:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:3.0:1789431555.688722:0:14472:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1250 count 1
00010000:00010000:3.0:1789431555.688735:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2c7be19/0xd8e438fb6352222d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.688748:0:14472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dcd55265/0xd8e438fb635205fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c723d expref: 115 pid: 14472 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.688756:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4e2:0x0].0x0 since=4s v=(0 0)
00010000:00010000:3.0:1789431555.688758:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4e2:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431555.688762:0:14472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2c7be19/0xd8e438fb6352222d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.688796:0:14472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dcd55265/0xd8e438fb635205fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c723d expref: 115 pid: 14472 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.688806:0:14472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dcd55265/0xd8e438fb635205fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c723d expref: 115 pid: 14472 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.688817:0:14472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a046680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14472:1876351894187008:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431555.688844:0:14472:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3a8150c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431555.688866:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8100
00000100:00100000:3.0:1789431555.688874:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf087a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3311:x1876351894185088:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:3.0:1789431555.688888:0:14486:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1248 count 1
00010000:00010000:3.0:1789431555.688902:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8c51b6c/0xd8e438fb63522234 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.688913:0:14486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d8846b2/0xd8e438fb635202fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7141 expref: 115 pid: 14482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.688921:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4e0:0x0].0x0 since=4s v=(0 0)
00010000:00010000:3.0:1789431555.688923:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4e0:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431555.688927:0:14486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8c51b6c/0xd8e438fb63522234 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.688946:0:14486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d8846b2/0xd8e438fb635202fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7141 expref: 115 pid: 14482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.688956:0:14486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d8846b2/0xd8e438fb635202fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7141 expref: 115 pid: 14482 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.688967:0:14486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a046d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14486:1876351894187136:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431555.688992:0:14486:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3a815c00 going to sleep for 11 seconds
00000100:00100000:3.0:1789431555.689013:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8101
00000100:00100000:3.0:1789431555.689021:0:14464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf087a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3311:x1876351894185600:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:3.0:1789431555.689038:0:14464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1252 count 1
00010000:00010000:3.0:1789431555.689079:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4ab51f7/0xd8e438fb6352223b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.689092:0:14464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6f93f9d/0xd8e438fb635208b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7316 expref: 115 pid: 14482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.689099:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4e4:0x0].0x0 since=3s v=(0 0)
00010000:00010000:3.0:1789431555.689102:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4e4:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431555.689105:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ab51f7/0xd8e438fb6352223b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.689125:0:14464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6f93f9d/0xd8e438fb635208b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7316 expref: 115 pid: 14482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.689136:0:14464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6f93f9d/0xd8e438fb635208b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7316 expref: 115 pid: 14482 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.689146:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a047b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14464:1876351894187264:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431555.689183:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3a815180 going to sleep for 11 seconds
00000100:00100000:3.0:1789431555.689208:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8102
00000100:00100000:3.0:1789431555.689218:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+12:3314:x1876351894184832:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:3.0:1789431555.689234:0:14497:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1239 count 1
00010000:00010000:3.0:1789431555.689250:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cfe7545/0xd8e438fb63522242 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.689273:0:14497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf38c5f1/0xd8e438fb6351f3bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6c71 expref: 115 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.689282:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4d7:0x0].0x0 since=7s v=(0 0)
00010000:00010000:3.0:1789431555.689286:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431555.689290:0:14497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cfe7545/0xd8e438fb63522242 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.689321:0:14497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cf38c5f1/0xd8e438fb6351f3bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6c71 expref: 115 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.689336:0:14497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cf38c5f1/0xd8e438fb6351f3bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6c71 expref: 115 pid: 14502 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.689348:0:14497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a045500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14497:1876351894187392:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431555.689386:0:14497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3a815b40 going to sleep for 11 seconds
00000100:00100000:3.0:1789431555.689411:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894186112
00000100:00100000:3.0:1789431555.689423:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894186112
00000100:00100000:3.0:1789431555.689453:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894185984
00000100:00100000:3.0:1789431555.689459:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894185984
00000100:00100000:3.0:1789431555.689484:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8103
00000100:00100000:3.0:1789431555.689496:0:14482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3314:x1876351894185344:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:3.0:1789431555.689513:0:14482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1246 count 1
00010000:00010000:3.0:1789431555.689530:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003102b737/0xd8e438fb63522249 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4de:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.689549:0:14482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000213bdec2/0xd8e438fb6351ff1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6fff expref: 115 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.689570:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4de:0x0].0x0 since=5s v=(0 0)
00010000:00010000:3.0:1789431555.689573:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4de:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431555.689578:0:14482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003102b737/0xd8e438fb63522249 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.689615:0:14482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000213bdec2/0xd8e438fb6351ff1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6fff expref: 115 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.689641:0:14482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000213bdec2/0xd8e438fb6351ff1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6fff expref: 115 pid: 14491 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.689654:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a047800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14482:1876351894187520:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431555.689685:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3a815e40 going to sleep for 11 seconds
00000100:00100000:3.0:1789431555.689709:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8105
00000100:00100000:3.0:1789431555.689719:0:14499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+12:3314:x1876351894186368:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:3.0:1789431555.689740:0:14499:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1247 count 1
00010000:00010000:3.0:1789431555.689758:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63522257 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4df:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.689774:0:14499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002796176a/0xd8e438fb63520355 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c715d expref: 105 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.689805:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4df:0x0].0x0 since=4s v=(0 0)
00010000:00010000:3.0:1789431555.689809:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4df:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431555.689817:0:14499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63522257 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.689844:0:14499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002796176a/0xd8e438fb63520355 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c715d expref: 105 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.689864:0:14499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002796176a/0xd8e438fb63520355 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c715d expref: 105 pid: 14500 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.689889:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a046300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:14499:1876351894187776:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431555.689916:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3a815240 going to sleep for 11 seconds
00010000:00010000:3.0:1789431555.693673:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63522211 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.693693:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63522211 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.693702:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63522211 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.693711:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431555.693717:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63522211 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.693726:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63522211 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.693747:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xd1e76203 (ffff90ce2d731400)
00010000:00010000:3.0:1789431555.693751:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431555.693758:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63522211 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.693766:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63522211 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.704017:0:14469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a044000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14469:1876351894186880:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431555.704084:0:14469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63522226 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.709604:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a047800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14482:1876351894187520:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431555.709637:0:14482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003102b737/0xd8e438fb63522249 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.709990:0:14469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63522226 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.710001:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63522226 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.710013:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63522226 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.710021:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63522226 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.710072:0:14469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:3.0:1789431555.710676:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf087a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3311:x1876351894184960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22219us (24101us total) trans 4294969562 rc 0/0
00000100:00100000:3.0:1789431555.710686:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8098
00000100:00100000:3.0:1789431555.727034:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a046300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:14499:1876351894187776:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431555.727088:0:14499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63522257 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.728506:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16352
00000100:00100000:3.0:1789431555.728517:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+107:2348:x1876351933288960:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431555.728527:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431555.728534:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b132c3c8/0xd8e438fb63520ca1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7451 expref: 107 pid: 6700 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.728545:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b132c3c8/0xd8e438fb63520ca1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7451 expref: 107 pid: 6700 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.728560:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e6:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431555.728563:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e6:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431555.728568:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb635222ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.728577:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb635222ab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.728593:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431555.728617:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+107:2348:x1876351933288960:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 102us (2096us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.728623:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16352
00010000:00010000:3.0:1789431555.728677:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b132c3c8/0xd8e438fb63520ca1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7451 expref: 106 pid: 6700 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.728699:0:14501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf087a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14501:1876351894188800:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431555.728720:0:14501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb635222ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.728731:0:14501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb635222ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.728740:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb635222ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.728751:0:14501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb635222ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.728759:0:14501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb635222ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.728797:0:14501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:3.0:1789431555.729466:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+13:3312:x1876351894186496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32218us (40065us total) trans 4294969957 rc 0/0
00000100:00100000:3.0:1789431555.729477:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8113
00000100:00100000:3.0:1789431555.729502:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933289088
00000100:00100000:3.0:1789431555.729509:0:14501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933289088
00000100:00100000:3.0:1789431555.729549:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8115
00000100:00100000:3.0:1789431555.729558:0:14501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+113:2349:x1876351933289088:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431555.729575:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431555.729597:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d83003b2/0xd8e438fb635222b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7b43 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431555.729627:0:14501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431555.729645:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ef:0x0].0x0 since=3013s v=(0 0)
00010000:00010000:3.0:1789431555.729649:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ef:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431555.729657:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d83003b2/0xd8e438fb635222b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b43 expref: 114 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.729673:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d83003b2/0xd8e438fb635222b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b43 expref: 114 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.729685:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ae59400, rc 0)
00000100:00100000:3.0:1789431555.729714:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+114:2349:x1876351933289088:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 158us (3166us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.729720:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8115
00010000:00010000:3.0:1789431555.735020:0:14482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003102b737/0xd8e438fb63522249 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.735511:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003102b737/0xd8e438fb63522249 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.735523:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003102b737/0xd8e438fb63522249 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.735532:0:14482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003102b737/0xd8e438fb63522249 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.735566:0:14482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:3.0:1789431555.736133:0:14482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3314:x1876351894185344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 46636us (48397us total) trans 4294969565 rc 0/0
00000100:00100000:3.0:1789431555.736150:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8103
00000004:00080000:3.0:1789431555.736241:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3bbf6d80/2, rc 0, transno 4294969565
00000100:00100000:3.0:1789431555.736253:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894185344:0@lo:6:osp-syn-0-0.0
00010000:00010000:3.0:1789431555.740565:0:14505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002d80445/0xd8e438fb6351fcf6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6f3b expref: 102 pid: 14482 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.740588:0:14505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:14505:1876351894187648:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431555.741759:0:14505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009bf89bc7/0xd8e438fb63522250 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.741794:0:14505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009bf89bc7/0xd8e438fb63522250 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.741809:0:14505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bf89bc7/0xd8e438fb63522250 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.741822:0:14505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bf89bc7/0xd8e438fb63522250 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.741830:0:14505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bf89bc7/0xd8e438fb63522250 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.741851:0:14505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:3.0:1789431555.744294:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+14:3314:x1876351894185856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 54790us (56523us total) trans 4294969960 rc 0/0
00000100:00100000:3.0:1789431555.744305:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8104
00000100:00100000:3.0:1789431555.744791:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933289600
00000100:00100000:3.0:1789431555.744857:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933289600
00000100:00100000:3.0:1789431555.745352:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295335
00000100:00100000:3.0:1789431555.745363:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf087a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+257:14616:x1876351933289600:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431555.745389:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431555.745417:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb635222dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7b4a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.745502:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635222e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.745527:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635222e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.745552:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635222e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.745578:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb635222ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10098:0x0].0x3857f8dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.745589:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb635222ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.745606:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb635222ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.748862:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635222e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.748872:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635222e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.748878:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635222e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.748883:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ae59600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431555.748887:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635222e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.748893:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635222e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.748907:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x0 (ffff90ce27a54300)
00010000:00010000:3.0:1789431555.748911:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431555.748916:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635222e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.748922:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635222e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.748937:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb635222ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.748944:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb635222ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.748949:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb635222ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.748953:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e74a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431555.748956:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb635222ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.748961:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb635222ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.748967:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x3857f8dc (ffff90ce2d731400)
00010000:00010000:3.0:1789431555.748970:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431555.748972:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb635222ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10098:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.748977:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb635222ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10098:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.749651:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb635222dc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b4a expref: 257 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.749672:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x0 (ffff90ce27a54300)
00010000:00010000:3.0:1789431555.749675:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431555.749680:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb635222dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b4a expref: 257 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.749693:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ae58200, rc 0)
00000100:00100000:3.0:1789431555.749750:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf087a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+256:14616:x1876351933289600:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4388us (5306us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431555.749759:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295335
00010000:00010000:3.0:1789431555.749813:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431555.749821:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cfe7545/0xd8e438fb63522242 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.749829:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb2f800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431555.749833:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cfe7545/0xd8e438fb63522242 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.749841:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cfe7545/0xd8e438fb63522242 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.749854:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cfe7545/0xd8e438fb63522242 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.749861:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cfe7545/0xd8e438fb63522242 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.749885:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431555.749887:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431555.749889:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431555.749903:0:14499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63522257 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.749912:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63522257 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.749919:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63522257 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.749926:0:14499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63522257 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.749939:0:14499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:3.0:1789431555.750559:0:14499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+14:3314:x1876351894186368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 60840us (62718us total) trans 4294969963 rc 0/0
00000100:00100000:3.0:1789431555.750568:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8105
00000100:00100000:3.0:1789431555.751513:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1a56b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1876351894189312:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431555.751534:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002386c4fe/0xd8e438fb635222c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.753322:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933289728
00000100:00100000:3.0:1789431555.753339:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933289728
00010000:00010000:3.0:1789431555.753406:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096242664/0xd8e438fb63520d6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7490 expref: 108 pid: 6698 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.753467:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933289984
00000100:00100000:3.0:1789431555.753471:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933289984
00010000:00010000:3.0:1789431555.753486:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006427cb9a/0xd8e438fb63521354 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c767a expref: 109 pid: 6699 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.753513:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933289856
00000100:00100000:3.0:1789431555.753516:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933289856
00010000:00010000:3.0:1789431555.753533:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb63521f16 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a32 expref: 98 pid: 6700 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.753558:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16361
00000100:00100000:3.0:1789431555.753569:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf087a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+109:2347:x1876351933289728:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431555.753590:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431555.753596:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096242664/0xd8e438fb63520d6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7490 expref: 109 pid: 6698 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.753611:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096242664/0xd8e438fb63520d6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7490 expref: 109 pid: 6698 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.753641:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096242664/0xd8e438fb63520d6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7490 expref: 109 pid: 6698 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.753662:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4e7:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431555.753668:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4e7:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431555.753676:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002386c4fe/0xd8e438fb635222c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.753687:0:14506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002386c4fe/0xd8e438fb635222c0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.753720:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431555.755911:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf087a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+106:2347:x1876351933289728:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 236us (2089us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.755923:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16361
00010000:00010000:3.0:1789431555.756386:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002386c4fe/0xd8e438fb635222c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.756399:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002386c4fe/0xd8e438fb635222c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.756412:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002386c4fe/0xd8e438fb635222c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.756430:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002386c4fe/0xd8e438fb635222c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.756457:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:3.0:1789431555.761126:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3311:x1876351894189184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29778us (29875us total) trans 4294969570 rc 0/0
00000100:00100000:3.0:1789431555.762830:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8116
00010000:00010000:3.0:1789431555.763102:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431555.763112:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63522265 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.763124:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3c00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431555.763129:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63522265 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.763207:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63522265 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.763233:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63522265 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.763241:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63522265 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.763269:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431555.763271:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431555.763272:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:3.0:1789431555.763318:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3bbf7480/2, rc 0, transno 4294969566
00000100:00100000:3.0:1789431555.763335:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894185472:0@lo:6:osp-syn-0-0.0
00000004:00080000:3.0:1789431555.763364:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf087a1880/2, rc 0, transno 4294969571
00000100:00100000:3.0:1789431555.763368:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf087a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894185728:0@lo:6:osp-syn-0-0.0
00010000:00010000:3.0:1789431555.766018:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431555.778612:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933290368
00000100:00100000:3.0:1789431555.778628:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933290368
00010000:00010000:3.0:1789431555.778691:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b8eaf536/0xd8e438fb635218b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7833 expref: 106 pid: 8217 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.778746:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933290496
00000100:00100000:3.0:1789431555.778750:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933290496
00010000:00010000:3.0:1789431555.778765:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1bf7dc6/0xd8e438fb63520fd4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c755b expref: 107 pid: 14505 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.778803:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16364
00000100:00100000:3.0:1789431555.778814:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+107:2349:x1876351933290368:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431555.778834:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431555.778841:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b8eaf536/0xd8e438fb635218b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7833 expref: 107 pid: 8217 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.778854:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b8eaf536/0xd8e438fb635218b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7833 expref: 107 pid: 8217 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.778882:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8eaf536/0xd8e438fb635218b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7833 expref: 107 pid: 8217 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.778907:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4eb:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431555.778912:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4eb:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431555.778920:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb635222f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.778932:0:14506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb635222f1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.778967:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431555.779030:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+105:2349:x1876351933290368:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 217us (2147us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.779038:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16364
00000100:00100000:3.0:1789431555.790436:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933290752
00000100:00100000:3.0:1789431555.790448:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933290752
00000100:00100000:3.0:1789431555.790509:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12269
00000100:00100000:3.0:1789431555.790520:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+256:14617:x1876351933290752:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431555.790953:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+257:14617:x1876351933290752:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 433us (703us total) trans 4295120644 rc 0/0
00000100:00100000:3.0:1789431555.790963:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12269
00000100:00100000:3.0:1789431555.798483:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.798548:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.805267:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.814293:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.818276:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.828575:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.828690:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.836104:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431555.840268:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431555.840404:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee400/0xd8e438fb6352234c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.840415:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b9ee400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431555.840419:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee400/0xd8e438fb6352234c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.840433:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee400/0xd8e438fb6352234c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.840448:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a5a:0x0].0x0 (ffff90ce2e707a00)
00010000:00010000:3.0:1789431555.840451:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431555.840455:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee400/0xd8e438fb6352234c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.840461:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee400/0xd8e438fb6352234c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.840490:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431555.840492:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431555.840493:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431555.848914:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb6352233e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.848936:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb6352233e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.848944:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb6352233e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.848951:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b274400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431555.848957:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb6352233e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.848965:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb6352233e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.848986:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xd1e76203 (ffff90ce2e707c00)
00010000:00010000:3.0:1789431555.848991:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431555.848998:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb6352233e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.849005:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb6352233e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.851114:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.851209:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.884628:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933293440
00000100:00100000:3.0:1789431555.884645:0:14505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933293440
00000100:00100000:3.0:1789431555.884724:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8121
00000100:00100000:3.0:1789431555.884736:0:14505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+97:2347:x1876351933293440:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431555.884761:0:14505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431555.884798:0:14505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008999eb73/0xd8e438fb635223d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7b7b expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431555.884832:0:14505:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431555.884857:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ef:0x0].0x0 since=3013s v=(0 0)
00010000:00010000:3.0:1789431555.884862:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ef:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431555.884872:0:14505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008999eb73/0xd8e438fb635223d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b7b expref: 98 pid: 14505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.884891:0:14505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008999eb73/0xd8e438fb635223d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b7b expref: 98 pid: 14505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.884907:0:14505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37e74a00, rc 0)
00000100:00100000:3.0:1789431555.884971:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+98:2347:x1876351933293440:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 238us (3507us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.884980:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8121
00010000:00010000:3.0:1789431555.888886:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635223bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.888913:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635223bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.888923:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635223bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.888930:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b9ee600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431555.888935:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635223bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.888945:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635223bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.888966:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xd1e76203 (ffff90ce2e707100)
00010000:00010000:3.0:1789431555.888970:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431555.888976:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635223bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.888983:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635223bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.902246:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933294208
00000100:00100000:3.0:1789431555.902263:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933294208
00010000:00010000:3.0:1789431555.903837:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008999eb73/0xd8e438fb635223d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b7b expref: 100 pid: 14505 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431555.903863:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1a568000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14468:1876351894190464:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431555.903897:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021b8b20c/0xd8e438fb635223df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b90 expref: 99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.903908:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae2a00, rc 0)
00000100:00100000:3.0:1789431555.903954:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+99:14616:x1876351933293952:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9104us (9698us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.903963:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8123
00000100:00100000:3.0:1789431555.916995:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.931449:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.948899:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933295232
00000100:00100000:3.0:1789431555.948912:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933295232
00000100:00100000:3.0:1789431555.948977:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295347
00000100:00100000:3.0:1789431555.948988:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+265:14617:x1876351933295232:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431555.949013:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431555.949038:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63522417 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7b9e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949150:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352241e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949167:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352241e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949180:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352241e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949200:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63522425 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949207:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63522425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949213:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63522425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949278:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352241e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949285:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352241e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949291:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352241e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949298:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e74200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431555.949303:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352241e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949323:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352241e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949334:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431555.949338:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431555.949343:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352241e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949350:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352241e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949364:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63522425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949370:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63522425 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949376:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63522425 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949381:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bad0400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431555.949383:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63522425 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949389:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63522425 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949395:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x6ed7d01b (ffff90ce2e707c00)
00010000:00010000:3.0:1789431555.949397:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431555.949399:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63522425 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949404:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63522425 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949438:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63522417 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b9e expref: 266 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949447:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431555.949449:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431555.949453:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63522417 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b9e expref: 266 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431555.949463:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37e74a00, rc 0)
00000100:00100000:3.0:1789431555.949531:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+265:14617:x1876351933295232:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 545us (736us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431555.949539:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295347
00000100:00100000:3.0:1789431555.951589:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.964098:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.986871:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431555.989429:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+269:14617:x1876351933295744:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 12376us (12582us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431555.989445:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12278
00000100:00100000:3.0:1789431556.016327:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.023900:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933296896
00000100:00100000:3.0:1789431556.023913:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933296896
00000100:00100000:3.0:1789431556.023996:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14318
00000100:00100000:3.0:1789431556.024007:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+270:2348:x1876351933296896:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431556.024026:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431556.024076:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63522480 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7bc1 expref: 270 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.024098:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a59:0x0].0x0 (ffff90cf04a08200)
00010000:00010000:3.0:1789431556.024105:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431556.024176:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+269:2348:x1876351933296896:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 171us (520us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431556.024184:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14318
00010000:00010000:3.0:1789431556.051422:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635224c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd31a9c98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.051491:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635224c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd31a9c98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.051501:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635224c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd31a9c98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.051508:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.051513:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635224c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd31a9c98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.051522:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635224c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd31a9c98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.051547:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xd31a9c98 (ffff90cf3afe7200)
00010000:00010000:3.0:1789431556.051552:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.051558:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635224c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd31a9c98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.051564:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635224c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd31a9c98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.073865:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933298048
00000100:00100000:3.0:1789431556.073880:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933298048
00000100:00100000:3.0:1789431556.073950:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12280
00000100:00100000:3.0:1789431556.073960:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0776d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+272:14617:x1876351933298048:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431556.074921:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0776d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+273:14617:x1876351933298048:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 954us (3387us total) trans 4295120659 rc 0/0
00000100:00100000:3.0:1789431556.074934:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12280
00010000:00010000:3.0:1789431556.098810:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63520ea0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1009c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c74f2 expref: 272 pid: 12775 timeout: 3114 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.098903:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894190720:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431556.098935:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63522521 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1009c:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.158227:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.168990:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.182112:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.183561:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933299968
00000100:00100000:3.0:1789431556.183570:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933299968
00000100:00100000:3.0:1789431556.183611:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12283
00000100:00100000:3.0:1789431556.183622:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+277:14617:x1876351933299968:12345-192.168.203.4@tcp:37:dbench.0
00000001:00080000:3.0:1789431556.205972:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969964 is committed
00000001:00080000:3.0:1789431556.205991:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969956 is committed
00000001:00080000:3.0:1789431556.206006:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969965 is committed
00010000:00010000:3.0:1789431556.227627:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb6352260f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.227638:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb6352260f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.227644:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb6352260f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.227650:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf18a56200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.227654:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb6352260f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.227662:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb6352260f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.227673:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xbf2dd773 (ffff90cf04a08f00)
00010000:00010000:3.0:1789431556.227676:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.227680:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb6352260f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.227685:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb6352260f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.231632:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.231745:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.246263:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933301632
00000100:00100000:3.0:1789431556.246278:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933301632
00000100:00100000:3.0:1789431556.246362:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12284
00000100:00100000:3.0:1789431556.246375:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+277:14617:x1876351933301632:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431556.246867:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+278:14617:x1876351933301632:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 493us (779us total) trans 4295120665 rc 0/0
00000100:00100000:3.0:1789431556.246877:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12284
00000100:00100000:3.0:1789431556.256011:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933302144
00000100:00100000:3.0:1789431556.256031:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933302144
00000100:00100000:3.0:1789431556.256166:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295369
00000100:00100000:3.0:1789431556.256178:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+279:14617:x1876351933302144:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431556.256252:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431556.256287:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb63522616 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c31 expref: 279 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.256312:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a5f:0x0].0x0 (ffff90cf04a08a00)
00010000:00010000:3.0:1789431556.256327:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431556.256353:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63522632 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.256371:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63522632 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.256382:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63522632 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.256399:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63522639 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0xbf2dd773 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.256406:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63522639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.256413:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63522639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.256559:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63522640 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.256569:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63522640 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.256576:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63522640 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431556.257298:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1183, 64 off83968
00010000:00010000:3.0:1789431556.257376:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63522647 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a5f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257387:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63522647 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257397:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63522647 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257405:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63522647 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257412:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63522647 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257418:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63522647 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257447:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431556.257472:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63522640 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257478:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63522640 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257484:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63522640 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257490:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f76400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.257495:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63522640 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257504:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63522640 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257514:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a5f:0x0].0x0 (ffff90ce2e707100)
00010000:00010000:3.0:1789431556.257517:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431556.257522:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63522640 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257528:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63522640 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257549:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63522632 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257556:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63522632 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257562:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63522632 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257567:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e74a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.257570:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63522632 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257576:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63522632 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257584:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431556.257586:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.257589:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63522632 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.257598:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63522632 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431556.257609:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006e3caab4 reply state 000000008c878bc4 transno 4295120667 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63522639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.257618:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431556.257732:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+280:14617:x1876351933302144:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1551us (4448us total) trans 4295120667 rc 0/0
00000100:00100000:3.0:1789431556.257742:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295369
00000100:00100000:3.0:1789431556.264387:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933302272
00000100:00100000:3.0:1789431556.264402:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933302272
00000100:00100000:3.0:1789431556.264473:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933302528
00000100:00100000:3.0:1789431556.264476:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933302528
00000100:00100000:3.0:1789431556.264514:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295370
00000100:00100000:3.0:1789431556.264529:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+280:14617:x1876351933302272:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431556.264569:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431556.264601:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352264e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7c46 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264692:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee400/0xd8e438fb63522655 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264710:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee400/0xd8e438fb63522655 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264725:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee400/0xd8e438fb63522655 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264749:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb6352265c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x11164342 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264757:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb6352265c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264763:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb6352265c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264851:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee400/0xd8e438fb63522655 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264860:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee400/0xd8e438fb63522655 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264867:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee400/0xd8e438fb63522655 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264874:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b9ee400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.264879:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee400/0xd8e438fb63522655 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264887:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee400/0xd8e438fb63522655 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264902:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431556.264905:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.264911:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee400/0xd8e438fb63522655 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264917:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee400/0xd8e438fb63522655 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264936:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb6352265c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264943:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb6352265c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264954:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb6352265c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264960:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b9ee600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.264962:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb6352265c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264968:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb6352265c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264975:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x11164342 (ffff90ce0f6c6e00)
00010000:00010000:3.0:1789431556.264977:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.264980:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb6352265c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.264985:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb6352265c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.265024:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352264e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c46 expref: 281 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.265035:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431556.265037:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.265041:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352264e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c46 expref: 281 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.265088:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37f77a00, rc 0)
00000100:00100000:3.0:1789431556.265158:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+280:14617:x1876351933302272:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 635us (876us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431556.265166:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295370
00010000:00010000:3.0:1789431556.269470:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431556.269486:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522678 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.269499:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431556.269504:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522678 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.269514:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522678 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.269535:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a5e:0x0].0x0 (ffff90cf3afe7400)
00010000:00010000:3.0:1789431556.269538:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431556.269544:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522678 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.269550:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522678 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.269573:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431556.269575:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431556.269577:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431556.272547:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933302656
00000100:00100000:3.0:1789431556.272565:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933302656
00000100:00100000:3.0:1789431556.272653:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295372
00000100:00100000:3.0:1789431556.272667:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+280:14617:x1876351933302656:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431556.272695:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431556.272724:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef200/0xd8e438fb6352267f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7c4d expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.272826:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef400/0xd8e438fb63522686 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.272845:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef400/0xd8e438fb63522686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.272859:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef400/0xd8e438fb63522686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431556.272906:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:3.0:1789431556.272910:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431556.272933:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef400/0xd8e438fb63522686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.272963:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef200/0xd8e438fb6352267f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c4d expref: 282 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.272984:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef400/0xd8e438fb63522686 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c4d expref: 281 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.273005:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431556.273009:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431556.273013:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b9ef400, rc 0)
00000100:00100000:3.0:1789431556.273682:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+281:14617:x1876351933302656:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1012us (3123us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431556.273692:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295372
00010000:00010000:3.0:1789431556.276951:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352266a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.276969:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352266a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.276979:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352266a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.276985:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.276990:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352266a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.277318:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352266a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.277337:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x3857f8dc (ffff90cf3afe7a00)
00010000:00010000:3.0:1789431556.277339:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.277345:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352266a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10098:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.277352:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352266a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10098:0x0].0x3857f8dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.283762:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933303040
00000100:00100000:3.0:1789431556.283792:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933303040
00000100:00100000:3.0:1789431556.284033:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12286
00000100:00100000:3.0:1789431556.284084:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+281:14617:x1876351933303040:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431556.292633:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.299424:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.304808:0:6794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1a569880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6794:1876351894191232:0@lo:5:osp-pre-0-0.0
00000100:00100000:3.0:1789431556.304891:0:6794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431556.304932:0:6794:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf22743840 going to sleep for 11 seconds
00000100:00100000:3.0:1789431556.305689:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00080000:3.0:1789431556.307745:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1789431556.314121:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.324643:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.324700:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.330566:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933304576
00000100:00100000:3.0:1789431556.330579:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933304576
00000100:00100000:3.0:1789431556.330650:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295378
00000100:00100000:3.0:1789431556.330664:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14616:x1876351933304576:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431556.330697:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431556.330726:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef200/0xd8e438fb63522712 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100ed:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7c7e expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.330877:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb63522719 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.330895:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63520bd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100ef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c740b expref: 283 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.330907:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb63522719 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x100ef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.330950:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63520bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c740b expref: 283 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.330972:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63520bd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c740b expref: 283 pid: 12181 timeout: 3114 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.330989:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894191360:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431556.331096:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3a8159c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431556.332394:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.336734:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894191360:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431556.336975:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb63522719 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.344041:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.344253:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431556.346002:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb63522719 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ef:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.346012:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb63522719 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ef:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431556.346034:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100ef:0x0]: returning size 327680
00010000:00010000:3.0:1789431556.346211:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef200/0xd8e438fb63522712 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100ed:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c7e expref: 287 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.346244:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb63522719 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ef:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c7e expref: 286 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.346256:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ef:0x0].0x0 (ffff90ce2e707900)
00010000:00010000:3.0:1789431556.346260:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431556.346263:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b9ee600, rc 0)
00000100:00100000:3.0:1789431556.351302:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+286:14616:x1876351933304576:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 20615us (20785us total) trans 4295120673 rc 0/0
00000100:00100000:3.0:1789431556.351319:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295378
00000100:00100000:3.0:1789431556.370221:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce279f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894191488:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431556.370269:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56c00/0xd8e438fb6352274a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100ef:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.381560:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56c00/0xd8e438fb6352274a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.381587:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56c00/0xd8e438fb6352274a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.382108:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.395442:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.413421:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.413474:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.418170:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.425155:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431556.425962:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb6352279e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.425978:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb6352279e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.425987:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb6352279e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.425999:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.426005:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb6352279e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.426014:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb6352279e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.426035:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x603ebcfa (ffff90cf08772400)
00010000:00010000:3.0:1789431556.426039:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.426044:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb6352279e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.429242:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb6352279e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.434938:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933307008
00000100:00100000:3.0:1789431556.434956:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933307008
00000100:00100000:3.0:1789431556.441136:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933307264
00000100:00100000:3.0:1789431556.441150:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933307264
00000100:00100000:3.0:1789431556.441235:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295386
00000100:00100000:3.0:1789431556.441246:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+288:14616:x1876351933307264:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431556.441279:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431556.441435:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef200/0xd8e438fb635227cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7cb6 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.441567:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee400/0xd8e438fb635227d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.441585:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635227ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100f1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ca8 expref: 289 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.441605:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee400/0xd8e438fb635227d6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100f1:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.441652:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635227ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100f1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ca8 expref: 289 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.441668:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635227ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100f1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ca8 expref: 289 pid: 12181 timeout: 3114 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.441684:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894191872:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431556.441955:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3a8159c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431556.450502:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.450557:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.450599:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933307648
00000100:00100000:3.0:1789431556.450609:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933307648
00000100:00100000:3.0:1789431556.450675:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295387
00000100:00100000:3.0:1789431556.450686:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+290:14617:x1876351933307648:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431556.450764:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431556.450811:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635227a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ca1 expref: 290 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.450830:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a61:0x0].0x0 (ffff90cf08772800)
00010000:00010000:3.0:1789431556.450846:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431556.450875:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635227dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.450896:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635227dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.450906:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635227dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.450921:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef400/0xd8e438fb635227e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x603ebcfa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.450928:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef400/0xd8e438fb635227e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.450933:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef400/0xd8e438fb635227e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451045:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635227eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451073:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635227eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451080:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635227eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431556.451628:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1184, 64 off84032
00000004:00080000:3.0:1789431556.451638:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3014482588420ns, next at 3015482585564ns, rc = 0
00010000:00010000:3.0:1789431556.451705:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb635227f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451716:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb635227f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451728:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb635227f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451735:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb635227f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451742:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb635227f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451749:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb635227f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451787:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431556.451813:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635227eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a61:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451819:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635227eb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a61:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451825:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635227eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a61:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451832:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce27814e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.451838:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635227eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a61:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451846:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635227eb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a61:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451856:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a61:0x0].0x0 (ffff90ce0f6c6f00)
00010000:00010000:3.0:1789431556.451859:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431556.451863:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635227eb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a61:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451868:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635227eb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a61:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451887:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635227dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451966:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635227dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451972:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635227dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451979:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b9ee600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.451982:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635227dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451989:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635227dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.451998:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431556.452001:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.452005:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635227dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.452012:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635227dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431556.452027:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f03cc97c reply state 000000004443f204 transno 4295120677 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef400/0xd8e438fb635227e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.452041:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431556.452166:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+291:14617:x1876351933307648:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1477us (1603us total) trans 4295120677 rc 0/0
00000100:00100000:3.0:1789431556.452174:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295387
00000100:00100000:3.0:1789431556.462333:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.494655:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.502401:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.502631:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.513439:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.516265:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933308928
00000100:00100000:3.0:1789431556.516278:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933308928
00010000:00010000:3.0:1789431556.516339:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63520cb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100f4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7458 expref: 293 pid: 12181 timeout: 3114 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.516392:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16375
00000100:00100000:3.0:1789431556.516403:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf087a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+293:2347:x1876351933308928:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431556.516422:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431556.516430:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63520cb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7458 expref: 293 pid: 12181 timeout: 3114 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.516446:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63520cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7458 expref: 293 pid: 12181 timeout: 3114 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.516471:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63520cb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7458 expref: 293 pid: 12181 timeout: 3114 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.516495:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100f4:0x0].0x0 (ffff90ce15f08100)
00010000:00010000:3.0:1789431556.516501:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37475000/0xd8e438fb6352283f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100f4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.516511:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37475000/0xd8e438fb6352283f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100f4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.516518:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37475000/0xd8e438fb6352283f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100f4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.516547:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431556.516620:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf087a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+292:2347:x1876351933308928:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 219us (536us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431556.516629:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16375
00000100:00100000:3.0:1789431556.523666:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.536428:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933309312
00000100:00100000:3.0:1789431556.536438:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933309312
00010000:00010000:3.0:1789431556.536475:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37475000/0xd8e438fb6352283f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x100f4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7cd2 expref: 293 pid: 12181 timeout: 3114 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.536513:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16376
00000100:00100000:3.0:1789431556.536521:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf087a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+293:2348:x1876351933309312:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431556.536537:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431556.536546:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37475000/0xd8e438fb6352283f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x100f4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7cd2 expref: 293 pid: 12181 timeout: 3114 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.536560:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37475000/0xd8e438fb6352283f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100f4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7cd2 expref: 293 pid: 12181 timeout: 3114 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.536584:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100f4:0x0].0x0 (ffff90ce15f08100)
00010000:00010000:3.0:1789431556.536590:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37475c00/0xd8e438fb63522877 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100f4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.536601:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37475c00/0xd8e438fb63522877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100f4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.536610:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37475c00/0xd8e438fb63522877 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100f4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.536633:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431556.536668:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf087a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+293:2348:x1876351933309312:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 148us (1776us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431556.536675:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16376
00000100:00100000:3.0:1789431556.544003:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933309568
00000100:00100000:3.0:1789431556.544016:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933309568
00000100:00100000:3.0:1789431556.546450:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12291
00000100:00100000:3.0:1789431556.546481:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+291:14617:x1876351933309568:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431556.546992:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+292:14617:x1876351933309568:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 525us (3135us total) trans 4295120680 rc 0/0
00000100:00100000:3.0:1789431556.547002:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12291
00010000:00010000:3.0:1789431556.563627:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431556.563649:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb6352289a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.563665:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431556.563670:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb6352289a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.563684:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb6352289a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.563708:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a62:0x0].0x0 (ffff90cf04a08700)
00010000:00010000:3.0:1789431556.563711:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431556.563718:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb6352289a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.563724:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb6352289a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.575606:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933310080
00000100:00100000:3.0:1789431556.575620:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933310080
00000100:00100000:3.0:1789431556.575698:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295396
00000100:00100000:3.0:1789431556.575711:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+292:14617:x1876351933310080:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431556.575738:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431556.575766:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb635228b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7cf5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.575874:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612c00/0xd8e438fb635228bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.575894:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612c00/0xd8e438fb635228bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.575910:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612c00/0xd8e438fb635228bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431556.575958:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:3.0:1789431556.575964:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431556.575988:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612c00/0xd8e438fb635228bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.576017:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb635228b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7cf5 expref: 294 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.576036:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612c00/0xd8e438fb635228bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7cf5 expref: 293 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.576045:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431556.576164:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431556.576169:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0e612c00, rc 0)
00000100:00100000:3.0:1789431556.576239:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+293:14617:x1876351933310080:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 531us (723us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431556.576247:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295396
00000100:00100000:3.0:1789431556.594706:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894192384
00000100:00100000:3.0:1789431556.594721:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894192384
00000100:00100000:3.0:1789431556.594864:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303
00000100:00100000:3.0:1789431556.594875:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2adb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:366be534-ad36-4915-90c5-622719f64be8+19:3312:x1876351894192384:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789431556.596247:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2adb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:366be534-ad36-4915-90c5-622719f64be8+19:3312:x1876351894192384:12345-0@lo:400:kworker.0 Request processed in 1366us (1798us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431556.596261:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303
00000100:00100000:3.0:1789431556.609308:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933310592
00000100:00100000:3.0:1789431556.609323:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933310592
00000100:00100000:3.0:1789431556.609378:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933310720
00000100:00100000:3.0:1789431556.609382:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933310720
00000100:00100000:3.0:1789431556.609423:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295398
00000100:00100000:3.0:1789431556.609498:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+294:14617:x1876351933310592:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431556.609520:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431556.609525:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431556.609555:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612c00/0xd8e438fb635228bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7cf5 expref: 294 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.609576:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431556.609583:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431556.609599:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb635228e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7d03 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.609731:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb635228ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.609788:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb635228ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.609805:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb635228ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.609829:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635228f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x603ebcfa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.609839:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635228f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.609851:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635228f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:3.0:1789431556.610611:0:12181:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4f3:0x0], index 1: 0
00010000:00010000:3.0:1789431556.610788:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635228fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.610800:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635228fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.610809:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635228fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.610844:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb635228ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.610851:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb635228ee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.610856:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb635228ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.610862:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0e613600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.610867:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb635228ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.610875:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb635228ee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.610884:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431556.610887:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.610892:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb635228ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.610897:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb635228ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431556.610909:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003282254d reply state 00000000bc628e14 transno 4295120682 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635228f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.610918:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431556.611313:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb635228e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d03 expref: 296 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.611331:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635228fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d03 expref: 295 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.611338:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a63:0x0].0x0 (ffff90ce0f6c6200)
00010000:00010000:3.0:1789431556.611340:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431556.611343:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf18a56200, rc 0)
00000100:00100000:3.0:1789431556.631382:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.643525:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.643567:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933311616
00000100:00100000:3.0:1789431556.643581:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933311616
00000100:00100000:3.0:1789431556.643658:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8133
00000100:00100000:3.0:1789431556.643672:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+108:2348:x1876351933311616:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431556.643698:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431556.643729:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2c7be19/0xd8e438fb63522934 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7d1f expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431556.643770:0:14468:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431556.643809:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f4:0x0].0x0 since=3014s v=(0 0)
00010000:00010000:3.0:1789431556.643815:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f4:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431556.643828:0:14468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2c7be19/0xd8e438fb63522934 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d1f expref: 109 pid: 14468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.643856:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2c7be19/0xd8e438fb63522934 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d1f expref: 109 pid: 14468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.643871:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf18a56e00, rc 0)
00000100:00100000:3.0:1789431556.643946:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+109:2348:x1876351933311616:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 277us (438us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431556.643953:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8133
00000100:00100000:3.0:1789431556.648476:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.665291:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933312128
00000100:00100000:3.0:1789431556.665380:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933312128
00000100:00100000:3.0:1789431556.675750:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933312384
00000100:00100000:3.0:1789431556.675768:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933312384
00000100:00100000:3.0:1789431556.675851:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295403
00000100:00100000:3.0:1789431556.675864:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+298:14617:x1876351933312384:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431556.675896:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431556.675924:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb6352296c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7d2d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.676017:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb63522973 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.676036:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb63522973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.676079:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb63522973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431556.676132:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:3.0:1789431556.676136:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431556.676160:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb63522973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.676191:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb6352296c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d2d expref: 300 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.676210:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb63522973 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d2d expref: 299 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.676218:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431556.676221:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431556.676225:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0e613600, rc 0)
00000100:00100000:3.0:1789431556.676314:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+299:14617:x1876351933312384:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 453us (678us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431556.676321:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295403
00000100:00100000:3.0:1789431556.686683:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933312768
00000100:00100000:3.0:1789431556.686697:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933312768
00000100:00100000:3.0:1789431556.686829:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12297
00000100:00100000:3.0:1789431556.686842:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+300:14617:x1876351933312768:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431556.696218:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.709006:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933313792
00000100:00100000:3.0:1789431556.709021:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933313792
00000100:00100000:3.0:1789431556.709112:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12300
00000100:00100000:3.0:1789431556.709125:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+302:14616:x1876351933313792:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431556.709541:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+303:14616:x1876351933313792:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 417us (618us total) trans 4295120690 rc 0/0
00000100:00100000:3.0:1789431556.709549:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12300
00000100:00100000:3.0:1789431556.714863:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933314048
00000100:00100000:3.0:1789431556.714886:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933314048
00000100:00100000:3.0:1789431556.714951:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295405
00000100:00100000:3.0:1789431556.714963:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+303:14616:x1876351933314048:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431556.715037:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431556.715115:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63522926 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a64:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d18 expref: 303 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.715141:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a64:0x0].0x0 (ffff90cf04a08a00)
00010000:00010000:3.0:1789431556.715155:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431556.715182:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb6352298f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.715200:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb6352298f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.715211:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb6352298f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.715228:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612c00/0xd8e438fb63522996 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd1e76203 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.715235:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612c00/0xd8e438fb63522996 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.715242:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612c00/0xd8e438fb63522996 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.715398:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb6352299d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a64:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.715408:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb6352299d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a64:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.715415:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb6352299d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a64:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431556.716081:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1184, 64 off83968
00010000:00010000:3.0:1789431556.716157:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb635229a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a64:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716170:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb635229a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716179:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb635229a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716187:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb635229a4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716193:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb635229a4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716199:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb635229a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716223:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431556.716248:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb6352299d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716258:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb6352299d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716264:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb6352299d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716271:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf18a56200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.716277:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb6352299d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716285:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb6352299d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716296:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a64:0x0].0x0 (ffff90ce0f6c6600)
00010000:00010000:3.0:1789431556.716299:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431556.716305:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb6352299d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716312:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb6352299d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716331:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb6352298f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716338:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb6352298f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716345:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb6352298f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716351:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0e612000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.716355:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb6352298f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716361:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb6352298f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716369:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431556.716371:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.716374:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb6352298f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.716380:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb6352298f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431556.716388:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000067bf8323 reply state 00000000505b92a2 transno 4295120691 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612c00/0xd8e438fb63522996 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.716397:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431556.716496:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+304:14616:x1876351933314048:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1532us (1748us total) trans 4295120691 rc 0/0
00000100:00100000:3.0:1789431556.716505:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295405
00000100:00100000:3.0:1789431556.721099:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933314176
00000100:00100000:3.0:1789431556.721112:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933314176
00000100:00100000:3.0:1789431556.721184:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295406
00000100:00100000:3.0:1789431556.721196:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+304:14617:x1876351933314176:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431556.721224:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431556.721256:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef400/0xd8e438fb635229ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7d3b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721356:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef200/0xd8e438fb635229b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721375:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef200/0xd8e438fb635229b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721389:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef200/0xd8e438fb635229b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721407:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635229b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721414:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635229b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721422:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635229b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721499:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef200/0xd8e438fb635229b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721507:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef200/0xd8e438fb635229b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721514:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef200/0xd8e438fb635229b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721521:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b9ef200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.721526:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef200/0xd8e438fb635229b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721535:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef200/0xd8e438fb635229b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721554:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431556.721557:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.721564:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef200/0xd8e438fb635229b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721571:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef200/0xd8e438fb635229b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721586:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635229b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721593:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635229b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721599:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635229b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721603:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b9ee600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.721606:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635229b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721612:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635229b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721619:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x4bac77d5 (ffff90ce0f6c6e00)
00010000:00010000:3.0:1789431556.721622:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.721625:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635229b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721631:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ee600/0xd8e438fb635229b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721685:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef400/0xd8e438fb635229ab lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d3b expref: 305 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721697:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431556.721700:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.721703:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b9ef400/0xd8e438fb635229ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d3b expref: 305 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.721713:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b9ef400, rc 0)
00000100:00100000:3.0:1789431556.721796:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+304:14617:x1876351933314176:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 602us (885us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431556.721804:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295406
00000100:00100000:3.0:1789431556.730168:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933314560
00000100:00100000:3.0:1789431556.730181:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933314560
00000100:00100000:3.0:1789431556.730243:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295408
00000100:00100000:3.0:1789431556.730256:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+305:14617:x1876351933314560:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431556.730291:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431556.730295:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431556.730331:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613600/0xd8e438fb63522973 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d2d expref: 305 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.730351:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431556.730356:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431556.730372:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb635229d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7d49 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.730517:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635229dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.730533:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635229dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.730544:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635229dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.730562:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635229e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.730569:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635229e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.730576:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635229e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:3.0:1789431556.731729:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4f4:0x0], index 1: 0
00010000:00010000:3.0:1789431556.732574:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635229ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.732596:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635229ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.732609:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635229ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.732654:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635229dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.733209:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635229dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.733224:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635229dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.733231:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf18a56200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.733237:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635229dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.733246:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635229dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.733267:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431556.733271:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.733277:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635229dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.733283:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635229dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431556.733378:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008a91484b reply state 00000000d7198301 transno 4295120692 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635229e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.733388:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431556.733449:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb635229d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d49 expref: 307 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.733469:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635229ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d49 expref: 306 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.733482:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a65:0x0].0x0 (ffff90ce2154d900)
00010000:00010000:3.0:1789431556.733484:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431556.733487:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cba00, rc 0)
00000100:00100000:3.0:1789431556.733696:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933314560:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3442us (3803us total) trans 4295120692 rc 0/0
00000100:00100000:3.0:1789431556.733706:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295408
00000100:00100000:3.0:1789431556.744152:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933314688
00000100:00100000:3.0:1789431556.744166:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933314688
00000100:00100000:3.0:1789431556.744247:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295409
00000100:00100000:3.0:1789431556.744259:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+305:14616:x1876351933314688:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431556.744292:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431556.744332:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635229f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7d50 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.744419:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb635229ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.744438:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb635229ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.744452:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb635229ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431556.744498:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:3.0:1789431556.744502:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431556.744524:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb635229ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.744558:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635229f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d50 expref: 307 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.744581:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb635229ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d50 expref: 306 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.744590:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431556.744594:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431556.744598:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cae00, rc 0)
00000100:00100000:3.0:1789431556.744666:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14616:x1876351933314688:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 409us (995us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431556.744687:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295409
00000100:00100000:3.0:1789431556.758476:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431556.766407:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933315584
00000100:00100000:3.0:1789431556.766413:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933315584
00000100:00100000:3.0:1789431556.766524:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295411
00000100:00100000:3.0:1789431556.766532:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933315584:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431556.766586:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431556.766599:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635229ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a65:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d49 expref: 307 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.766609:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a65:0x0].0x0 (ffff90ce2154d900)
00010000:00010000:3.0:1789431556.766619:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431556.766635:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522a14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.766669:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522a14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.766681:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522a14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.766698:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63522a1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.766704:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63522a1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.766711:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63522a1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.766841:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63522a22 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.766850:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63522a22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a65:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.766857:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63522a22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a65:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431556.769992:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1186, 64 off84160
00000100:00100000:3.0:1789431556.776020:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933315968
00000100:00100000:3.0:1789431556.776032:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933315968
00000100:00100000:3.0:1789431556.776297:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295412
00000100:00100000:3.0:1789431556.776310:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933315968:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431556.776346:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431556.776376:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522a53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7d6c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776467:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522a5a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776486:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522a5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776499:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522a5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776516:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522a61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776523:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776530:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776604:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522a5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776612:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522a5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776620:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522a5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776627:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.776632:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522a5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776642:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522a5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776655:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431556.776658:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.776664:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522a5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776682:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522a5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776695:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776701:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522a61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776707:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522a61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776712:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.776715:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522a61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776722:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522a61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776729:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x8f93a2f9 (ffff90ce2154d900)
00010000:00010000:3.0:1789431556.776732:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.776735:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522a61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776742:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522a61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776786:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522a53 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d6c expref: 308 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776797:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431556.776799:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.776803:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522a53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d6c expref: 308 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.776813:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cba00, rc 0)
00000100:00100000:3.0:1789431556.776897:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933315968:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 590us (1047us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431556.776905:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295412
00000100:00100000:3.0:1789431556.796938:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933316736
00000100:00100000:3.0:1789431556.796953:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933316736
00000100:00100000:3.0:1789431556.797029:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295414
00000100:00100000:3.0:1789431556.797042:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933316736:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431556.797160:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431556.797196:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63522a37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a66:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d5e expref: 311 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.797221:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a66:0x0].0x0 (ffff90cf04a08a00)
00010000:00010000:3.0:1789431556.797234:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431556.797262:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522a76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.797281:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522a76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.797294:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522a76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.797528:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522a7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd1e76203 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.797538:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522a7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.797546:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522a7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd1e76203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.801094:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431556.801102:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63522a8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.801110:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae2600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431556.801114:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63522a8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.801121:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63522a8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.801132:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a66:0x0].0x0 (ffff90cf04a08f00)
00010000:00010000:3.0:1789431556.801135:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431556.801138:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63522a8b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.801149:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63522a8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.801168:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431556.801170:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431556.801172:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431556.818092:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295416
00000100:00100000:3.0:1789431556.818110:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933317120:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431556.818139:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431556.818166:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522aae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7d81 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818240:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522abc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818260:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522abc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818274:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522abc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818292:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522ac3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818299:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818306:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818449:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522abc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818457:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522abc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818465:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522abc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818471:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.818477:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522abc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818485:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522abc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818495:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431556.818497:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.818502:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522abc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818507:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522abc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818515:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818520:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522ac3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818525:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818531:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431556.818533:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818539:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522ac3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818545:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x8f93a2f9 (ffff90ce2154d500)
00010000:00010000:3.0:1789431556.818548:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431556.818551:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522ac3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818557:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522ac3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818584:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522aae lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d81 expref: 312 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818594:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431556.818596:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:3.0:1789431556.818600:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522aae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d81 expref: 312 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.818608:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cac00, rc 0)
00000100:00100000:3.0:1789431556.818629:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933317120:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 528us (1120us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431556.818634:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295416
00000100:00100000:3.0:1789431556.825686:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933317376
00000100:00100000:3.0:1789431556.825701:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933317376
00000100:00100000:3.0:1789431556.825788:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295418
00000100:00100000:3.0:1789431556.825804:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933317376:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431556.825832:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431556.825863:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63522aca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7d8f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.881136:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933319296
00000100:00100000:3.0:1789431556.881142:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933319296
00000100:00100000:3.0:1789431556.881237:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12307
00000100:00100000:3.0:1789431556.881245:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+314:14616:x1876351933319296:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431556.884897:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+315:14616:x1876351933319296:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 3641us (4045us total) trans 4295120701 rc 0/0
00000100:00100000:3.0:1789431556.884970:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12307
00000100:00100000:3.0:1789431556.904492:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933320192
00000100:00100000:3.0:1789431556.904504:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933320192
00000100:00100000:3.0:1789431556.904578:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295428
00000100:00100000:3.0:1789431556.904916:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+316:14616:x1876351933320192:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431556.904947:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431556.904975:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522bcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7dd5 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.905079:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522bd4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.905094:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.905111:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.913996:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933320320
00000100:00100000:3.0:1789431556.914011:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933320320
00000100:00100000:3.0:1789431556.914094:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12308
00000100:00100000:3.0:1789431556.914105:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+315:14617:x1876351933320320:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431556.942809:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431556.957883:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431556.957918:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2a00/0xd8e438fb63522be9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ddc expref: 318 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.958024:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431556.958032:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431556.958095:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb63522c7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7e0d expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.958251:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522c83 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.958269:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522c83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.958281:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522c83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.958297:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522c8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xbf2dd773 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.958304:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522c8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.958521:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522c8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431556.959964:0:12775:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4f7:0x0], index 0: 0
00010000:00010000:0.0:1789431556.960241:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63522c91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a6a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.960258:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63522c91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a6a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.960271:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63522c91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a6a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.960871:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522c83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.960884:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522c83 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.960892:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522c83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.960899:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431556.960905:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522c83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.960915:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522c83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.960930:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431556.960933:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431556.960940:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522c83 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.961008:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522c83 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431556.961030:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002929dd88 reply state 0000000049927f21 transno 4295120705 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522c8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431556.961040:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431556.961145:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb63522c7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e0d expref: 320 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.961164:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63522c91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a6a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e0d expref: 319 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.961172:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a6a:0x0].0x0 (ffff90cf3afe7d00)
00010000:00010000:0.0:1789431556.961174:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431556.961177:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4800, rc 0)
00000100:00100000:0.0:1789431556.961276:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+320:14616:x1876351933321984:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3510us (3767us total) trans 4295120705 rc 0/0
00000100:00100000:0.0:1789431556.961286:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295436
00010000:00010000:0.0:1789431556.963396:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63522c67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.963420:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63522c67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.963429:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63522c67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.963437:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431556.963443:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63522c67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.963455:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63522c67 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.963476:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x4bac77d5 (ffff90cf04d11e00)
00010000:00010000:0.0:1789431556.963480:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431556.963488:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63522c67 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.963495:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63522c67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431556.967459:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933322112
00000100:00100000:3.0:1789431556.967473:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933322112
00000100:00100000:3.0:1789431556.967584:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933322240
00000100:00100000:3.0:1789431556.967588:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933322240
00000100:00100000:3.0:1789431556.983578:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933322752
00000100:00100000:3.0:1789431556.983594:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933322752
00000100:00100000:3.0:1789431556.983678:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12311
00000100:00100000:3.0:1789431556.983691:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07768c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+319:14617:x1876351933322752:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431556.984214:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07768c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+320:14617:x1876351933322752:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 525us (1297us total) trans 4295120707 rc 0/0
00000100:00100000:3.0:1789431556.984223:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12311
00010000:00010000:3.0:1789431556.989409:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431556.989420:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb63522cc2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.989429:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ac00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431556.989432:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb63522cc2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.989441:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb63522cc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.989455:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a6a:0x0].0x0 (ffff90cf062f5200)
00010000:00010000:3.0:1789431556.989458:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431556.989461:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb63522cc2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.989468:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb63522cc2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431556.989488:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431556.989490:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431556.989492:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431556.991374:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63522cb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.991397:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63522cb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.991406:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63522cb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.991413:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431556.991419:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63522cb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.991426:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63522cb4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.991444:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xbf2dd773 (ffff90cf062f5700)
00010000:00010000:0.0:1789431556.991447:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431556.991453:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63522cb4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.991459:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63522cb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xbf2dd773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431556.996022:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933323264
00000100:00100000:0.0:1789431556.996042:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933323264
00000100:00100000:0.0:1789431556.996146:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933323392
00000100:00100000:0.0:1789431556.996150:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933323392
00000100:00100000:0.0:1789431556.996185:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295438
00000100:00100000:0.0:1789431556.996197:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+321:14617:x1876351933323264:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431556.998868:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431556.998915:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63522c6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a69:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e06 expref: 320 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.998941:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a69:0x0].0x0 (ffff90cf04d11900)
00010000:00010000:0.0:1789431556.998955:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431556.998987:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb63522cde lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.999006:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb63522cde lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.999017:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb63522cde lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.999035:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522ce5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.999043:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.999065:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.999211:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522cec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a69:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.999224:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522cec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a69:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431556.999231:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522cec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a69:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:0.0:1789431556.999954:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1188, 64 off84288
00010000:00010000:0.0:1789431557.000036:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522cf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a69:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000072:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522cf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000082:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522cf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000092:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522cf3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000099:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522cf3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000106:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522cf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000129:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431557.000156:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522cec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000163:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522cec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000176:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522cec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000182:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.000187:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522cec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000197:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522cec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000209:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a69:0x0].0x0 (ffff90cf3afe7b00)
00010000:00010000:0.0:1789431557.000212:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431557.000217:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522cec lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000223:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522cec lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000247:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb63522cde lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000254:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb63522cde lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000259:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb63522cde lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000264:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.000267:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb63522cde lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000277:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb63522cde lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000284:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431557.000287:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.000290:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb63522cde lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.000297:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb63522cde lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431557.000307:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000adb4f717 reply state 0000000000a605f3 transno 4295120709 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431557.000322:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431557.000478:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+321:14617:x1876351933323264:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 4275us (5808us total) trans 4295120709 rc 0/0
00000100:00100000:0.0:1789431557.000490:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295438
00010000:00010000:3.0:1789431557.000540:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431557.000551:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522cf3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.000559:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4e00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431557.000562:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522cf3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.000571:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522cf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.000583:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a69:0x0].0x0 (ffff90cf3afe7b00)
00010000:00010000:3.0:1789431557.000586:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431557.001997:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522cf3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.002022:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522cf3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.002079:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431557.002083:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431557.002086:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431557.004567:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933323520
00000100:00100000:3.0:1789431557.004584:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933323520
00000100:00100000:3.0:1789431557.004661:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295440
00000100:00100000:3.0:1789431557.004673:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+321:14616:x1876351933323520:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.004700:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.004727:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522cfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7e29 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.004746:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.004759:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522ce5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.004767:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522ce5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.004783:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.004789:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522ce5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.004802:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522ce5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.004822:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x4bac77d5 (ffff90cf3afe7600)
00010000:00010000:0.0:1789431557.004826:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.004833:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522ce5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.004841:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522ce5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.004843:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522d01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.004860:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.004942:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431557.004989:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:3.0:1789431557.004994:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431557.005018:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.005077:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522cfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e29 expref: 322 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.005096:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522d01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e29 expref: 321 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.005109:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431557.005112:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431557.005115:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb800, rc 0)
00000100:00100000:3.0:1789431557.005193:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+321:14616:x1876351933323520:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 523us (780us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431557.005200:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295440
00000100:00100000:3.0:1789431557.009573:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.019845:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+321:14616:x1876351933323776:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 6281us (6497us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431557.019862:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12312
00000100:00100000:3.0:1789431557.021756:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.021919:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933323904
00000100:00100000:0.0:1789431557.021933:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933323904
00000100:00100000:0.0:1789431557.022110:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295442
00000100:00100000:0.0:1789431557.022122:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+321:14617:x1876351933323904:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431557.022150:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431557.022178:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522d1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7e37 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.022265:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb63522d24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.022286:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb63522d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.022323:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb63522d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431557.022381:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:0.0:1789431557.022387:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431557.022416:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb63522d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.022453:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63522d1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e37 expref: 323 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.022480:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb63522d24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e37 expref: 322 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.022492:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431557.022496:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431557.022501:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4a00, rc 0)
00000100:00100000:0.0:1789431557.022592:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+322:14617:x1876351933323904:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 472us (985us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431557.022602:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295442
00000100:00100000:3.0:1789431557.025228:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.031801:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933324288
00000100:00100000:3.0:1789431557.031817:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933324288
00000100:00100000:3.0:1789431557.031884:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12313
00000100:00100000:3.0:1789431557.031897:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+324:14617:x1876351933324288:12345-192.168.203.4@tcp:37:dbench.0
00010000:00010000:0.0:1789431557.031898:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63522d39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.031915:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63522d39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.031924:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63522d39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.031931:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.031937:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63522d39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.031946:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63522d39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.031966:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x11164342 (ffff90cf062f5e00)
00010000:00010000:0.0:1789431557.031969:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.031974:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63522d39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.031981:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63522d39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431557.037448:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+323:14617:x1876351933324288:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 5537us (6236us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431557.037463:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12313
00000100:00100000:3.0:1789431557.038809:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.038902:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933324672
00000100:00100000:0.0:1789431557.038915:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933324672
00000100:00100000:0.0:1789431557.038994:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12314
00000100:00100000:0.0:1789431557.039007:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+323:14616:x1876351933324672:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431557.039632:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+324:14616:x1876351933324672:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 624us (831us total) trans 4295120711 rc 0/0
00000100:00100000:0.0:1789431557.039642:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12314
00000100:00100000:3.0:1789431557.049428:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933324928
00000100:00100000:3.0:1789431557.049442:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933324928
00000100:00100000:3.0:1789431557.049519:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295444
00000100:00100000:3.0:1789431557.049532:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+324:14616:x1876351933324928:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431557.049612:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431557.049650:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63522d40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a6b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e3e expref: 324 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.049680:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a6b:0x0].0x0 (ffff90cf062f5c00)
00010000:00010000:3.0:1789431557.049696:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431557.049725:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63522d55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.049745:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63522d55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.049758:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63522d55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.049789:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522d5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x11164342 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.049797:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522d5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.049804:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522d5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.049967:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63522d63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a6b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.049977:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63522d63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a6b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.049985:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63522d63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a6b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.054143:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431557.054154:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63522d6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.054164:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431557.054168:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63522d6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.054178:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63522d6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.054199:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a6b:0x0].0x0 (ffff90ce2154d400)
00010000:00010000:0.0:1789431557.054203:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431557.054209:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63522d6a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.054216:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63522d6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.054247:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.054250:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.054252:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431557.055569:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431557.059343:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522d5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.059365:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522d5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.059375:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522d5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.059578:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.059583:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522d5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.059593:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522d5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.059621:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x11164342 (ffff90ce2154da00)
00010000:00010000:0.0:1789431557.059624:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.059630:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522d5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.059638:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63522d5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x11164342 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431557.065466:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933325312
00000100:00100000:3.0:1789431557.065483:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933325312
00000100:00100000:3.0:1789431557.065563:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295446
00000100:00100000:3.0:1789431557.065575:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+324:14617:x1876351933325312:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.065625:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.065656:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522d86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7e53 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.065765:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522d8d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.065795:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522d8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.065808:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522d8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.065827:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522d94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.065834:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.065841:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.065912:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522d8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.065920:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522d8d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.065934:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522d8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.065941:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.065946:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522d8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.065955:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522d8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.065970:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431557.065973:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.065979:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522d8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.065985:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522d8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.066002:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.066008:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522d94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.066015:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.066020:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.066022:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.066033:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522d94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.066041:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xcc55ce19 (ffff90ce2154d600)
00010000:00010000:3.0:1789431557.066043:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.066099:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522d94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.066108:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522d94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.066150:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522d86 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e53 expref: 325 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.066161:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431557.066163:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.066167:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522d86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e53 expref: 325 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.066178:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb800, rc 0)
00000100:00100000:3.0:1789431557.066371:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+324:14617:x1876351933325312:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 797us (1634us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431557.066380:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295446
00000100:00100000:0.0:1789431557.082410:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.084943:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.089095:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.089180:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+325:14616:x1876351933325824:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 4032us (4242us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431557.089195:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12315
00000004:00080000:0.0:1789431557.091490:0:12181:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4f8:0x0], index 0: 0
00010000:00010000:0.0:1789431557.091872:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522de8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a6c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.091893:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a6c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.091905:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a6c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.091951:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63522dda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.091959:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63522dda lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.091967:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63522dda lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.091973:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.091978:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63522dda lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.091988:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63522dda lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.092002:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431557.092006:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.092012:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63522dda lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.092019:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63522dda lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431557.092035:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002c258e7e reply state 00000000b5547c83 transno 4295120713 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63522de1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431557.092045:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431557.092323:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e200/0xd8e438fb63522dd3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e6f expref: 327 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.092341:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522de8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a6c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e6f expref: 326 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.092350:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a6c:0x0].0x0 (ffff90cf3afe7600)
00010000:00010000:0.0:1789431557.092353:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431557.092355:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd5800, rc 0)
00000100:00100000:0.0:1789431557.092491:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+327:14617:x1876351933326080:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2851us (3446us total) trans 4295120713 rc 0/0
00000100:00100000:0.0:1789431557.092501:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295450
00010000:00010000:0.0:1789431557.097089:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63522de1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.097115:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63522de1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.097124:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63522de1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.097132:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985ea00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.097138:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63522de1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.097146:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63522de1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.097169:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x4bac77d5 (ffff90cf062f5400)
00010000:00010000:0.0:1789431557.097174:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.097181:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63522de1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.097187:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63522de1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431557.098529:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933326208
00000100:00100000:0.0:1789431557.098543:0:14501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933326208
00000100:00100000:0.0:1789431557.098633:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8141
00000100:00100000:0.0:1789431557.098645:0:14501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+112:2350:x1876351933326208:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431557.098669:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431557.098697:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb63522df6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7e76 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789431557.098739:0:14501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431557.098766:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f8:0x0].0x0 since=3015s v=(0 0)
00010000:00010000:0.0:1789431557.098782:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f8:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431557.098801:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb63522df6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e76 expref: 113 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.098824:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb63522df6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e76 expref: 113 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.098840:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4a00, rc 0)
00000100:00100000:0.0:1789431557.098929:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+113:2350:x1876351933326208:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 286us (705us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431557.098937:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8141
00000100:00100000:3.0:1789431557.102378:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.104290:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3babd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894192896:0@lo:13:osp-pre-1-0.0
00000100:00100000:0.0:1789431557.107233:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1789431557.114207:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1789431557.126508:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933326848
00000100:00100000:0.0:1789431557.126521:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933326848
00000100:00100000:0.0:1789431557.126587:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8142
00000100:00100000:0.0:1789431557.126598:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+98:2348:x1876351933326848:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431557.126623:0:14471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431557.126651:0:14471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c365429/0xd8e438fb63522e20 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7e84 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789431557.126694:0:14471:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431557.126720:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f8:0x0].0x0 since=3015s v=(0 0)
00010000:00010000:0.0:1789431557.126726:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f8:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431557.126737:0:14471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c365429/0xd8e438fb63522e20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e84 expref: 99 pid: 14471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.126857:0:14471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005c365429/0xd8e438fb63522e20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e84 expref: 99 pid: 14471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.126875:0:14471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd5400, rc 0)
00000100:00100000:0.0:1789431557.126949:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+99:2348:x1876351933326848:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 352us (538us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431557.126957:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8142
00000100:00100000:3.0:1789431557.128885:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.128929:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933327104
00000100:00100000:3.0:1789431557.128940:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933327104
00000100:00100000:3.0:1789431557.129070:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295452
00000100:00100000:3.0:1789431557.129082:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+328:14617:x1876351933327104:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431557.129156:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431557.129190:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522de8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a6c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e6f expref: 328 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.129211:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a6c:0x0].0x0 (ffff90cf3afe7600)
00010000:00010000:3.0:1789431557.129224:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431557.129253:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522e27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.129271:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522e27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.129283:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522e27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.129299:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522e2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.129307:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522e2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.129314:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522e2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.129449:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522e35 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a6c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.129458:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522e35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.129466:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522e35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431557.129999:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1188, 64 off84224
00010000:00010000:3.0:1789431557.130098:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63522e3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a6c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130110:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63522e3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130119:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63522e3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130127:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63522e3c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130134:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63522e3c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130140:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63522e3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130167:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431557.130191:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522e35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130198:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522e35 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130205:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522e35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130214:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.130219:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522e35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130227:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522e35 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130237:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a6c:0x0].0x0 (ffff90ce2154d600)
00010000:00010000:3.0:1789431557.130240:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431557.130244:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522e35 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130251:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522e35 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130270:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522e27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130275:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522e27 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130281:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522e27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130286:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.130288:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522e27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130294:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522e27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130305:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431557.130307:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.130310:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522e27 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.130316:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522e27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431557.130326:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000ee880e3 reply state 00000000f85716f5 transno 4295120716 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522e2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431557.130352:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431557.130449:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+329:14617:x1876351933327104:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1365us (1573us total) trans 4295120716 rc 0/0
00000100:00100000:3.0:1789431557.130458:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295452
00010000:00010000:0.0:1789431557.132414:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431557.132432:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63522e3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a6c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.132452:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431557.132459:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63522e3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a6c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.132473:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63522e3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a6c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.132497:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a6c:0x0].0x0 (ffff90ce2154d600)
00010000:00010000:0.0:1789431557.132502:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431557.132508:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63522e3c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a6c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.132515:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63522e3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a6c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.132540:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.132547:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.132549:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.133312:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522e2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.133326:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522e2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.133333:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522e2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.133339:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.133344:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522e2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.133351:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522e2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.133363:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x4bac77d5 (ffff90ce2154dc00)
00010000:00010000:0.0:1789431557.133366:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.133369:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522e2e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.133375:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63522e2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431557.137400:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.143992:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431557.146471:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431557.146546:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431557.146556:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63522e6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a6d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.146564:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431557.146569:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63522e6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a6d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.146570:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63522e66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a6d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.146578:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63522e66 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.146584:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63522e66 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.146586:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63522e6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a6d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.146590:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.146594:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63522e66 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.146600:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63522e66 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.146603:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a6d:0x0].0x0 (ffff90cf04d11b00)
00010000:00010000:3.0:1789431557.146607:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431557.146614:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63522e6d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a6d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.146615:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a6d:0x0].0x0 (ffff90cf04d11b00)
00010000:00010000:0.0:1789431557.146617:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431557.146621:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63522e66 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.146622:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63522e6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a6d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.146628:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63522e66 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a6d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.146640:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431557.146642:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431557.146643:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.146652:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63522e58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.146658:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63522e58 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.146670:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63522e58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.146675:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae2600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.146679:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63522e58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.146685:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63522e58 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.146693:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431557.146696:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.146698:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63522e58 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.146703:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63522e58 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431557.146716:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f15f9200 reply state 000000009b8062c5 transno 4295120718 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63522e5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431557.146807:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431557.146943:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b9d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+330:14616:x1876351933327744:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2573us (2957us total) trans 4295120718 rc 0/0
00000100:00100000:0.0:1789431557.146955:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295454
00000100:00100000:3.0:1789431557.149681:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933327872
00000100:00100000:3.0:1789431557.149694:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933327872
00000100:00100000:0.0:1789431557.167045:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.168110:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933328384
00000100:00100000:3.0:1789431557.168127:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933328384
00000100:00100000:3.0:1789431557.168198:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12319
00000100:00100000:3.0:1789431557.168210:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+331:14616:x1876351933328384:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431557.169644:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933328640
00000100:00100000:0.0:1789431557.169655:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933328640
00000100:00100000:0.0:1789431557.169712:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295458
00000100:00100000:0.0:1789431557.169722:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+333:14617:x1876351933328640:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431557.169744:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431557.169780:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63522ea5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7ea7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.169875:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522eac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.169894:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522eac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.169909:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522eac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.169926:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522eb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.169933:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.169939:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.169993:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522eac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.170002:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522eac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.170009:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522eac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.170016:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.170022:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522eac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.170031:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522eac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.170067:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431557.170072:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.170077:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522eac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.170084:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522eac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.170099:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.170105:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522eb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.170112:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.170117:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.170120:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.170126:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522eb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.170132:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xcc55ce19 (ffff90cf3afe7e00)
00010000:00010000:0.0:1789431557.170135:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.170138:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522eb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.170144:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522eb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.170182:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63522ea5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ea7 expref: 334 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.170193:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431557.170196:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:0.0:1789431557.170199:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63522ea5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ea7 expref: 334 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.170208:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4800, rc 0)
00000100:00100000:0.0:1789431557.170276:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+333:14617:x1876351933328640:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 555us (707us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431557.170283:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295458
00000100:00100000:3.0:1789431557.174044:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+331:14616:x1876351933328384:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 5827us (7004us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431557.174192:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12319
00000100:00100000:3.0:1789431557.177430:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933328768
00000100:00100000:3.0:1789431557.177444:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933328768
00000100:00100000:3.0:1789431557.177555:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295459
00000100:00100000:3.0:1789431557.177567:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+331:14617:x1876351933328768:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.177594:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.177622:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522eba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7eae expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177708:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522ec1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177734:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177747:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177764:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63522ec8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xd0af0a21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177788:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63522ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177795:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63522ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177866:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177874:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522ec1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177882:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522ec1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177888:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.177893:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522ec1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177901:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522ec1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177917:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431557.177921:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.177927:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522ec1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177934:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63522ec1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177950:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63522ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177957:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63522ec8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177964:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63522ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177969:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.177972:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63522ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177979:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63522ec8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177986:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xd0af0a21 (ffff90ce2154d200)
00010000:00010000:3.0:1789431557.177989:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.177992:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63522ec8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.177997:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63522ec8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.178036:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522eba lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7eae expref: 332 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.178091:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431557.178094:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.178098:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63522eba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7eae expref: 332 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.178109:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb800, rc 0)
00000100:00100000:3.0:1789431557.178189:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+331:14617:x1876351933328768:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 624us (894us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431557.178197:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295459
00000100:00100000:0.0:1789431557.186296:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933329152
00000100:00100000:0.0:1789431557.186307:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933329152
00000100:00100000:0.0:1789431557.186362:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295461
00000100:00100000:0.0:1789431557.186373:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+334:14617:x1876351933329152:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431557.186392:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431557.186407:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63522ef2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7ebc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186473:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522ef9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186488:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186496:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186509:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186516:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186524:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186575:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186582:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522ef9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186589:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186594:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.186598:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186604:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522ef9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186617:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431557.186619:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.186623:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522ef9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186629:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522ef9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186639:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186645:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186651:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186655:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.186658:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186664:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186671:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xe321e362 (ffff90cf3afe7e00)
00010000:00010000:0.0:1789431557.186673:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.186676:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186682:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186710:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63522ef2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ebc expref: 334 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186721:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431557.186724:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.186728:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63522ef2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ebc expref: 334 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.186737:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4800, rc 0)
00000100:00100000:0.0:1789431557.186763:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+333:14617:x1876351933329152:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 393us (602us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431557.186779:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295461
00010000:00010000:0.0:1789431557.187658:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2000/0xd8e438fb63522edd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.187673:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2000/0xd8e438fb63522edd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.187678:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2000/0xd8e438fb63522edd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.187684:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.187688:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2000/0xd8e438fb63522edd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.187696:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2000/0xd8e438fb63522edd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.187714:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x603ebcfa (ffff90cf04d11f00)
00010000:00010000:0.0:1789431557.187717:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.187721:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2000/0xd8e438fb63522edd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.187727:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2000/0xd8e438fb63522edd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431557.190532:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933329280
00000100:00100000:3.0:1789431557.190546:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933329280
00000100:00100000:3.0:1789431557.190613:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8143
00000100:00100000:3.0:1789431557.190625:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+103:2347:x1876351933329280:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.190649:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.190676:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63522f07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7ec3 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431557.190712:0:14468:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431557.190739:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f9:0x0].0x0 since=3015s v=(0 0)
00010000:00010000:3.0:1789431557.190744:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f9:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431557.190756:0:14468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63522f07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ec3 expref: 104 pid: 14468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.190794:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63522f07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ec3 expref: 104 pid: 14468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.190810:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cac00, rc 0)
00000100:00100000:3.0:1789431557.191375:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+104:2347:x1876351933329280:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 747us (1008us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431557.191386:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8143
00000100:00100000:0.0:1789431557.197996:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933329536
00000100:00100000:0.0:1789431557.198012:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933329536
00000100:00100000:0.0:1789431557.198131:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295462
00000100:00100000:0.0:1789431557.198145:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+332:14617:x1876351933329536:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431557.198184:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431557.198189:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431557.198226:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb63522e7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e92 expref: 332 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.198254:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431557.198262:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431557.198292:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63522f0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7eca expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.198460:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.198479:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.198498:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.198515:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522f1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.198522:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522f1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.198530:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522f1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431557.199236:0:12181:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4f9:0x0], index 1: 0
00010000:00010000:0.0:1789431557.201256:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522f23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a6f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.201356:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a6f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.201372:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a6f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.201443:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.201450:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f15 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.201458:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.201469:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.201474:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.201482:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f15 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.201497:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431557.201501:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.201507:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f15 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.201514:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431557.201532:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007084f55d reply state 00000000759ad6e9 transno 4295120720 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63522f1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431557.201541:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431557.201586:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63522f0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7eca expref: 334 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.201601:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522f23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a6f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7eca expref: 333 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.201608:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a6f:0x0].0x0 (ffff90cf3afe7800)
00010000:00010000:0.0:1789431557.201611:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431557.201613:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd5e00, rc 0)
00000100:00100000:0.0:1789431557.201724:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+334:14617:x1876351933329536:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3580us (3869us total) trans 4295120720 rc 0/0
00000100:00100000:0.0:1789431557.201735:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295462
00000100:00100000:3.0:1789431557.214538:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.219394:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.219456:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.219585:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933330432
00000100:00100000:0.0:1789431557.219599:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933330432
00000100:00100000:0.0:1789431557.219679:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12321
00000100:00100000:0.0:1789431557.219692:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0776b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+334:14617:x1876351933330432:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431557.220222:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0776b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+335:14617:x1876351933330432:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 529us (839us total) trans 4295120722 rc 0/0
00000100:00100000:0.0:1789431557.220231:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12321
00010000:00010000:3.0:1789431557.225906:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431557.225917:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63522f4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.225994:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431557.225998:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63522f4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.226007:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63522f4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.226032:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a6e:0x0].0x0 (ffff90cf04d11600)
00010000:00010000:3.0:1789431557.226035:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431557.226039:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63522f4d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.226045:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63522f4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.226086:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431557.226088:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431557.226090:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.230434:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb63522f3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.230461:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb63522f3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.230471:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb63522f3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.230477:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.230484:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb63522f3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.230493:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb63522f3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.230515:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x603ebcfa (ffff90cf04d11000)
00010000:00010000:0.0:1789431557.230519:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.230526:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb63522f3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.230537:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb63522f3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.236184:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431557.237968:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63522f69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a6f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.237978:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431557.237981:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63522f69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a6f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.237989:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63522f69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a6f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.237999:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a6f:0x0].0x0 (ffff90cf04d11600)
00010000:00010000:0.0:1789431557.238002:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431557.238005:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63522f69 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a6f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.238012:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63522f69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a6f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.238029:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.238031:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.238033:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.241441:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63522f5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.241459:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63522f5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.241475:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63522f5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.241483:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.241490:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63522f5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.241500:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63522f5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.241522:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xe321e362 (ffff90cf04d11400)
00010000:00010000:0.0:1789431557.241526:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.241532:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63522f5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.241540:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63522f5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431557.245765:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.245951:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933331072
00000100:00100000:0.0:1789431557.245966:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933331072
00000100:00100000:0.0:1789431557.246145:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295467
00000100:00100000:0.0:1789431557.246162:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+335:14616:x1876351933331072:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431557.246190:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431557.246219:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7ee6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.246431:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.246456:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.246471:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431557.246522:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:0.0:1789431557.246526:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431557.246548:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.246578:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63522f9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ee6 expref: 337 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.246600:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63522fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ee6 expref: 336 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.246610:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431557.246614:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431557.246619:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd5e00, rc 0)
00000100:00100000:0.0:1789431557.246692:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+336:14616:x1876351933331072:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 534us (941us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431557.246699:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295467
00000100:00100000:3.0:1789431557.250923:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.258521:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933331456
00000100:00100000:3.0:1789431557.258534:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933331456
00000100:00100000:3.0:1789431557.258605:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12323
00000100:00100000:3.0:1789431557.258617:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+339:14617:x1876351933331456:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431557.297785:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.297913:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.302625:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933332352
00000100:00100000:3.0:1789431557.302647:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933332352
00000100:00100000:3.0:1789431557.302798:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295472
00000100:00100000:3.0:1789431557.302828:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+339:14617:x1876351933332352:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.302857:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.302888:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352300a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7f10 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.302978:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63523011 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.302998:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63523011 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.303014:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63523011 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.303033:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63523018 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.303046:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63523018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.303094:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63523018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.303170:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63523011 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.303193:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63523011 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.303200:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63523011 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.303206:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.303212:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63523011 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.303220:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63523011 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.303235:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431557.303238:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.303244:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63523011 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.303252:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63523011 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.303266:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63523018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.303274:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63523018 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.303280:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63523018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.303285:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cae00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.303288:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63523018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.303295:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63523018 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.303314:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xe321e362 (ffff90ce2154df00)
00010000:00010000:3.0:1789431557.303317:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.303320:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63523018 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.303326:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63523018 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.304647:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352300a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f10 expref: 340 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.304671:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431557.304674:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.304680:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352300a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f10 expref: 340 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.304705:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb800, rc 0)
00000100:00100000:3.0:1789431557.306114:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+339:14617:x1876351933332352:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3290us (8341us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431557.306130:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295472
00000100:00100000:3.0:1789431557.310548:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.319932:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.326658:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295474
00000100:00100000:3.0:1789431557.326670:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+339:14616:x1876351933332864:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431557.326740:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431557.326763:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63522fe0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a70:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ef4 expref: 339 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.326793:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a70:0x0].0x0 (ffff90cf04d11f00)
00010000:00010000:3.0:1789431557.326806:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431557.326847:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352301f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.326866:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352301f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.326891:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352301f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.326911:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352302d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.326918:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352302d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.326931:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352302d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.327098:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352303b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a70:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.327108:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352303b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a70:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.327115:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352303b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a70:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431557.327849:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1190, 64 off84352
00010000:00010000:3.0:1789431557.327925:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523049 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a70:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.327938:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523049 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a70:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.327948:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523049 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a70:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.327957:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523049 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a70:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.327965:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523049 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a70:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.327972:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523049 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a70:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.328013:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431557.328039:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352303b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.328045:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352303b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.328096:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352303b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.328103:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.328109:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352303b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.328118:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352303b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.328130:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a70:0x0].0x0 (ffff90ce2154d600)
00010000:00010000:3.0:1789431557.328134:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431557.328139:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352303b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.328147:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352303b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.328169:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352301f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.328178:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352301f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.328189:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352301f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.328213:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.328218:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352301f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.328239:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352301f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.328258:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431557.328262:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.328268:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352301f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.328278:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352301f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431557.328303:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003233b611 reply state 000000000f91ec75 transno 4295120727 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352302d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431557.328328:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431557.328452:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+343:14616:x1876351933332864:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1779us (17915us total) trans 4295120727 rc 0/0
00000100:00100000:3.0:1789431557.328465:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295474
00010000:00010000:0.0:1789431557.331449:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352302d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.331478:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352302d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.331486:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352302d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.331494:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.331499:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352302d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.331508:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352302d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.331528:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x603ebcfa (ffff90ce2154d800)
00010000:00010000:0.0:1789431557.331531:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.331538:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352302d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.331544:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352302d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x603ebcfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431557.335122:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.336792:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.348435:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.348540:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.348689:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933333760
00000100:00100000:3.0:1789431557.348704:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933333760
00000100:00100000:3.0:1789431557.348784:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295476
00000100:00100000:3.0:1789431557.348797:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+340:14616:x1876351933333760:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.348826:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.348856:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb6352307a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7f2c expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.348946:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523081 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.348965:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.348979:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431557.349024:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:3.0:1789431557.349029:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431557.349109:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.349143:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb6352307a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f2c expref: 342 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.349164:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f2c expref: 341 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.349175:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431557.349179:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431557.349183:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae2600, rc 0)
00000100:00100000:3.0:1789431557.349259:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+341:14616:x1876351933333760:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 465us (718us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431557.349267:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295476
00000100:00100000:3.0:1789431557.355042:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.355240:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933334016
00000100:00100000:0.0:1789431557.355254:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933334016
00000100:00100000:0.0:1789431557.355337:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295477
00000100:00100000:0.0:1789431557.355350:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+342:14617:x1876351933334016:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431557.355441:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431557.355477:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523050 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a71:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f17 expref: 342 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.355503:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a71:0x0].0x0 (ffff90cf04d11b00)
00010000:00010000:0.0:1789431557.355517:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431557.355545:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523088 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.355568:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523088 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.355580:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523088 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.355598:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb6352308f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.355606:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb6352308f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.355613:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb6352308f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.355755:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523096 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a71:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.355764:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523096 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a71:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.355780:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523096 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a71:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:0.0:1789431557.356449:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1192, 64 off84544
00010000:00010000:0.0:1789431557.356527:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352309d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a71:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.356539:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352309d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a71:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.356548:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352309d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a71:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.356557:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352309d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a71:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.356563:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352309d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a71:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.356570:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352309d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a71:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.357683:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431557.357731:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523096 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.357742:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523096 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.357751:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523096 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.357757:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.357762:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523096 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.357781:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523096 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.357804:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a71:0x0].0x0 (ffff90cf3afe7a00)
00010000:00010000:0.0:1789431557.357808:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431557.357813:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523096 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.357820:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523096 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.357848:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523088 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.357855:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523088 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.357860:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523088 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.357866:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.357877:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523088 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.357884:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523088 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.357893:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431557.357896:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.357900:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523088 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.357906:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523088 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431557.357922:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001be9d53a reply state 00000000cf90cd2a transno 4295120730 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb6352308f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431557.357932:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431557.358417:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+343:14617:x1876351933334016:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3064us (3384us total) trans 4295120730 rc 0/0
00000100:00100000:0.0:1789431557.358427:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295477
00010000:00010000:3.0:1789431557.358814:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431557.358824:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352309d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a71:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.358834:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5e00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431557.358837:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352309d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a71:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.358846:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352309d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a71:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.358860:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a71:0x0].0x0 (ffff90cf3afe7a00)
00010000:00010000:3.0:1789431557.358862:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431557.358997:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352309d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a71:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.359006:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352309d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a71:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.359032:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431557.359035:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431557.359037:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431557.359669:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933334144
00000100:00100000:3.0:1789431557.359681:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933334144
00000100:00100000:3.0:1789431557.359749:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12326
00000100:00100000:3.0:1789431557.359761:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07769450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+343:14616:x1876351933334144:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431557.367221:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933334272
00000100:00100000:3.0:1789431557.367235:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933334272
00000100:00100000:3.0:1789431557.367317:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295478
00000100:00100000:3.0:1789431557.367330:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+343:14617:x1876351933334272:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.367363:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.367400:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635230a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7f33 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367483:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635230ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367501:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635230ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367515:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635230ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367533:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635230b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367540:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635230b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367546:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635230b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367613:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635230ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367621:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635230ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367629:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635230ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367635:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.367641:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635230ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367649:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635230ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367662:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431557.367666:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.367671:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635230ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367678:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635230ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367695:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635230b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367701:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635230b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367707:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635230b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367712:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.367714:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635230b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367720:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635230b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367727:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x8842e21 (ffff90ce2154df00)
00010000:00010000:3.0:1789431557.367730:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.367733:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635230b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367739:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635230b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367788:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635230a4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f33 expref: 344 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367799:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431557.367801:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.367804:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635230a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f33 expref: 344 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.367814:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3800, rc 0)
00000100:00100000:3.0:1789431557.368042:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+343:14617:x1876351933334272:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 714us (1258us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431557.368105:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295478
00000100:00100000:3.0:1789431557.372103:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.374535:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.375027:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933334528
00000100:00100000:3.0:1789431557.375039:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933334528
00000100:00100000:3.0:1789431557.375250:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295479
00000100:00100000:3.0:1789431557.375262:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+342:14617:x1876351933334528:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.375288:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.375325:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635230b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7f3a expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.376471:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635230c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.376498:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635230c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.376511:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635230c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431557.376560:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:3.0:1789431557.376564:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431557.376589:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635230c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.376624:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635230b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f3a expref: 344 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.376645:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635230c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f3a expref: 343 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.376655:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431557.376658:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431557.376663:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cba00, rc 0)
00000100:00100000:3.0:1789431557.376753:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+343:14617:x1876351933334528:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1492us (2227us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431557.376762:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295479
00000100:00100000:0.0:1789431557.381819:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.384890:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933334912
00000100:00100000:3.0:1789431557.384902:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933334912
00000100:00100000:3.0:1789431557.384967:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12327
00000100:00100000:3.0:1789431557.384979:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+343:14617:x1876351933334912:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431557.390623:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+343:14617:x1876351933334912:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 5629us (5809us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431557.390639:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12327
00000100:00100000:0.0:1789431557.393010:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.393215:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933335040
00000100:00100000:3.0:1789431557.393228:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933335040
00000100:00100000:3.0:1789431557.393624:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295481
00000100:00100000:3.0:1789431557.393638:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+343:14616:x1876351933335040:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.393667:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.393695:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635230dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7f48 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.393794:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635230e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.393813:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635230e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.393828:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635230e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.393845:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635230ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.393852:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635230ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.393859:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635230ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.393999:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635230e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.394009:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635230e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.394017:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635230e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.394023:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.394029:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635230e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.394036:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635230e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.394078:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431557.394081:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.394088:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635230e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.394094:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635230e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.394107:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635230ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.394113:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635230ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.394117:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635230ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.394121:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.394124:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635230ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.394130:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635230ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.394135:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x4bac77d5 (ffff90ce2154df00)
00010000:00010000:3.0:1789431557.394138:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.394140:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635230ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.394145:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635230ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.394180:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635230dc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f48 expref: 344 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.394189:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431557.394191:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.394194:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635230dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f48 expref: 344 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.394203:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035ca800, rc 0)
00000100:00100000:3.0:1789431557.394285:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+343:14616:x1876351933335040:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 651us (1292us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431557.394293:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295481
00000100:00100000:0.0:1789431557.403292:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.403521:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.404587:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295482
00000100:00100000:3.0:1789431557.404602:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+344:14617:x1876351933335296:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.404632:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.404660:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb635230f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7f4f expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.404757:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635230f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.404795:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635230f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.404810:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635230f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.404831:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635230ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.404838:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635230ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.404846:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635230ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.404920:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635230f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.404928:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635230f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.404935:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635230f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.404941:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.404946:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635230f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.404954:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635230f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.404968:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431557.404971:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.404977:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635230f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.404985:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635230f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.405001:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635230ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.405007:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635230ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.405013:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635230ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.405019:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce27814e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.405022:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635230ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.405029:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635230ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.405036:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x8842e21 (ffff90ce2154d400)
00010000:00010000:3.0:1789431557.405039:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.405042:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635230ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.405077:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635230ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.405119:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb635230f1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f4f expref: 345 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.405131:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431557.405134:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:3.0:1789431557.405137:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb635230f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f4f expref: 345 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.405148:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cae00, rc 0)
00000100:00100000:3.0:1789431557.405312:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+344:14617:x1876351933335296:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 714us (2044us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431557.405320:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295482
00000100:00100000:3.0:1789431557.405348:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295483
00000100:00100000:3.0:1789431557.405359:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+343:14616:x1876351933335552:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.405371:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.405595:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431557.405615:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523081 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f2c expref: 343 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.405628:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431557.405632:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431557.405643:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523106 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7f56 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.405739:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352310d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.405751:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352310d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.405760:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352310d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.405795:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523114 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.405804:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523114 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.405811:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523114 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:3.0:1789431557.406877:0:12775:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4fb:0x0], index 0: 0
00010000:00010000:3.0:1789431557.407141:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb6352311b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a72:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.407157:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb6352311b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a72:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.407170:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb6352311b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a72:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.407216:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352310d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.407227:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352310d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.407234:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352310d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.407240:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.407244:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352310d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.407253:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352310d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.407267:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431557.407271:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.407277:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352310d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.409245:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352310d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431557.409274:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007c560110 reply state 000000008deb68cc transno 4295120731 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523114 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431557.409285:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431557.409718:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523106 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f56 expref: 345 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.409739:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb6352311b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a72:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f56 expref: 344 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.409755:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a72:0x0].0x0 (ffff90ce2154d500)
00010000:00010000:3.0:1789431557.409758:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431557.409763:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3200, rc 0)
00000100:00100000:3.0:1789431557.409877:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+345:14616:x1876351933335552:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4519us (6354us total) trans 4295120731 rc 0/0
00000100:00100000:3.0:1789431557.409888:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295483
00000100:00100000:0.0:1789431557.415943:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.416647:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.422678:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431557.425577:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431557.432900:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.434786:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431557.437339:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431557.437350:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb6352316f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a72:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.437359:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985fc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431557.437362:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb6352316f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a72:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.437370:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb6352316f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a72:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.437383:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a72:0x0].0x0 (ffff90cf062f5200)
00010000:00010000:0.0:1789431557.437386:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431557.437391:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb6352316f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a72:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.437397:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb6352316f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a72:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.437418:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.437420:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.437421:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431557.442189:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.442354:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933336576
00000100:00100000:3.0:1789431557.442370:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933336576
00000100:00100000:3.0:1789431557.442491:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295487
00000100:00100000:3.0:1789431557.442504:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+345:14616:x1876351933336576:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.442534:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.442561:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523176 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7f72 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442649:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352317d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442666:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352317d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442680:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352317d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442696:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523184 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442703:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442710:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442795:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352317d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442803:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352317d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442811:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352317d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442817:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.442822:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352317d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442830:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352317d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442844:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431557.442848:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.442854:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352317d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442861:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352317d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442876:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442883:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523184 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442889:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442894:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae2600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.442896:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442902:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523184 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442910:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x8f93a2f9 (ffff90ce2154d400)
00010000:00010000:3.0:1789431557.442913:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.442915:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523184 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442921:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523184 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442961:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523176 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f72 expref: 346 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442972:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431557.442974:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.442978:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523176 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f72 expref: 346 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.442988:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3000, rc 0)
00000100:00100000:3.0:1789431557.443263:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+345:14616:x1876351933336576:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 761us (1086us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431557.443272:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295487
00000100:00100000:0.0:1789431557.449506:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431557.454995:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63523192 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.455016:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63523192 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.455024:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63523192 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.455030:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.455036:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63523192 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.455044:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63523192 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431557.455168:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431557.458537:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431557.458543:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.458555:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63523192 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.458570:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63523192 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431557.459489:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000023aa074d reply state 00000000cf1661d1 transno 4295120734 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63523199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431557.459509:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431557.460029:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb6352318b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f79 expref: 348 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.460077:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb635231a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a73:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f79 expref: 347 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.460086:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a73:0x0].0x0 (ffff90cf04d11400)
00010000:00010000:0.0:1789431557.460089:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431557.460093:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e3000, rc 0)
00000100:00100000:0.0:1789431557.460204:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+348:14617:x1876351933336832:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10405us (10711us total) trans 4295120734 rc 0/0
00000100:00100000:0.0:1789431557.460214:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295488
00000100:00100000:3.0:1789431557.461020:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.472011:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+347:14616:x1876351933337088:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 9160us (10982us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431557.472033:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12329
00000100:00100000:0.0:1789431557.473601:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.479969:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.490961:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933337984
00000100:00100000:3.0:1789431557.490975:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933337984
00000100:00100000:0.0:1789431557.494590:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295492
00000100:00100000:0.0:1789431557.494603:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+348:14616:x1876351933338112:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431557.494613:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431557.494625:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635231df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7f95 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494678:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635231ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494689:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635231ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494697:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635231ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494711:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635231f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494718:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635231f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494725:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635231f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494803:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635231ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494811:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635231ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494818:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635231ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494825:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.494830:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635231ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494843:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635231ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494852:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431557.494855:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.494859:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635231ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494865:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635231ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494876:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635231f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494882:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635231f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494889:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635231f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494894:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.494897:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635231f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494902:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635231f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494909:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xefbe0492 (ffff90cf3afe7400)
00010000:00010000:0.0:1789431557.494912:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.494914:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635231f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494920:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635231f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494953:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635231df lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f95 expref: 349 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494962:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431557.494965:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.494968:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635231df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f95 expref: 349 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.494978:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4e00, rc 0)
00000100:00100000:0.0:1789431557.495089:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+348:14616:x1876351933338112:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 489us (1542us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431557.495096:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295492
00010000:00010000:0.0:1789431557.497722:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431557.497732:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63523202 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a73:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.497739:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7bc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431557.497744:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63523202 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a73:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.497752:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63523202 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a73:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.497775:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a73:0x0].0x0 (ffff90cf062f5600)
00010000:00010000:0.0:1789431557.497778:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431557.497784:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63523202 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a73:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.497790:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63523202 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a73:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.497806:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.497809:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.497811:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431557.501127:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933338240
00000100:00100000:3.0:1789431557.501142:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933338240
00000100:00100000:3.0:1789431557.501214:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295493
00000100:00100000:3.0:1789431557.501226:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+349:14616:x1876351933338240:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.501254:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.501281:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523209 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7f9c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501365:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523210 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501381:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523210 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501396:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523210 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501413:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523217 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501420:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501428:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501506:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523210 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501514:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523210 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501522:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523210 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501528:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae2600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.501534:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523210 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501542:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523210 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501556:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431557.501559:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.501564:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523210 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501570:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb63523210 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501583:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501589:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523217 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501594:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523217 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501599:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.501602:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523217 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501607:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523217 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501614:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x4bac77d5 (ffff90ce2154d400)
00010000:00010000:3.0:1789431557.501616:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.501619:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523217 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501624:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523217 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501661:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523209 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f9c expref: 350 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.501673:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431557.501676:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.503443:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523209 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f9c expref: 350 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.503478:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3000, rc 0)
00010000:00010000:0.0:1789431557.503987:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb635231e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.503999:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb635231e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.504007:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb635231e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.504014:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985fc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.504020:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb635231e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.504028:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb635231e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.504072:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xe321e362 (ffff90cf062f5200)
00010000:00010000:0.0:1789431557.504076:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.504081:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb635231e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.504088:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb635231e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431557.508311:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933338368
00000100:00100000:0.0:1789431557.508326:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933338368
00000100:00100000:0.0:1789431557.508407:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295494
00000100:00100000:0.0:1789431557.508419:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+348:14617:x1876351933338368:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431557.508452:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431557.508478:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb6352321e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7fa3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508566:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523225 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508586:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523225 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508600:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523225 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508617:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352322c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508624:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352322c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508632:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352322c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508701:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523225 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508712:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523225 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508721:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508728:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.508733:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508742:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523225 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508756:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431557.508760:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.508775:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523225 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508782:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523225 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508795:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352322c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508801:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352322c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508807:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352322c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508812:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.508815:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352322c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508824:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352322c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508831:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x37612e21 (ffff90cf3afe7400)
00010000:00010000:0.0:1789431557.508833:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.508835:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352322c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508840:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb6352322c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508877:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb6352321e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fa3 expref: 349 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508888:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431557.508892:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.508896:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb6352321e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fa3 expref: 349 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.508906:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4e00, rc 0)
00000100:00100000:0.0:1789431557.509004:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+348:14617:x1876351933338368:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 570us (791us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431557.509013:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295494
00000100:00100000:3.0:1789431557.522689:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933338624
00000100:00100000:3.0:1789431557.522703:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933338624
00000100:00100000:3.0:1789431557.522800:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295495
00000100:00100000:3.0:1789431557.522816:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+349:14616:x1876351933338624:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.522853:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.522858:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431557.522892:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb635231b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f80 expref: 349 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.522915:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431557.522921:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431557.522931:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb6352323a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7faa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.523192:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523248 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.523205:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523248 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.523214:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523248 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.523232:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb6352324f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.523244:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb6352324f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.523255:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb6352324f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431557.536972:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933339008
00000100:00100000:0.0:1789431557.536981:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933339008
00000100:00100000:0.0:1789431557.537033:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12331
00000100:00100000:0.0:1789431557.537043:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07768850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+350:14617:x1876351933339008:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431557.549604:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933339264
00000100:00100000:3.0:1789431557.549617:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933339264
00000100:00100000:3.0:1789431557.549692:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12332
00000100:00100000:3.0:1789431557.549706:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+351:14616:x1876351933339264:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431557.550165:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+352:14616:x1876351933339264:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 460us (977us total) trans 4295120738 rc 0/0
00000100:00100000:0.0:1789431557.550174:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07768850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+352:14617:x1876351933339008:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 13129us (13283us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431557.550181:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12332
00000100:00100000:0.0:1789431557.551552:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12331
00000100:00100000:0.0:1789431557.561833:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933339520
00000100:00100000:0.0:1789431557.561847:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933339520
00000100:00100000:0.0:1789431557.561987:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295497
00000100:00100000:0.0:1789431557.562002:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+351:14617:x1876351933339520:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431557.562036:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431557.562114:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb6352326b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7fbf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562221:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523272 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562257:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523272 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562274:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523272 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562293:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523279 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562301:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562307:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562376:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523272 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562385:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523272 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562393:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523272 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562400:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.562406:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523272 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562415:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523272 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562429:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431557.562433:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.562440:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523272 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562784:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523272 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562802:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562810:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523279 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562817:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562822:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.562826:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562833:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523279 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562843:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x37612e21 (ffff90cf3afe7400)
00010000:00010000:0.0:1789431557.562846:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.562849:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523279 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562855:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523279 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562903:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb6352326b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fbf expref: 352 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562914:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431557.562917:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:0.0:1789431557.562921:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb6352326b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fbf expref: 352 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.562931:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4e00, rc 0)
00000100:00100000:0.0:1789431557.563156:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+351:14617:x1876351933339520:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1155us (1623us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431557.563166:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295497
00000100:00100000:3.0:1789431557.566903:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.567250:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933339776
00000100:00100000:0.0:1789431557.567264:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933339776
00000100:00100000:0.0:1789431557.567341:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295498
00000100:00100000:0.0:1789431557.567353:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+351:14616:x1876351933339776:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431557.567425:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431557.567757:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63523256 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a74:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7faa expref: 351 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.567794:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a74:0x0].0x0 (ffff90cf062f5600)
00010000:00010000:0.0:1789431557.567809:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431557.567839:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523280 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.567858:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523280 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.567871:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523280 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.567893:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523287 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.567900:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523287 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.567906:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523287 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.568084:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352328e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a74:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.568093:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352328e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a74:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.568100:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352328e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a74:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:0.0:1789431557.568955:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1192, 64 off84480
00010000:00010000:0.0:1789431557.569041:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b000/0xd8e438fb63523295 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a74:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.569090:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b000/0xd8e438fb63523295 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a74:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.569100:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b000/0xd8e438fb63523295 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a74:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.569110:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b000/0xd8e438fb63523295 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a74:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.569117:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b000/0xd8e438fb63523295 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a74:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.569124:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b000/0xd8e438fb63523295 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a74:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.569390:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431557.569425:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352328e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a74:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.569434:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352328e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a74:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.569441:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352328e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a74:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.569573:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431557.569581:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b000/0xd8e438fb63523295 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a74:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.569589:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6b000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431557.569594:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b000/0xd8e438fb63523295 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a74:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.569604:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b000/0xd8e438fb63523295 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a74:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.569621:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a74:0x0].0x0 (ffff90cf3afe7f00)
00010000:00010000:3.0:1789431557.569625:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431557.569631:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b000/0xd8e438fb63523295 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a74:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.569637:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b000/0xd8e438fb63523295 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a74:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.569655:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431557.569658:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431557.569660:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.574466:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00031400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.574478:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352328e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a74:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.574494:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352328e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a74:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.574519:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a74:0x0].0x0 (ffff90cf3afe7f00)
00010000:00010000:0.0:1789431557.574523:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431557.574530:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352328e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a74:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.574538:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352328e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a74:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.574593:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523280 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.574601:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523280 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.574608:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523280 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.574613:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.574616:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523280 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.574622:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523280 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.574631:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431557.574634:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.574637:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523280 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.574647:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523280 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431557.574661:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000271160aa reply state 00000000b82049fa transno 4295120739 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523287 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431557.574673:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431557.574827:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+352:14616:x1876351933339776:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 7469us (7930us total) trans 4295120739 rc 0/0
00000100:00100000:0.0:1789431557.574839:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295498
00000100:00100000:3.0:1789431557.576688:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933339904
00000100:00100000:3.0:1789431557.576701:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933339904
00000100:00100000:3.0:1789431557.576775:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295499
00000100:00100000:3.0:1789431557.576789:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+352:14617:x1876351933339904:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.576818:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.576847:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb6352329c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7fc6 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.576933:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635232a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.576951:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635232a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.576965:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635232a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.576983:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635232aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.576990:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635232aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.576996:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635232aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.577099:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635232a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.577107:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635232a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.577116:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635232a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.577123:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.577129:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635232a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.577137:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635232a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.577150:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431557.577154:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.577160:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635232a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.577166:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635232a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.577181:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635232aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.577187:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635232aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.577194:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635232aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.577199:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.577202:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635232aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.577213:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635232aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.577221:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xe7ee91d5 (ffff90ce2154df00)
00010000:00010000:3.0:1789431557.577223:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.577226:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635232aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.577232:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635232aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.577282:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb6352329c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fc6 expref: 353 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.577295:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431557.577297:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.577301:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb6352329c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fc6 expref: 353 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.577312:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae2600, rc 0)
00000100:00100000:3.0:1789431557.577396:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+352:14617:x1876351933339904:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 609us (1200us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431557.577404:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295499
00010000:00010000:0.0:1789431557.579461:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523287 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.579487:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523287 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.579496:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523287 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.579503:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00030e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.579509:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523287 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.579518:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523287 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.579538:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x4bac77d5 (ffff90cf3afe7200)
00010000:00010000:0.0:1789431557.579541:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.579547:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523287 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.579555:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523287 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431557.590409:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933340032
00000100:00100000:3.0:1789431557.590433:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933340032
00000100:00100000:3.0:1789431557.590525:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295500
00000100:00100000:3.0:1789431557.590538:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+351:14616:x1876351933340032:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.590575:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.590605:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635232b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7fcd expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.590700:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.590721:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.590734:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.590754:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635232bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.590943:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635232bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.590951:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635232bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.591026:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.591034:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.591041:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.591090:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.591097:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.591106:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.591122:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431557.591126:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.591133:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.591140:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.591153:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635232bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.591160:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635232bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.591167:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635232bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.591172:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce27814e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.591176:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635232bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.591182:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635232bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.591189:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xefbe0492 (ffff90ce2154d900)
00010000:00010000:3.0:1789431557.591193:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.591196:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635232bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.591203:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635232bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xefbe0492 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.591241:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635232b1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fcd expref: 352 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.591253:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431557.591255:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.591259:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635232b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fcd expref: 352 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.591268:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3200, rc 0)
00000100:00100000:3.0:1789431557.591364:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+351:14616:x1876351933340032:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 829us (4762us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431557.591373:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295500
00000100:00100000:0.0:1789431557.599240:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933340160
00000100:00100000:0.0:1789431557.599256:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933340160
00000100:00100000:0.0:1789431557.599343:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295501
00000100:00100000:0.0:1789431557.599357:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+351:14616:x1876351933340160:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431557.599387:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431557.599426:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb635232c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7fd4 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.599519:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635232cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.599539:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635232cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.599554:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635232cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431557.599604:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:0.0:1789431557.599608:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431557.599632:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635232cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.599664:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb635232c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fd4 expref: 353 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.599689:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635232cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fd4 expref: 352 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.599699:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431557.599702:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431557.599707:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6b800, rc 0)
00000100:00100000:0.0:1789431557.600117:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+352:14616:x1876351933340160:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 697us (1252us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431557.600127:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295501
00000100:00100000:0.0:1789431557.605946:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.606090:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933340288
00000100:00100000:3.0:1789431557.606105:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933340288
00000100:00100000:3.0:1789431557.606170:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12333
00000100:00100000:3.0:1789431557.606181:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+352:14616:x1876351933340288:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431557.614207:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933340416
00000100:00100000:3.0:1789431557.614227:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933340416
00000100:00100000:3.0:1789431557.614319:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295502
00000100:00100000:3.0:1789431557.614332:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+354:14617:x1876351933340416:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.614360:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.614391:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635232d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7fdb expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614484:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635232db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614505:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635232db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614518:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635232db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614535:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614542:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614549:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614637:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635232db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614646:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635232db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614653:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635232db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614659:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.614664:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635232db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614690:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635232db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614705:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431557.614708:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.614715:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635232db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614721:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635232db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614739:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614745:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614751:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614757:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.614759:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614773:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614781:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xcf8a5e3e (ffff90ce2154d900)
00010000:00010000:3.0:1789431557.614784:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.614786:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614792:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635232e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614831:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635232d4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fdb expref: 355 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614841:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431557.614844:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.614848:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635232d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fdb expref: 355 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.614858:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce27814e00, rc 0)
00000100:00100000:3.0:1789431557.614946:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+354:14617:x1876351933340416:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 617us (2478us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431557.614955:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295502
00000100:00100000:0.0:1789431557.624600:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431557.634844:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb635232f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.634907:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb635232f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.634917:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb635232f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.634925:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.634931:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb635232f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.634943:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb635232f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.634963:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xcf8a5e3e (ffff90cf062f5700)
00010000:00010000:3.0:1789431557.634966:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.634971:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb635232f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.634978:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb635232f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431557.645397:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933341184
00000100:00100000:3.0:1789431557.645411:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933341184
00000100:00100000:3.0:1789431557.645485:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295505
00000100:00100000:3.0:1789431557.645497:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+353:14616:x1876351933341184:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.645530:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.645560:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523321 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c7ff7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.645654:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523328 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.645674:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523328 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.645688:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523328 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.645705:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb6352332f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xb058de9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.645714:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb6352332f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xb058de9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.645720:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb6352332f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xb058de9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.645804:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523328 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.645812:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523328 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.645819:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523328 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.645825:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.645830:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523328 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.645840:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523328 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.645854:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431557.645857:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.645864:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523328 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.645871:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523328 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.645961:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb6352332f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xb058de9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.645971:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb6352332f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xb058de9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.645978:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb6352332f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xb058de9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.645984:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae2600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.645987:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb6352332f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xb058de9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.645993:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb6352332f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xb058de9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.646002:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xb058de9e (ffff90ce2154d900)
00010000:00010000:3.0:1789431557.646005:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.646008:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb6352332f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xb058de9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.646015:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb6352332f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xb058de9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.646102:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523321 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ff7 expref: 354 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.646114:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431557.646117:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.646120:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523321 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ff7 expref: 354 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.646136:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3600, rc 0)
00000100:00100000:3.0:1789431557.646225:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+353:14616:x1876351933341184:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 730us (935us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431557.646233:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295505
00000100:00100000:3.0:1789431557.660962:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933341440
00000100:00100000:3.0:1789431557.660976:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933341440
00000100:00100000:3.0:1789431557.661041:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12334
00000100:00100000:3.0:1789431557.661084:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+353:14617:x1876351933341440:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431557.661552:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+354:14617:x1876351933341440:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 500us (3022us total) trans 4295120741 rc 0/0
00000100:00100000:3.0:1789431557.661560:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12334
00000100:00100000:3.0:1789431557.671663:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.675697:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933342080
00000100:00100000:0.0:1789431557.675724:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933342080
00000100:00100000:0.0:1789431557.677468:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295508
00000100:00100000:0.0:1789431557.677486:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+356:14617:x1876351933342080:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431557.677572:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431557.677611:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb635232fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a75:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fe2 expref: 356 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.677634:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a75:0x0].0x0 (ffff90cf062f5600)
00010000:00010000:0.0:1789431557.677650:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431557.678189:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a400/0xd8e438fb63523375 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.678214:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a400/0xd8e438fb63523375 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.678466:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a400/0xd8e438fb63523375 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.678499:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352337c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.678509:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352337c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.678518:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352337c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.678674:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523383 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a75:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.678683:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523383 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.678690:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523383 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.681403:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431557.681418:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352338a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a75:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.681429:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431557.681434:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352338a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a75:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.681444:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352338a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a75:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.681460:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a75:0x0].0x0 (ffff90cf3afe7f00)
00010000:00010000:3.0:1789431557.681464:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431557.681468:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352338a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a75:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.681476:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352338a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a75:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.681503:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431557.681505:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431557.681507:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431557.683096:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933342208
00000100:00100000:3.0:1789431557.683110:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933342208
00000100:00100000:3.0:1789431557.683189:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8151
00000100:00100000:3.0:1789431557.683202:0:14482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+107:2350:x1876351933342208:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.683228:0:14482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.687370:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352337c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.687392:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352337c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.687401:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352337c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.687408:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.687413:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352337c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.687421:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352337c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.687442:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xcf8a5e3e (ffff90cf3afe7200)
00010000:00010000:3.0:1789431557.687446:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.687452:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352337c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.687458:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352337c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431557.697024:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933342592
00000100:00100000:3.0:1789431557.697039:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933342592
00000100:00100000:3.0:1789431557.697150:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12335
00000100:00100000:3.0:1789431557.697163:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+355:14616:x1876351933342592:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431557.697663:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+356:14616:x1876351933342592:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 497us (945us total) trans 4295120744 rc 0/0
00000100:00100000:3.0:1789431557.697672:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12335
00000100:00100000:3.0:1789431557.713276:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.713728:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.713800:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933343104
00000100:00100000:0.0:1789431557.713823:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933343104
00000100:00100000:0.0:1789431557.713906:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12336
00000100:00100000:0.0:1789431557.713924:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07769850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+358:14617:x1876351933343104:12345-192.168.203.4@tcp:37:dbench.0
00010000:00010000:0.0:1789431557.718000:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431557.718013:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635233d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a76:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.719754:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431557.719776:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635233d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a76:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.719796:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635233d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a76:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.719825:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a76:0x0].0x0 (ffff90cf04a08a00)
00010000:00010000:0.0:1789431557.719828:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431557.719833:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635233d0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a76:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.719839:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635233d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a76:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.719864:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.719867:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.719869:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431557.727738:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933343360
00000100:00100000:3.0:1789431557.727754:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933343360
00000100:00100000:3.0:1789431557.727843:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295512
00000100:00100000:3.0:1789431557.727856:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+359:14617:x1876351933343360:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.727888:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.727916:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb635233d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8021 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728021:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635233de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728041:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635233de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728096:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635233de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.728106:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635233c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728113:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635233e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.728116:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635233c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728120:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635233e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.728124:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635233c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728127:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635233e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.728131:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.728136:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635233c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.728144:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635233c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.728161:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x4bac77d5 (ffff90cf04d11b00)
00010000:00010000:0.0:1789431557.728165:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.728171:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635233c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.728177:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635233c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728201:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635233de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728206:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635233de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728213:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635233de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728218:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.728221:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635233de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728227:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635233de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728235:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431557.728238:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.728242:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635233de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728247:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635233de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728259:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635233e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728265:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635233e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728271:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635233e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728276:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.728279:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635233e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728285:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635233e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728293:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xe7ee91d5 (ffff90ce2154d900)
00010000:00010000:3.0:1789431557.728295:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.728308:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635233e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728314:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635233e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728350:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb635233d7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8021 expref: 359 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728367:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431557.728369:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:3.0:1789431557.728373:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2600/0xd8e438fb635233d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8021 expref: 359 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.728382:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae2600, rc 0)
00000100:00100000:3.0:1789431557.739993:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.761249:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.761325:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.779360:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431557.779553:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63523432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.779570:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63523432 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.779579:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63523432 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.779586:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985fe00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431557.779592:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63523432 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.779602:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63523432 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.779624:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xd10cee2b (ffff90cf22651c00)
00010000:00010000:3.0:1789431557.779628:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431557.779636:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63523432 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.779645:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63523432 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431557.786431:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.786791:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933344512
00000100:00100000:0.0:1789431557.786806:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933344512
00000100:00100000:0.0:1789431557.786889:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8152
00000100:00100000:0.0:1789431557.786901:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+103:2348:x1876351933344512:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431557.786923:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431557.786953:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000570a40a0/0xd8e438fb6352345c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c804b expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789431557.786989:0:14469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431557.787018:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fd:0x0].0x0 since=3015s v=(0 0)
00010000:00010000:0.0:1789431557.787023:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fd:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431557.787034:0:14469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000570a40a0/0xd8e438fb6352345c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c804b expref: 104 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.787098:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000570a40a0/0xd8e438fb6352345c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c804b expref: 104 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.787115:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6a400, rc 0)
00000100:00100000:0.0:1789431557.787196:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+104:2348:x1876351933344512:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 296us (780us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431557.787207:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8152
00000100:00100000:0.0:1789431557.789441:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.799570:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933344896
00000100:00100000:3.0:1789431557.799585:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933344896
00000100:00100000:3.0:1789431557.799721:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12338
00000100:00100000:3.0:1789431557.799734:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+359:14617:x1876351933344896:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431557.800262:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+360:14617:x1876351933344896:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 529us (1055us total) trans 4295120747 rc 0/0
00000100:00100000:3.0:1789431557.800272:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12338
00000100:00100000:0.0:1789431557.807422:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.813901:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.817206:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431557.822922:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb635234b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.822943:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb635234b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.822955:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb635234b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431557.824958:0:12775:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4fe:0x0], index 0: 0
00010000:00010000:0.0:1789431557.825603:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb635234be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a78:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.825627:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb635234be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.825644:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb635234be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.826323:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb635234a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.826336:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb635234a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.826343:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb635234a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.826354:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.826360:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb635234a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.826368:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb635234a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.826385:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431557.826389:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.826396:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb635234a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.826402:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb635234a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431557.826420:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000611bc94a reply state 0000000060cc9282 transno 4295120749 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb635234b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x4bac77d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431557.826431:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431557.826484:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb635234a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8060 expref: 363 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.826502:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb635234be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8060 expref: 362 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.826510:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a78:0x0].0x0 (ffff90cf3afe7000)
00010000:00010000:0.0:1789431557.826512:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431557.826515:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6be00, rc 0)
00000100:00100000:0.0:1789431557.826612:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+363:14616:x1876351933345536:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8428us (9414us total) trans 4295120749 rc 0/0
00000100:00100000:0.0:1789431557.827408:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295521
00000100:00100000:3.0:1789431557.842869:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.850585:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.854417:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.854650:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933345792
00000100:00100000:0.0:1789431557.854664:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933345792
00000100:00100000:0.0:1789431557.854737:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8153
00000100:00100000:0.0:1789431557.854756:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+108:2347:x1876351933345792:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431557.854790:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431557.854814:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000983102ae/0xd8e438fb635234d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8067 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789431557.854853:0:14468:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431557.854879:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fe:0x0].0x0 since=3015s v=(0 0)
00010000:00010000:0.0:1789431557.854887:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fe:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431557.854910:0:14468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000983102ae/0xd8e438fb635234d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8067 expref: 109 pid: 14468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.854935:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000983102ae/0xd8e438fb635234d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8067 expref: 109 pid: 14468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.854953:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6b000, rc 0)
00000100:00100000:0.0:1789431557.855014:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+109:2347:x1876351933345792:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 265us (4438us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431557.855024:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8153
00000100:00100000:3.0:1789431557.861511:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.867917:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.875287:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.883915:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.901274:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.902382:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.905290:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933346944
00000100:00100000:0.0:1789431557.905316:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933346944
00000100:00100000:3.0:1789431557.912125:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.938944:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933347584
00000100:00100000:3.0:1789431557.938958:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933347584
00000100:00100000:3.0:1789431557.939100:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8154
00000100:00100000:3.0:1789431557.939114:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+104:2347:x1876351933347584:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431557.939139:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431557.939170:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c39cf53b/0xd8e438fb6352356d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8098 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431557.939212:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431557.939242:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fe:0x0].0x0 since=3015s v=(0 0)
00010000:00010000:3.0:1789431557.939248:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fe:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431557.939259:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c39cf53b/0xd8e438fb6352356d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8098 expref: 105 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.939280:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c39cf53b/0xd8e438fb6352356d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8098 expref: 105 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431557.939307:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae2600, rc 0)
00000100:00100000:3.0:1789431557.939379:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+105:2347:x1876351933347584:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 268us (638us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431557.939386:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8154
00000100:00100000:3.0:1789431557.948321:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.948469:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933347840
00000100:00100000:0.0:1789431557.948482:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933347840
00000100:00100000:0.0:1789431557.948547:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12342
00000100:00100000:0.0:1789431557.948559:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+365:14617:x1876351933347840:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431557.952264:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+366:14617:x1876351933347840:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 3684us (3923us total) trans 4295120753 rc 0/0
00000100:00100000:0.0:1789431557.952283:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12342
00000100:00100000:3.0:1789431557.955110:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431557.955185:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933348096
00000100:00100000:0.0:1789431557.955199:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933348096
00000100:00100000:0.0:1789431557.955277:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295530
00000100:00100000:0.0:1789431557.955290:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+366:14616:x1876351933348096:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431557.955331:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431557.955363:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523574 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c809f expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955468:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352357b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955489:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352357b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955503:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352357b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955521:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523582 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xcc55ce19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955529:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955537:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955617:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352357b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955626:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352357b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955634:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352357b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955642:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.955647:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352357b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955655:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352357b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955681:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431557.955685:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.955691:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352357b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955697:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352357b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955712:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955718:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523582 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955725:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955731:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6ae00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.955734:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955740:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523582 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955747:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xcc55ce19 (ffff90cf3afe7e00)
00010000:00010000:0.0:1789431557.955750:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.955753:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523582 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.955759:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523582 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xcc55ce19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.956001:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523574 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c809f expref: 367 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.956014:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431557.956017:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:0.0:1789431557.956020:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523574 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c809f expref: 367 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.956031:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6aa00, rc 0)
00000100:00100000:0.0:1789431557.956565:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+366:14616:x1876351933348096:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1273us (1466us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431557.956574:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295530
00000100:00100000:3.0:1789431557.961583:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431557.964081:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431557.964090:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb6352359e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a79:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.964098:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431557.964101:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb6352359e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a79:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.964108:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb6352359e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a79:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.964118:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a79:0x0].0x0 (ffff90cf11d83f00)
00010000:00010000:0.0:1789431557.964121:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431557.964124:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb6352359e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a79:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.964130:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb6352359e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a79:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.964148:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.964150:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431557.964151:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431557.965835:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431557.977529:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63523590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.977556:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63523590 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.977565:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63523590 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.977576:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431557.977583:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63523590 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.977593:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63523590 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.977617:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x22737f46 (ffff90cf04d11600)
00010000:00010000:0.0:1789431557.977621:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431557.977628:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63523590 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431557.977635:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63523590 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431557.980605:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.980702:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.994602:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431557.994658:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.008832:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933349248
00000100:00100000:3.0:1789431558.008960:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933349248
00000100:00100000:3.0:1789431558.009084:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12343
00000100:00100000:3.0:1789431558.009102:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+368:14617:x1876351933349248:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431558.015693:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.029482:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.029548:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.035588:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+370:14616:x1876351933350144:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 4336us (6024us total) trans 4295120757 rc 0/0
00000100:00100000:0.0:1789431558.035601:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295538
00010000:00010000:0.0:1789431558.041383:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63523638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.041409:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63523638 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.041418:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63523638 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.041425:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985fc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.041432:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63523638 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.041442:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63523638 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.041464:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xe321e362 (ffff90cf22651900)
00010000:00010000:0.0:1789431558.041468:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.041473:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63523638 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.041481:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63523638 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431558.048612:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933350272
00000100:00100000:0.0:1789431558.048632:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933350272
00000100:00100000:0.0:1789431558.048881:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295539
00000100:00100000:0.0:1789431558.048905:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+369:14616:x1876351933350272:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.048936:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.048964:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb6352364d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c80d7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049079:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523654 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049098:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523654 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049112:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523654 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049131:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352365b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049141:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352365b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049147:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352365b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049217:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523654 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049227:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523654 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049235:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523654 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049242:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.049248:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523654 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049255:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523654 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049470:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.049473:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.049481:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523654 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049487:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523654 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049503:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352365b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049511:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352365b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049517:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352365b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049522:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.049526:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352365b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049532:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352365b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049539:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xd0af0a21 (ffff90cf3afe7e00)
00010000:00010000:0.0:1789431558.049542:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.049545:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352365b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049551:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352365b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049593:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb6352364d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c80d7 expref: 370 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049845:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.049848:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.049853:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb6352364d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c80d7 expref: 370 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.049870:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6ae00, rc 0)
00000100:00100000:0.0:1789431558.050022:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+369:14616:x1876351933350272:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1119us (1539us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431558.050032:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295539
00000100:00100000:3.0:1789431558.056206:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.056266:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.063623:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933350784
00000100:00100000:3.0:1789431558.063635:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933350784
00000100:00100000:3.0:1789431558.063735:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12345
00000100:00100000:3.0:1789431558.063748:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+373:14616:x1876351933350784:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431558.068253:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+372:14616:x1876351933350784:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 4488us (4961us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431558.068269:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12345
00000100:00100000:3.0:1789431558.074356:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.074680:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933351040
00000100:00100000:0.0:1789431558.074695:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933351040
00000100:00100000:0.0:1789431558.074774:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295542
00000100:00100000:0.0:1789431558.074787:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+371:14616:x1876351933351040:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.074816:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.074839:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523693 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c80ec expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.074960:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352369a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.074978:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352369a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.074989:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352369a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075007:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075014:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075020:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075117:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352369a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075125:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352369a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075131:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352369a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075136:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.075140:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352369a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075146:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352369a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075155:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.075158:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.075162:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352369a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075168:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352369a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075179:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075185:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075191:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075197:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.075200:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075206:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075213:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xd0af0a21 (ffff90cf3afe7e00)
00010000:00010000:0.0:1789431558.075216:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.075218:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075224:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xd0af0a21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075470:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523693 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c80ec expref: 372 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075483:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.075486:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:0.0:1789431558.075490:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523693 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c80ec expref: 372 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.075499:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6bc00, rc 0)
00000100:00100000:0.0:1789431558.075586:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+371:14616:x1876351933351040:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 802us (1247us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431558.075596:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295542
00000100:00100000:0.0:1789431558.081833:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.081900:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00080000:0.0:1789431558.082378:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1789431558.082570:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933351296
00000100:00100000:3.0:1789431558.082577:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933351296
00000100:00100000:3.0:1789431558.082619:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295543
00000100:00100000:3.0:1789431558.082627:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+371:14616:x1876351933351296:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.082643:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.082660:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635236af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c80fa expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.082732:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635236b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.082749:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635236b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.082776:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635236b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.082802:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635236bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.082810:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635236bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.082818:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635236bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.082886:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635236b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.082894:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635236b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.082902:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635236b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.082908:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.082914:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635236b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.082922:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635236b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.082936:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431558.082939:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.082944:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635236b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.082951:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635236b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.082967:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635236bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.082974:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635236bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.082980:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635236bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.082985:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.082988:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635236bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.082995:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635236bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.083003:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x8842e21 (ffff90ce2154de00)
00010000:00010000:3.0:1789431558.083006:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.083009:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635236bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.083016:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635236bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.083138:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635236af lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c80fa expref: 372 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.083154:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431558.083156:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.083160:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635236af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c80fa expref: 372 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.083171:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3800, rc 0)
00000100:00100000:3.0:1789431558.083209:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+371:14616:x1876351933351296:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 583us (1308us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431558.083217:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295543
00000100:00100000:0.0:1789431558.093199:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933351424
00000100:00100000:0.0:1789431558.093218:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933351424
00000100:00100000:0.0:1789431558.093436:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295544
00000100:00100000:0.0:1789431558.093450:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+371:14616:x1876351933351424:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.093482:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.093512:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635236c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8101 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093600:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093620:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093634:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093651:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093658:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093665:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093740:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093748:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093757:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093775:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.093788:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093798:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093813:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.093816:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.093823:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093830:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093850:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093856:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093863:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093868:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.093872:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093883:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093891:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xe321e362 (ffff90cf3afe7e00)
00010000:00010000:0.0:1789431558.093894:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.093896:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093902:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093945:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635236c4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8101 expref: 372 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093956:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.093958:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.093962:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635236c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8101 expref: 372 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.093972:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6bc00, rc 0)
00000100:00100000:0.0:1789431558.094139:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+371:14616:x1876351933351424:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 692us (2455us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431558.094148:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295544
00000100:00100000:3.0:1789431558.096471:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.111031:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.111185:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933351808
00000100:00100000:0.0:1789431558.111199:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933351808
00000100:00100000:0.0:1789431558.111273:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295545
00000100:00100000:0.0:1789431558.111291:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+371:14616:x1876351933351808:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.111327:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.111330:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431558.111364:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42000/0xd8e438fb63523670 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c80e5 expref: 371 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.111389:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.111395:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431558.111412:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635236e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c810f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.111549:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.111565:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.111576:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.111601:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.111608:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.111614:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431558.112263:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x500:0x0], index 0: 0
00010000:00010000:0.0:1789431558.112466:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635236f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a7c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.112479:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635236f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a7c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.112489:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635236f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a7c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.112532:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.112539:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.112547:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.112553:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.112558:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.112566:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.112576:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.112580:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.112584:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.112590:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635236e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431558.112602:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fe050eba reply state 00000000fdff1c47 transno 4295120759 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431558.112613:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431558.112644:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635236e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c810f expref: 373 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.112658:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635236f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a7c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c810f expref: 372 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.112665:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a7c:0x0].0x0 (ffff90cf3afe7600)
00010000:00010000:0.0:1789431558.112668:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431558.112670:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6b800, rc 0)
00000100:00100000:0.0:1789431558.114308:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+373:14616:x1876351933351808:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2994us (3259us total) trans 4295120759 rc 0/0
00000100:00100000:0.0:1789431558.114323:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295545
00000100:00100000:3.0:1789431558.117741:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431558.121000:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.121024:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.121032:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.121040:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.121076:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.121090:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.121116:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xe321e362 (ffff90cf3afe7e00)
00010000:00010000:0.0:1789431558.121120:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.121127:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.121133:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a000/0xd8e438fb635236ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.136186:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.136329:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933352064
00000100:00100000:0.0:1789431558.136341:0:14505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933352064
00000100:00100000:0.0:1789431558.136430:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8158
00000100:00100000:0.0:1789431558.136442:0:14505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+110:2350:x1876351933352064:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.136467:0:14505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.136497:0:14505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a11e56e8/0xd8e438fb63523703 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8116 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789431558.136538:0:14505:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x500:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431558.136567:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x500:0x0].0x0 since=3016s v=(0 0)
00010000:00010000:0.0:1789431558.136573:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x500:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431558.136584:0:14505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a11e56e8/0xd8e438fb63523703 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8116 expref: 111 pid: 14505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.136604:0:14505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a11e56e8/0xd8e438fb63523703 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8116 expref: 111 pid: 14505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.136618:0:14505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6a000, rc 0)
00000100:00100000:0.0:1789431558.136698:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+111:2350:x1876351933352064:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 258us (528us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431558.136705:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8158
00000100:00100000:0.0:1789431558.154873:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933352320
00000100:00100000:0.0:1789431558.154888:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933352320
00000100:00100000:0.0:1789431558.154966:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12346
00000100:00100000:0.0:1789431558.154979:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07769c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+372:14616:x1876351933352320:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431558.155512:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07769c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+373:14616:x1876351933352320:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 533us (777us total) trans 4295120760 rc 0/0
00000100:00100000:0.0:1789431558.155521:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12346
00000100:00100000:3.0:1789431558.167465:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431558.171034:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431558.171043:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43200/0xd8e438fb6352371f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a7c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.171080:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac43200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431558.171083:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43200/0xd8e438fb6352371f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a7c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.171090:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43200/0xd8e438fb6352371f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a7c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.171101:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a7c:0x0].0x0 (ffff90cf22651900)
00010000:00010000:3.0:1789431558.171103:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431558.171106:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43200/0xd8e438fb6352371f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a7c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.171112:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43200/0xd8e438fb6352371f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a7c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.171132:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431558.171134:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431558.171136:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431558.176597:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.180812:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933352960
00000100:00100000:3.0:1789431558.180827:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933352960
00000100:00100000:3.0:1789431558.180901:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295547
00000100:00100000:3.0:1789431558.180914:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+374:14616:x1876351933352960:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.180946:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.180972:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63523726 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c811d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181452:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352372d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181472:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352372d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181485:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352372d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181503:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523734 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181509:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181520:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181599:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352372d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181607:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352372d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181614:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352372d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181621:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.181625:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352372d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181634:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352372d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181649:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431558.181652:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.181658:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352372d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181664:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352372d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181677:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181683:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523734 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181689:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181694:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.181697:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181703:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523734 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181710:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x8842e21 (ffff90ce2154de00)
00010000:00010000:3.0:1789431558.181713:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.181716:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523734 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181722:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523734 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181783:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63523726 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c811d expref: 375 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181794:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431558.181797:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.181800:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63523726 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c811d expref: 375 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.181810:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e3c00, rc 0)
00000100:00100000:3.0:1789431558.181901:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+374:14616:x1876351933352960:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 989us (1209us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431558.181913:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295547
00000100:00100000:3.0:1789431558.188590:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.188791:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933353088
00000100:00100000:0.0:1789431558.188807:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933353088
00000100:00100000:0.0:1789431558.188887:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295548
00000100:00100000:0.0:1789431558.188900:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+374:14616:x1876351933353088:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.188932:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.188963:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352373b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8124 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.189098:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523742 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.189118:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.189131:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431558.189185:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:0.0:1789431558.189190:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431558.189215:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.189247:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352373b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8124 expref: 376 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.189269:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8124 expref: 375 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.189278:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.189282:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431558.189286:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6be00, rc 0)
00000100:00100000:0.0:1789431558.197128:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.208842:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933353344
00000100:00100000:0.0:1789431558.208857:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933353344
00000100:00100000:0.0:1789431558.208944:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295550
00000100:00100000:0.0:1789431558.208959:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+375:14617:x1876351933353344:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.208987:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.209017:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352375e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8132 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.209144:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523765 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.209164:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.209183:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431558.209230:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:0.0:1789431558.209235:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431558.209258:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.209305:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352375e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8132 expref: 377 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.209329:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523765 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8132 expref: 376 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.209337:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431558.209341:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431558.209344:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6a600, rc 0)
00000100:00100000:0.0:1789431558.209426:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+376:14617:x1876351933353344:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 471us (1077us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431558.209433:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295550
00000100:00100000:3.0:1789431558.210167:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933353472
00000100:00100000:3.0:1789431558.210178:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933353472
00000100:00100000:3.0:1789431558.210289:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12348
00000100:00100000:3.0:1789431558.210309:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+376:14616:x1876351933353472:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431558.219211:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933353600
00000100:00100000:3.0:1789431558.219225:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933353600
00000100:00100000:3.0:1789431558.219302:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12349
00000100:00100000:3.0:1789431558.219314:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+378:14617:x1876351933353600:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431558.227144:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.227199:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933353856
00000100:00100000:3.0:1789431558.227212:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933353856
00000100:00100000:3.0:1789431558.227289:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295551
00000100:00100000:3.0:1789431558.229041:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+376:14616:x1876351933353856:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.229098:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.229128:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb6352376c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8139 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.229234:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523773 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.229256:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523773 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.229270:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523773 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.233597:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352377a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.233624:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352377a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.233641:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352377a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.233730:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523773 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.233738:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523773 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.233745:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523773 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.233751:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.233756:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523773 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.233773:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523773 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.235021:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431558.235025:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.235033:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523773 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.235041:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63523773 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.235080:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352377a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.235088:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352377a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.235094:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352377a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.235100:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.235104:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352377a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.235111:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352377a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.235118:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x8842e21 (ffff90ce2154de00)
00010000:00010000:3.0:1789431558.235120:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.235123:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352377a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.235128:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352377a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x8842e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.235197:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb6352376c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8139 expref: 377 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.235208:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431558.235210:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:3.0:1789431558.235214:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb6352376c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8139 expref: 377 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.235224:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e3c00, rc 0)
00000100:00100000:3.0:1789431558.235509:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+376:14616:x1876351933353856:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6478us (8377us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431558.235520:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295551
00000100:00100000:0.0:1789431558.235707:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.240575:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933353984
00000100:00100000:3.0:1789431558.240597:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933353984
00000100:00100000:3.0:1789431558.240680:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295552
00000100:00100000:3.0:1789431558.240693:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+376:14617:x1876351933353984:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.240723:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.240754:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63523781 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8140 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241141:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63523788 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241161:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63523788 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241175:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63523788 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241202:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb6352378f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x425ecf6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241209:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb6352378f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x425ecf6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241220:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb6352378f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x425ecf6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241299:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63523788 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241309:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63523788 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241317:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63523788 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241325:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.241330:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63523788 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241341:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63523788 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241354:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431558.241358:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.241365:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63523788 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241372:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63523788 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241387:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb6352378f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x425ecf6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241393:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb6352378f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x425ecf6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241399:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb6352378f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x425ecf6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241405:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.241407:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb6352378f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x425ecf6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241414:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb6352378f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x425ecf6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241422:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x425ecf6b (ffff90ce2154d300)
00010000:00010000:3.0:1789431558.241425:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.241428:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb6352378f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x425ecf6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241434:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb6352378f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x425ecf6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241477:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63523781 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8140 expref: 377 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241489:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431558.241492:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.241496:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63523781 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8140 expref: 377 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.241507:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e2400, rc 0)
00000100:00100000:3.0:1789431558.241601:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+376:14617:x1876351933353984:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 911us (5894us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431558.241612:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295552
00000100:00100000:3.0:1789431558.248200:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933354112
00000100:00100000:3.0:1789431558.248216:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933354112
00000100:00100000:3.0:1789431558.248297:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933354240
00000100:00100000:3.0:1789431558.248301:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933354240
00000100:00100000:3.0:1789431558.248332:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295553
00000100:00100000:3.0:1789431558.248343:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+377:14616:x1876351933354112:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.248370:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.248401:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523796 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8147 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248485:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352379d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248505:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352379d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248520:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352379d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248537:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635237a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248543:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635237a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248549:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635237a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248621:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352379d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248629:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352379d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248636:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352379d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248642:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.248648:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352379d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248656:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352379d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248671:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431558.248674:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.248680:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352379d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248687:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352379d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248702:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635237a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248708:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635237a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248714:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635237a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248719:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.248722:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635237a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248728:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635237a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248736:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x37612e21 (ffff90ce2154d400)
00010000:00010000:3.0:1789431558.248738:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.248741:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635237a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248746:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635237a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248800:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523796 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8147 expref: 378 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248812:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431558.248815:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.248819:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523796 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8147 expref: 378 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.248830:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3600, rc 0)
00000100:00100000:3.0:1789431558.248928:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+377:14616:x1876351933354112:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 587us (4813us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431558.248935:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295553
00000100:00100000:3.0:1789431558.248957:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295554
00000100:00100000:3.0:1789431558.248966:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+376:14617:x1876351933354240:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.248975:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.248985:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635237ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c814e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249021:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635237b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249030:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635237b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249037:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635237b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249080:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635237b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x4f0278e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249087:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635237b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4f0278e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249093:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635237b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4f0278e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249131:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635237b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249138:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635237b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249143:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635237b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249147:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce27814e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.249149:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635237b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249156:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635237b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249164:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431558.249167:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.249170:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635237b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249176:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635237b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249185:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635237b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4f0278e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249192:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635237b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4f0278e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249197:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635237b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4f0278e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249203:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce20f06e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.249206:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635237b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4f0278e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249212:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635237b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4f0278e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249220:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x4f0278e7 (ffff90ce2154d500)
00010000:00010000:3.0:1789431558.249222:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.249225:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635237b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x4f0278e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249232:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635237b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x4f0278e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249254:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635237ab lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c814e expref: 377 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249263:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431558.249266:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.249269:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635237ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c814e expref: 377 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.249278:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3200, rc 0)
00000100:00100000:3.0:1789431558.249302:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+376:14617:x1876351933354240:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 339us (1332us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431558.249309:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295554
00000100:00100000:0.0:1789431558.258183:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933354368
00000100:00100000:0.0:1789431558.258199:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933354368
00000100:00100000:0.0:1789431558.258271:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295555
00000100:00100000:0.0:1789431558.258301:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+376:14616:x1876351933354368:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.258329:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.258358:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635237c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8155 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258450:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635237c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258470:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635237c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258485:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635237c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258503:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635237ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258510:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635237ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258517:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635237ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258594:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635237c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258603:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635237c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258611:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635237c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258618:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6ae00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.258624:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635237c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258637:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635237c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258651:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.258654:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.258660:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635237c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258667:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635237c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258682:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635237ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258688:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635237ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258694:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635237ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258699:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.258702:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635237ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258708:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635237ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258715:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xe321e362 (ffff90cf3afe7f00)
00010000:00010000:0.0:1789431558.258718:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.258720:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635237ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258727:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635237ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.258776:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635237c0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8155 expref: 377 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.259212:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.259215:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.259221:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635237c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8155 expref: 377 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.259234:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6b800, rc 0)
00000100:00100000:0.0:1789431558.259536:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+376:14616:x1876351933354368:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1253us (1542us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431558.259546:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295555
00000100:00100000:0.0:1789431558.271553:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933354496
00000100:00100000:0.0:1789431558.271570:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933354496
00000100:00100000:0.0:1789431558.271643:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933354752
00000100:00100000:0.0:1789431558.271647:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933354752
00000100:00100000:0.0:1789431558.271678:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295556
00000100:00100000:0.0:1789431558.271690:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+377:14617:x1876351933354496:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.271721:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.271751:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635237d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c815c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.271879:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635237dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.273897:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635237dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.273907:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635237dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.273927:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523806 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x622c68bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.273935:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x622c68bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.273941:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x622c68bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.273987:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635237dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.273993:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635237dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.273999:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635237dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.274004:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.274008:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635237dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.274015:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635237dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.274026:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431558.274028:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.274031:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635237dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.274037:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635237dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.274068:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x622c68bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.274075:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523806 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x622c68bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.274081:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x622c68bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.274086:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00030e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.274088:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x622c68bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.274094:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523806 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x622c68bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.274100:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x622c68bf (ffff90cf3afe7600)
00010000:00010000:0.0:1789431558.274102:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.274105:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523806 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x622c68bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.274110:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523806 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x622c68bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.274142:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635237d5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c815c expref: 379 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.274152:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431558.274154:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.274158:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635237d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c815c expref: 379 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.274167:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6bc00, rc 0)
00000100:00100000:0.0:1789431558.274197:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+378:14617:x1876351933354496:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2511us (2993us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431558.274205:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295556
00010000:00010000:0.0:1789431558.281424:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635237f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.281449:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635237f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.281458:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635237f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.281465:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.281471:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635237f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.281481:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635237f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.281507:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xe321e362 (ffff90cf11d83e00)
00010000:00010000:0.0:1789431558.281510:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.281516:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635237f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.281524:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635237f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.289536:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933355008
00000100:00100000:3.0:1789431558.289544:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933355008
00000100:00100000:3.0:1789431558.289607:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295558
00000100:00100000:3.0:1789431558.289618:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+377:14617:x1876351933355008:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.289637:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.289668:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb63523814 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8171 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.289767:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb6352381b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.289785:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb6352381b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.289798:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb6352381b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.289815:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523822 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x9fa70bab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.289830:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x9fa70bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.289837:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x9fa70bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.289912:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb6352381b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.289920:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb6352381b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.289928:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb6352381b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.289935:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce20f06c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.289940:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb6352381b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.289949:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb6352381b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.289962:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431558.289965:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.289971:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb6352381b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.289978:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb6352381b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.289992:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x9fa70bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.289998:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523822 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x9fa70bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.290004:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x9fa70bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.290008:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce20f06a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.290011:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x9fa70bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.290017:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523822 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x9fa70bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.290025:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x9fa70bab (ffff90ce2154d500)
00010000:00010000:3.0:1789431558.290029:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.290033:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523822 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x9fa70bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.290039:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523822 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x9fa70bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.290103:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb63523814 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8171 expref: 378 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.290120:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431558.290124:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.290128:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb63523814 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8171 expref: 378 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.290139:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce20f06e00, rc 0)
00000100:00100000:3.0:1789431558.306939:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.307132:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933355520
00000100:00100000:0.0:1789431558.307147:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933355520
00000100:00100000:0.0:1789431558.307237:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14324
00000100:00100000:0.0:1789431558.307250:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+378:2349:x1876351933355520:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431558.307284:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431558.307329:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb6352383e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8178 expref: 378 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.307355:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bb:0x0].0x0 (ffff90ce2d721d00)
00010000:00010000:0.0:1789431558.307361:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431558.307443:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+377:2349:x1876351933355520:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 196us (523us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431558.307452:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14324
00000100:00100000:3.0:1789431558.321241:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933355776
00000100:00100000:3.0:1789431558.321257:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933355776
00000100:00100000:0.0:1789431558.321493:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295560
00000100:00100000:0.0:1789431558.321508:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+378:14617:x1876351933355776:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.321544:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.321572:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523845 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c817f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.322011:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352384c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.322029:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb6350de7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c1801 expref: 379 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.322040:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352384c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.322112:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb6350de7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c1801 expref: 379 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.322130:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb6350de7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c1801 expref: 379 pid: 12775 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431558.322147:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894193280:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431558.322405:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf10798e40 going to sleep for 11 seconds
00000100:00100000:0.0:1789431558.328504:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933356032
00000100:00100000:0.0:1789431558.328529:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933356032
00000100:00100000:0.0:1789431558.328607:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295561
00000100:00100000:0.0:1789431558.328621:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+380:14616:x1876351933356032:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431558.328699:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431558.328738:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635237f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a7d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8163 expref: 380 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.328849:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a7d:0x0].0x0 (ffff90cf11d83a00)
00010000:00010000:0.0:1789431558.328868:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431558.328902:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63523853 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.328920:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63523853 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.328932:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63523853 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.328950:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352385a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.328957:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352385a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.328963:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352385a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.329171:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523861 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a7d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.329180:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523861 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.329187:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523861 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.330530:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894193280:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431558.330573:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352384c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.331078:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352384c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.331090:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352384c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431558.331112:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bb:0x0]: returning size 260096
00010000:00010000:3.0:1789431558.331269:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523845 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c817f expref: 380 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.331296:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352384c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c817f expref: 379 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.331305:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bb:0x0].0x0 (ffff90ce2d721d00)
00010000:00010000:3.0:1789431558.331309:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431558.331314:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf00031400, rc 0)
00000100:00100000:3.0:1789431558.331577:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+379:14617:x1876351933355776:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10070us (10546us total) trans 4295120765 rc 0/0
00000100:00100000:3.0:1789431558.331588:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295560
00000040:00080000:0.0:1789431558.332177:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1197, 64 off84864
00010000:00010000:0.0:1789431558.332243:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb6352386f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a7d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.332260:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb6352386f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a7d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.332271:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb6352386f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a7d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.332279:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb6352386f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a7d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.332284:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb6352386f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a7d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.332290:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb6352386f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a7d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.332312:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431558.332327:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523861 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.332334:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523861 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.332340:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523861 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.332347:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.332351:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523861 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.332359:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523861 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.333990:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431558.334001:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb6352386f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a7d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.334011:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6be00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431558.334015:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb6352386f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a7d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.334023:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb6352386f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a7d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.334041:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a7d:0x0].0x0 (ffff90cf3afe7f00)
00010000:00010000:3.0:1789431558.334043:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431558.334061:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb6352386f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a7d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.334067:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb6352386f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a7d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.334085:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431558.334087:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431558.334089:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431558.334178:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a7d:0x0].0x0 (ffff90cf3afe7f00)
00010000:00010000:0.0:1789431558.334181:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431558.334185:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523861 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.334191:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523861 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.334218:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63523853 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.334225:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63523853 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.334230:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63523853 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.334236:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.334239:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63523853 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.334245:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63523853 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.334254:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.334257:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.334262:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63523853 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.334268:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63523853 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431558.334279:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f984a6bd reply state 00000000981fdb60 transno 4295120766 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352385a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xe321e362 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431558.334293:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431558.334448:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+380:14616:x1876351933356032:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 5827us (6099us total) trans 4295120766 rc 0/0
00000100:00100000:0.0:1789431558.334458:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295561
00000100:00100000:0.0:1789431558.349007:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933356288
00000100:00100000:0.0:1789431558.349017:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933356288
00000100:00100000:0.0:1789431558.349108:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295562
00000100:00100000:0.0:1789431558.349119:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+380:14616:x1876351933356288:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.349138:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.349159:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523876 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8186 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349224:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352387d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349240:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352387d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349251:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352387d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349266:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523884 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349273:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349278:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349333:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352387d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349341:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352387d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349348:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352387d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349354:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6b800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.349359:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352387d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349377:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352387d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349388:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.349391:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.349395:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352387d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349401:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352387d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349413:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349419:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523884 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349425:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523884 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349430:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.349433:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523884 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349439:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523884 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349446:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x37612e21 (ffff90cf3afe7f00)
00010000:00010000:0.0:1789431558.349449:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.349451:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523884 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349457:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523884 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349487:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523876 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8186 expref: 381 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349497:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.349499:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.349502:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523876 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8186 expref: 381 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.349512:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6a800, rc 0)
00000100:00100000:0.0:1789431558.349560:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+380:14616:x1876351933356288:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 443us (637us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431558.349568:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295562
00000100:00100000:3.0:1789431558.354462:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933356416
00000100:00100000:3.0:1789431558.354480:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933356416
00000100:00100000:3.0:1789431558.354571:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295563
00000100:00100000:3.0:1789431558.354586:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+379:14616:x1876351933356416:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.354620:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.354651:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb6352388b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c818d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.354759:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523892 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.354813:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.354827:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431558.354874:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:3.0:1789431558.354878:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431558.355591:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.355637:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb6352388b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c818d expref: 381 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.355661:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c818d expref: 380 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.355671:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431558.355674:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431558.355679:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf00030e00, rc 0)
00000100:00100000:3.0:1789431558.356018:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+380:14616:x1876351933356416:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1434us (1637us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431558.356031:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295563
00000100:00100000:3.0:1789431558.369203:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933356544
00000100:00100000:3.0:1789431558.369219:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933356544
00000100:00100000:3.0:1789431558.369293:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295564
00000100:00100000:3.0:1789431558.369314:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+381:14617:x1876351933356544:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.369334:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.369357:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb63523899 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8194 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.369431:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635238a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.369445:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352384c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c817f expref: 382 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.369461:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635238a0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.369494:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352384c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c817f expref: 382 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.369506:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352384c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c817f expref: 382 pid: 5848 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.369519:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d6a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894193408:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431558.378752:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0776ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+382:14616:x1876351933356672:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 9427us (9573us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431558.378788:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12351
00000100:00100000:0.0:1789431558.379992:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933356800
00000100:00100000:0.0:1789431558.380001:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933356800
00010000:00010000:0.0:1789431558.380037:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352384c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c817f expref: 382 pid: 5848 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431558.380104:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16379
00000100:00100000:0.0:1789431558.380114:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb58850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+382:2348:x1876351933356800:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431558.380128:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431558.380135:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352384c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c817f expref: 382 pid: 5848 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.380146:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352384c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c817f expref: 382 pid: 5848 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.380166:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb6352384c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c817f expref: 382 pid: 5848 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.380181:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bb:0x0].0x0 (ffff90ce2d721d00)
00010000:00010000:0.0:1789431558.380186:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635238a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.380194:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635238a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.380201:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635238a0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.380219:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431558.380278:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb58850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+381:2348:x1876351933356800:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 165us (2437us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431558.380288:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16379
00000100:00100000:0.0:1789431558.393674:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933357312
00000100:00100000:0.0:1789431558.393679:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933357312
00000100:00100000:0.0:1789431558.393719:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295565
00000100:00100000:0.0:1789431558.393727:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+381:14616:x1876351933357312:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.393738:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.393757:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635238a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c819b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.393830:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635238ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.393845:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635238ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.393856:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635238ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.393869:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635238b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.393876:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635238b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.393882:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635238b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.393926:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635238ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.393937:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635238ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.393943:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635238ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.393949:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.393953:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635238ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.393960:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635238ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.393971:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.393974:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.393978:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635238ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.393983:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635238ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.393994:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635238b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.394000:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635238b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.394006:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635238b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.394010:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6b800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.394013:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635238b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.394018:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635238b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.394025:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x37612e21 (ffff90cf3afe7f00)
00010000:00010000:0.0:1789431558.394028:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.394031:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635238b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.394036:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635238b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x37612e21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.394116:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635238a7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c819b expref: 382 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.394129:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.394132:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:0.0:1789431558.394136:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635238a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c819b expref: 382 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.394147:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6a800, rc 0)
00000100:00100000:0.0:1789431558.394185:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+381:14616:x1876351933357312:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 458us (1293us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431558.394192:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295565
00000100:00100000:0.0:1789431558.401161:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933357440
00000100:00100000:0.0:1789431558.401171:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933357440
00000100:00100000:0.0:1789431558.401222:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933357568
00000100:00100000:0.0:1789431558.401226:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933357568
00000100:00100000:0.0:1789431558.401248:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295566
00000100:00100000:0.0:1789431558.401258:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+382:14617:x1876351933357440:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.401281:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.401303:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635238bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c81a2 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401380:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635238c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401397:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635238c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401408:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635238c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401421:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635238ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401427:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635238ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401433:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635238ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401529:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb635238d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401538:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb635238d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401560:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb635238d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431558.401594:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bb:0x0]: returning size 260096
00000004:00200000:0.0:1789431558.401598:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431558.401615:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb635238d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401626:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb635238d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401634:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635238c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401640:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635238c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401647:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635238c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401653:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6ae00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.401657:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635238c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401664:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635238c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401675:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431558.401678:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.401683:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635238c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401689:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb635238c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401706:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635238ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401713:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635238ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401718:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635238ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401723:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.401726:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635238ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401732:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635238ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401739:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x14be06ab (ffff90cf3afe7f00)
00010000:00010000:0.0:1789431558.401741:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.401744:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635238ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401749:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635238ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401789:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635238bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81a2 expref: 384 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401803:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb635238d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81a2 expref: 383 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401815:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bb:0x0].0x0 (ffff90ce2d721d00)
00010000:00010000:0.0:1789431558.401818:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431558.401820:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6be00, rc 0)
00000100:00100000:0.0:1789431558.401875:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+383:14617:x1876351933357440:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 618us (895us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431558.401882:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295566
00000100:00100000:0.0:1789431558.401901:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295567
00000100:00100000:0.0:1789431558.401909:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+382:14616:x1876351933357568:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.401918:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.401927:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb635238d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c81a9 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401959:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635238df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401969:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635238df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401977:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635238df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401989:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635238e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.401996:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635238e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.402003:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635238e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.402032:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635238df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.402040:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635238df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.402075:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635238df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.402083:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.402086:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635238df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.402093:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635238df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.402101:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.402104:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.402107:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635238df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.402114:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635238df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.402123:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635238e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.402129:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635238e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.402135:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635238e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.402142:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.402145:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635238e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.402151:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635238e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.402158:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xe7ee91d5 (ffff90cf3afe7600)
00010000:00010000:0.0:1789431558.402161:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.402163:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635238e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.402168:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635238e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.402189:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb635238d8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81a9 expref: 383 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.402199:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.402201:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.402205:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb635238d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81a9 expref: 383 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.402214:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf00031400, rc 0)
00000100:00100000:0.0:1789431558.402237:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+382:14616:x1876351933357568:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 329us (1196us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431558.402244:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295567
00000100:00100000:3.0:1789431558.409414:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.409640:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933357696
00000100:00100000:0.0:1789431558.409655:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933357696
00000100:00100000:0.0:1789431558.409732:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295568
00000100:00100000:0.0:1789431558.409745:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+382:14616:x1876351933357696:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.409799:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.409831:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635238ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c81b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.409930:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635238f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.409949:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635238f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.409963:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635238f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.409986:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635238fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.409994:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635238fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.410002:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635238fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.410117:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635238f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.410126:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635238f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.410134:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635238f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.410142:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.410147:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635238f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.410156:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635238f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.410170:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.410174:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.410179:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635238f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.410186:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635238f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.410202:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635238fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.410208:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635238fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.410214:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635238fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.410219:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.410222:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635238fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.410228:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635238fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.410241:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xcf8a5e3e (ffff90cf04a08a00)
00010000:00010000:0.0:1789431558.410243:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.410246:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635238fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.410252:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635238fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.410620:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635238ed lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81b0 expref: 383 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.410634:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.410637:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.410641:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635238ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81b0 expref: 383 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.410653:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4e00, rc 0)
00000100:00100000:0.0:1789431558.410745:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+382:14616:x1876351933357696:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1003us (1348us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431558.410754:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295568
00000100:00100000:0.0:1789431558.415716:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431558.431598:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb63523925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a7e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.431611:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb63523925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a7e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.431643:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897c00/0xd8e438fb63523917 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.431650:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897c00/0xd8e438fb63523917 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.431656:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897c00/0xd8e438fb63523917 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.431663:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f897c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431558.431667:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897c00/0xd8e438fb63523917 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.431675:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897c00/0xd8e438fb63523917 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.431684:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431558.431688:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.431692:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897c00/0xd8e438fb63523917 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.431698:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897c00/0xd8e438fb63523917 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431558.431710:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003c257349 reply state 0000000063861e40 transno 4295120768 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb6352391e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.431717:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431558.431747:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63523910 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81be expref: 385 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.431771:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb63523925 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a7e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81be expref: 384 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.431778:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a7e:0x0].0x0 (ffff90cf11d83400)
00010000:00010000:1.0:1789431558.431780:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431558.431783:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce27814e00, rc 0)
00000100:00100000:1.0:1789431558.431847:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+385:14616:x1876351933358336:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1827us (2533us total) trans 4295120768 rc 0/0
00000100:00100000:1.0:1789431558.431855:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295570
00010000:00010000:0.0:1789431558.435819:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb6352391e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.435843:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb6352391e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.435853:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb6352391e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.435861:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f897200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.435867:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb6352391e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.435876:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb6352391e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.435909:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xcf8a5e3e (ffff90cf11d83b00)
00010000:00010000:0.0:1789431558.435912:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.435917:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb6352391e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.435924:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb6352391e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.438109:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf0482b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894193536:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431558.438141:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb63523909 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431558.440932:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.441036:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933358592
00000100:00100000:3.0:1789431558.441103:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933358592
00010000:00010000:1.0:1789431558.441891:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb63523909 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.441901:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb63523909 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431558.441920:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bb:0x0]: returning size 260096
00010000:00010000:1.0:1789431558.442115:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb63523902 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81b7 expref: 384 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.442135:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb63523909 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81b7 expref: 383 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.442148:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bb:0x0].0x0 (ffff90ce2d721d00)
00010000:00010000:1.0:1789431558.442152:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431558.442154:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0f896600, rc 0)
00000100:00100000:1.0:1789431558.442185:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+383:14617:x1876351933358080:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12534us (12982us total) trans 4295120769 rc 0/0
00000100:00100000:1.0:1789431558.442193:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295569
00000100:00100000:0.0:1789431558.444500:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431558.448294:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431558.454239:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.454533:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933358720
00000100:00100000:3.0:1789431558.454543:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933358720
00000100:00100000:3.0:1789431558.454603:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295571
00000100:00100000:3.0:1789431558.454613:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+383:14617:x1876351933358720:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.454636:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.454656:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63523941 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c81cc expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.454734:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523948 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.454748:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb63523909 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81b7 expref: 384 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.454756:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523948 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.454800:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb63523909 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81b7 expref: 384 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.454814:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb63523909 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81b7 expref: 384 pid: 6797 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.454826:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d6a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894193664:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431558.454906:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3a8150c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431558.463784:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.463870:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.463974:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d6a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894193664:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431558.464000:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523948 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.464876:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.464884:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431558.464912:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bb:0x0]: returning size 260096
00000004:00200000:1.0:1789431558.464917:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431558.464930:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.464956:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63523941 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81cc expref: 385 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.464972:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81cc expref: 384 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.464980:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bb:0x0].0x0 (ffff90ce2d721d00)
00010000:00010000:1.0:1789431558.464983:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431558.464986:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce20f06a00, rc 0)
00000100:00100000:1.0:1789431558.465009:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+384:14617:x1876351933358720:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10398us (10771us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431558.465015:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295571
00000100:00100000:1.0:1789431558.472782:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933359360
00000100:00100000:1.0:1789431558.472937:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933359360
00000100:00100000:1.0:1789431558.478426:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12354
00000100:00100000:1.0:1789431558.478451:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+384:14617:x1876351933359360:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431558.479341:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+385:14617:x1876351933359360:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 899us (6921us total) trans 4295120771 rc 0/0
00000100:00100000:1.0:1789431558.479351:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12354
00000100:00100000:1.0:1789431558.482245:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431558.484104:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431558.484111:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523964 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a7e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.484117:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac43800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431558.484120:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523964 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a7e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.484126:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523964 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a7e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.484139:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a7e:0x0].0x0 (ffff90cf22651900)
00010000:00010000:0.0:1789431558.484142:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431558.484145:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523964 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a7e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.484151:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523964 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a7e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.484167:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431558.484169:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431558.484171:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431558.488412:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.489962:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933359744
00000100:00100000:0.0:1789431558.489976:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933359744
00000100:00100000:0.0:1789431558.490044:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295573
00000100:00100000:0.0:1789431558.490069:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+386:14616:x1876351933359744:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.490092:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.490112:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb6352396b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c81d3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490172:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523972 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490186:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523972 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490197:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523972 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490210:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523979 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490217:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523979 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490223:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523979 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490274:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523972 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490281:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523972 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490287:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523972 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490293:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.490297:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523972 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490304:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523972 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490314:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.490317:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.490321:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523972 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490327:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523972 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490339:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523979 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490345:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523979 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490351:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523979 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490355:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.490358:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523979 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490364:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523979 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490370:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xe7ee91d5 (ffff90cf04a08a00)
00010000:00010000:0.0:1789431558.490372:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.490374:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523979 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490380:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523979 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490405:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb6352396b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81d3 expref: 387 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490414:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.490416:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.490419:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb6352396b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81d3 expref: 387 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.490432:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4800, rc 0)
00000100:00100000:0.0:1789431558.490488:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+386:14616:x1876351933359744:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 420us (2092us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431558.490494:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295573
00010000:00010000:1.0:1789431558.493340:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43200/0xd8e438fb63523956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.493367:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43200/0xd8e438fb63523956 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.493376:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43200/0xd8e438fb63523956 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.493382:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac43200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431558.493387:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43200/0xd8e438fb63523956 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.493400:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43200/0xd8e438fb63523956 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.493424:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xcf8a5e3e (ffff90cf22651200)
00010000:00010000:1.0:1789431558.493427:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.493432:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43200/0xd8e438fb63523956 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.493438:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43200/0xd8e438fb63523956 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xcf8a5e3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.494719:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.494852:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933359872
00000100:00100000:1.0:1789431558.494869:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933359872
00000100:00100000:1.0:1789431558.494964:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295574
00000100:00100000:1.0:1789431558.494978:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+385:14617:x1876351933359872:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431558.495006:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431558.495036:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb63523980 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c81da expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495150:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897c00/0xd8e438fb63523987 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495168:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897c00/0xd8e438fb63523987 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495182:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897c00/0xd8e438fb63523987 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495200:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb6352398e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495209:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb6352398e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495216:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb6352398e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495367:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63523995 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495377:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63523995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495385:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63523995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431558.495433:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bb:0x0]: returning size 260096
00000004:00200000:1.0:1789431558.495438:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431558.495463:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63523995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495477:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63523995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495494:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897c00/0xd8e438fb63523987 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495502:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897c00/0xd8e438fb63523987 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495509:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897c00/0xd8e438fb63523987 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495521:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f897c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431558.495525:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897c00/0xd8e438fb63523987 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495534:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897c00/0xd8e438fb63523987 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495548:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431558.495552:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.495558:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897c00/0xd8e438fb63523987 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495565:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897c00/0xd8e438fb63523987 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495581:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb6352398e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495588:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb6352398e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495593:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb6352398e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495598:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f896600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431558.495601:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb6352398e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495607:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb6352398e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495618:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x14be06ab (ffff90cf11d83200)
00010000:00010000:1.0:1789431558.495621:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.495624:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb6352398e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495630:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb6352398e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495674:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb63523980 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81da expref: 387 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495688:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63523995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81da expref: 386 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.495695:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bb:0x0].0x0 (ffff90ce2d721d00)
00010000:00010000:1.0:1789431558.495697:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431558.495699:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0f897000, rc 0)
00000100:00100000:1.0:1789431558.495792:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+386:14617:x1876351933359872:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 817us (1081us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431558.495801:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295574
00000100:00100000:3.0:1789431558.498043:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.498326:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933360000
00000100:00100000:1.0:1789431558.498341:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933360000
00000100:00100000:1.0:1789431558.498426:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295575
00000100:00100000:1.0:1789431558.498439:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+386:14616:x1876351933360000:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431558.498469:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431558.498501:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb6352399c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c81e1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.498607:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635239a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.498626:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635239a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.498640:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635239a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431558.498688:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:1.0:1789431558.498692:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431558.498716:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635239a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.498745:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb6352399c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81e1 expref: 388 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.498776:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635239a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81e1 expref: 387 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.498785:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431558.498790:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431558.498794:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce20f06e00, rc 0)
00000100:00100000:1.0:1789431558.498876:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+387:14616:x1876351933360000:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 440us (848us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431558.500076:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295575
00000100:00100000:3.0:1789431558.507782:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.507876:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933360128
00000100:00100000:0.0:1789431558.507893:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933360128
00000100:00100000:0.0:1789431558.507988:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12355
00000100:00100000:0.0:1789431558.507999:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+387:14616:x1876351933360128:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431558.514180:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933360256
00000100:00100000:0.0:1789431558.514197:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933360256
00000100:00100000:0.0:1789431558.514292:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14326
00000100:00100000:0.0:1789431558.514304:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+389:2350:x1876351933360256:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431558.514319:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431558.514342:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63523995 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81da expref: 389 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.514374:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bb:0x0].0x0 (ffff90ce2d721d00)
00010000:00010000:0.0:1789431558.514378:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431558.514440:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+388:2350:x1876351933360256:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 138us (483us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431558.514448:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14326
00000100:00100000:1.0:1789431558.516710:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933360512
00000100:00100000:1.0:1789431558.516730:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933360512
00000100:00100000:1.0:1789431558.517007:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295576
00000100:00100000:1.0:1789431558.517022:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+388:14617:x1876351933360512:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431558.517080:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431558.517112:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635239aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c81e8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.517266:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635239b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.517300:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523948 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81cc expref: 388 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.517312:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635239b1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.517355:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81cc expref: 388 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.517372:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523948 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81cc expref: 388 pid: 12775 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.517389:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf04829c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894193792:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431558.517505:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3180 going to sleep for 11 seconds
00000100:00100000:0.0:1789431558.518869:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+388:14616:x1876351933360128:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 10860us (11111us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431558.518882:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12355
00000100:00100000:1.0:1789431558.522020:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf04829c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894193792:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431558.522093:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635239b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.522586:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.522842:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933360640
00000100:00100000:3.0:1789431558.522853:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933360640
00010000:00010000:3.0:1789431558.522915:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523948 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81cc expref: 388 pid: 12775 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.522968:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16382
00000100:00100000:3.0:1789431558.522980:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+388:2348:x1876351933360640:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431558.522999:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431558.523008:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523948 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81cc expref: 388 pid: 12775 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.523023:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81cc expref: 388 pid: 12775 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.523094:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63523948 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81cc expref: 388 pid: 12775 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.523118:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bb:0x0].0x0 (ffff90ce2d721d00)
00010000:00010000:3.0:1789431558.523125:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635239b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.523138:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635239b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.523147:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635239b1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.523177:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431558.523254:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+387:2348:x1876351933360640:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 275us (670us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431558.523261:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16382
00010000:00010000:1.0:1789431558.523642:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635239b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.523654:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635239b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431558.523684:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bb:0x0]: returning size 260096
00010000:00010000:1.0:1789431558.523962:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635239aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81e8 expref: 388 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.523986:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635239b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81e8 expref: 387 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.523996:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bb:0x0].0x0 (ffff90ce2d721d00)
00010000:00010000:1.0:1789431558.523999:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431558.524003:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0f896600, rc 0)
00000100:00100000:1.0:1789431558.524095:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+387:14617:x1876351933360512:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7078us (9864us total) trans 4295120773 rc 0/0
00000100:00100000:1.0:1789431558.524105:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295576
00000100:00100000:0.0:1789431558.533148:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.533262:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933360896
00000100:00100000:3.0:1789431558.533278:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933360896
00000100:00100000:3.0:1789431558.533373:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295577
00000100:00100000:3.0:1789431558.533386:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+387:14616:x1876351933360896:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.533414:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.533442:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635239bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c81ef expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533537:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb635239c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533555:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb635239c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533568:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb635239c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533585:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635239cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533593:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635239cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533605:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635239cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533681:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb635239c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533689:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb635239c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533697:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb635239c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533704:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae2e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.533708:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb635239c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533717:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb635239c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533731:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431558.533735:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.533741:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb635239c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533747:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb635239c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533776:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635239cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533782:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635239cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533790:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635239cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533796:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.533799:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635239cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533805:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635239cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533813:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xe7ee91d5 (ffff90ce2154d500)
00010000:00010000:3.0:1789431558.533826:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.533829:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635239cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533836:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb635239cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe7ee91d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.533875:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635239bf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81ef expref: 388 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.534026:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431558.534029:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:3.0:1789431558.534033:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635239bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81ef expref: 388 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.534045:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3200, rc 0)
00000100:00100000:3.0:1789431558.534253:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+387:14616:x1876351933360896:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 870us (1115us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431558.534263:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295577
00000100:00100000:0.0:1789431558.537042:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.538602:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295578
00000100:00100000:3.0:1789431558.538618:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+387:14617:x1876351933361024:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.538653:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.538683:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635239d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c81f6 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.539000:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635239db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.539021:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635239b1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81e8 expref: 388 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.539032:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635239db lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.539164:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635239b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81e8 expref: 388 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.539382:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635239b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81e8 expref: 388 pid: 5848 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.539399:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d6a9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894193920:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431558.539553:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3a815300 going to sleep for 11 seconds
00000100:00100000:3.0:1789431558.545959:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.548580:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431558.548750:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635239b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81e8 expref: 388 pid: 5848 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431558.548792:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d6a9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894193920:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431558.548825:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635239db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.548838:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635239db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.548845:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635239db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431558.548925:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bb:0x0]: returning size 260096
00000004:00200000:0.0:1789431558.548930:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431558.548958:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635239db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.549005:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635239d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81f6 expref: 388 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.549029:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635239db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81f6 expref: 387 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.549039:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bb:0x0].0x0 (ffff90ce2d721d00)
00010000:00010000:0.0:1789431558.549043:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431558.549077:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3800, rc 0)
00000100:00100000:0.0:1789431558.549143:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+387:14617:x1876351933361024:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10528us (12116us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431558.549153:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295578
00000100:00100000:0.0:1789431558.549914:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933361152
00000100:00100000:0.0:1789431558.549926:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933361152
00000100:00100000:1.0:1789431558.555927:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.560220:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.560987:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.561718:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933361792
00000100:00100000:0.0:1789431558.561735:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933361792
00000100:00100000:0.0:1789431558.561865:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933361920
00000100:00100000:0.0:1789431558.561869:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933361920
00000100:00100000:0.0:1789431558.561917:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295580
00000100:00100000:0.0:1789431558.561931:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+389:14616:x1876351933361792:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.561966:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.561970:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431558.562005:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635239a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81e1 expref: 389 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.562030:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.562037:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431558.562092:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635239f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8204 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.562251:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635239fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.562271:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635239fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.562284:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635239fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.562502:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523a05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd10cee2b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.562511:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523a05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.562519:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523a05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431558.563288:0:12775:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x501:0x0], index 1: 0
00000100:00100000:3.0:1789431558.563504:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295581
00000100:00100000:3.0:1789431558.563524:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+389:14617:x1876351933361920:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.563548:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.563570:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523a0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c820b expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.563642:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523a13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.563658:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523a13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.563671:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523a13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.563687:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523a1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.563695:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.563701:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.563791:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523a21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.563801:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.563809:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431558.563848:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bb:0x0]: returning size 260096
00000004:00200000:3.0:1789431558.563853:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431558.563876:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.563902:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.563912:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523a13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.563920:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523a13 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.563928:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523a13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.563936:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.563942:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523a13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.563951:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523a13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.563964:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431558.563968:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.563974:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523a13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.563981:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523a13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.564001:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.564008:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523a1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.564013:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.564018:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae2e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.564020:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.564025:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523a1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.564033:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x14be06ab (ffff90ce2154d500)
00010000:00010000:3.0:1789431558.564035:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.564038:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523a1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.564044:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523a1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.564122:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523a0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c820b expref: 391 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.564138:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523a21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c820b expref: 390 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.564151:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bb:0x0].0x0 (ffff90ce2d721d00)
00010000:00010000:3.0:1789431558.564153:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431558.564156:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3000, rc 0)
00000100:00100000:3.0:1789431558.564248:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+390:14617:x1876351933361920:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 732us (3266us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431558.564257:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295581
00010000:00010000:0.0:1789431558.566197:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523a28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a7f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.566223:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a7f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.566238:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a7f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.566282:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635239fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.566517:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635239fe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.566527:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635239fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.566534:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.566539:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635239fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.566549:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635239fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.566562:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.566566:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.566571:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635239fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.566577:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb635239fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431558.566595:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000562cd5be reply state 000000003a9b3c9e transno 4295120775 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523a05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431558.566606:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431558.566651:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635239f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8204 expref: 391 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.566668:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523a28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a7f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8204 expref: 390 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.566675:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a7f:0x0].0x0 (ffff90cf3afe7600)
00010000:00010000:0.0:1789431558.566678:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431558.566680:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4800, rc 0)
00000100:00100000:0.0:1789431558.566781:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+391:14616:x1876351933361792:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4853us (6577us total) trans 4295120775 rc 0/0
00000100:00100000:0.0:1789431558.566792:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295580
00000100:00100000:3.0:1789431558.569936:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.570262:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933362048
00000100:00100000:1.0:1789431558.570276:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933362048
00000100:00100000:1.0:1789431558.570384:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14327
00000100:00100000:1.0:1789431558.570397:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb59450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+391:2350:x1876351933362048:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431558.570418:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431558.570453:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523a21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c820b expref: 391 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.570486:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bb:0x0].0x0 (ffff90ce2d721d00)
00010000:00010000:1.0:1789431558.570493:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431558.571616:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb59450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+390:2350:x1876351933362048:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1207us (1683us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431558.571632:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14327
00010000:00010000:1.0:1789431558.572334:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523a05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.572352:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523a05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.572361:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523a05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.572369:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431558.572375:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523a05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.572385:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523a05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.572405:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xd10cee2b (ffff90cf04a08a00)
00010000:00010000:1.0:1789431558.572409:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.572416:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523a05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.572422:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523a05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.574510:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.574714:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933362304
00000100:00100000:0.0:1789431558.574726:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933362304
00000100:00100000:0.0:1789431558.574867:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295582
00000100:00100000:0.0:1789431558.575947:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+389:14617:x1876351933362304:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.575996:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.576034:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523a36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8212 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.576206:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523a3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.576227:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635239db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81f6 expref: 390 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.576238:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523a3d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.576282:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635239db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81f6 expref: 390 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.576747:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635239db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81f6 expref: 390 pid: 12181 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431558.576851:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894194048:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431558.577663:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf18a0bb40 going to sleep for 11 seconds
00000100:00100000:0.0:1789431558.578564:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.579380:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933362432
00000100:00100000:1.0:1789431558.579395:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933362432
00000100:00100000:1.0:1789431558.579470:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8161
00000100:00100000:1.0:1789431558.579483:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+107:2348:x1876351933362432:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431558.579506:0:14471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431558.579535:0:14471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000213bdec2/0xd8e438fb63523a44 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8219 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789431558.579571:0:14471:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x501:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:1.0:1789431558.579597:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x501:0x0].0x0 since=3016s v=(0 0)
00010000:00010000:1.0:1789431558.579602:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x501:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431558.579613:0:14471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000213bdec2/0xd8e438fb63523a44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8219 expref: 108 pid: 14471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.579636:0:14471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000213bdec2/0xd8e438fb63523a44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8219 expref: 108 pid: 14471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.579653:0:14471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0e613600, rc 0)
00000100:00100000:1.0:1789431558.579723:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+108:2348:x1876351933362432:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 243us (1167us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431558.579731:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8161
00000100:00100000:0.0:1789431558.584569:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.584639:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894194048:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431558.584679:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523a3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.584696:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933362560
00000100:00100000:1.0:1789431558.584708:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933362560
00010000:00010000:1.0:1789431558.584756:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635239db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81f6 expref: 391 pid: 12181 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.584820:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16384
00000100:00100000:1.0:1789431558.584831:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+391:2347:x1876351933362560:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431558.584855:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431558.584864:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635239db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81f6 expref: 391 pid: 12181 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.584879:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635239db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81f6 expref: 391 pid: 12181 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.584997:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635239db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81f6 expref: 391 pid: 12181 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.585017:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bb:0x0].0x0 (ffff90ce2d721d00)
00010000:00010000:1.0:1789431558.585023:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523a3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.585036:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523a3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.585045:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523a3d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.586806:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431558.586859:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523a3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.586871:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523a3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431558.586901:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bb:0x0]: returning size 260096
00000100:00100000:1.0:1789431558.587039:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+391:2347:x1876351933362560:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 2204us (2482us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431558.587071:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16384
00010000:00010000:3.0:1789431558.587143:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523a36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8212 expref: 391 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.587167:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523a3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8212 expref: 390 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.587176:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bb:0x0].0x0 (ffff90ce2d721d00)
00010000:00010000:3.0:1789431558.587180:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431558.587184:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf00031400, rc 0)
00000100:00100000:3.0:1789431558.587219:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+390:14617:x1876351933362304:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12338us (12718us total) trans 4295120776 rc 0/0
00000100:00100000:3.0:1789431558.587226:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295582
00000100:00100000:3.0:1789431558.589413:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.604277:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933363072
00000100:00100000:3.0:1789431558.604304:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933363072
00000100:00100000:0.0:1789431558.607010:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431558.608821:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431558.608830:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523a67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a7f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.608839:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431558.608843:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523a67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a7f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.608851:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523a67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a7f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.608861:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a7f:0x0].0x0 (ffff90cf22651900)
00010000:00010000:3.0:1789431558.608863:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431558.608867:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523a67 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a7f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.608872:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523a67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a7f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.608902:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431558.608904:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431558.608906:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431558.616324:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.616343:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523a59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.616352:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523a59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.616359:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac43c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.616381:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523a59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.616391:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523a59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.616406:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295584
00010000:00010000:0.0:1789431558.616412:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xd10cee2b (ffff90cf22651200)
00010000:00010000:0.0:1789431558.616417:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.616423:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523a59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.616425:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+392:14617:x1876351933363200:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.616438:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523a59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd10cee2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.616465:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431558.616490:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523a6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8220 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.616680:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523a75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.616696:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523a3d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8212 expref: 392 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.616706:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523a75 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.616747:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523a3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8212 expref: 392 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.616772:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523a3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8212 expref: 392 pid: 12181 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.616787:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf04829c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894194176:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431558.617031:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3780 going to sleep for 11 seconds
00000100:00100000:0.0:1789431558.620999:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.621246:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933363328
00000100:00100000:1.0:1789431558.621260:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933363328
00000100:00100000:1.0:1789431558.621334:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295585
00000100:00100000:1.0:1789431558.621350:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+393:14616:x1876351933363328:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431558.621385:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431558.621415:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523a7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8227 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.621499:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523a83 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.621516:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523a83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.621529:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523a83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.621548:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523a8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.621555:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.621561:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.622113:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523a83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.622127:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523a83 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.622135:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523a83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.622141:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431558.622146:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523a83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.622155:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523a83 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.622171:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431558.622174:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.622180:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523a83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.622187:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523a83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.622202:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.622208:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523a8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.622213:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523a8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.622218:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf42157200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431558.622220:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523a8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.622226:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523a8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.622233:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x22737f46 (ffff90cf11d83600)
00010000:00010000:1.0:1789431558.622236:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.622239:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523a8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.622245:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523a8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.622290:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523a7c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8227 expref: 394 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.622301:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431558.622303:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.622306:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523a7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8227 expref: 394 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.622315:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4e00, rc 0)
00000100:00100000:1.0:1789431558.622401:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+393:14616:x1876351933363328:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1055us (1415us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431558.622409:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295585
00000100:00100000:0.0:1789431558.627236:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933363456
00000100:00100000:0.0:1789431558.627261:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933363456
00010000:00010000:0.0:1789431558.627329:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523a3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8212 expref: 393 pid: 12181 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431558.627381:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16385
00000100:00100000:0.0:1789431558.627393:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+393:2348:x1876351933363456:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431558.627413:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431558.627420:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523a3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8212 expref: 393 pid: 12181 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.627434:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523a3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8212 expref: 393 pid: 12181 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.627463:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523a3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100bb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8212 expref: 393 pid: 12181 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.627484:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bb:0x0].0x0 (ffff90ce2d721d00)
00010000:00010000:0.0:1789431558.627491:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523a75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.627502:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.627513:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523a75 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.627558:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431558.627632:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431558.627635:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+392:2348:x1876351933363456:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 243us (780us total) trans 0 rc 0/0
00010000:00010000:1.0:1789431558.627652:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431558.627653:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16385
00000004:00200000:1.0:1789431558.627716:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bb:0x0]: returning size 260096
00000004:00200000:1.0:1789431558.627722:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431558.627749:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.627806:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523a6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8220 expref: 392 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.627832:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5e00/0xd8e438fb63523a75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8220 expref: 391 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.627840:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bb:0x0].0x0 (ffff90ce2d721d00)
00010000:00010000:1.0:1789431558.627852:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431558.627855:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd5e00, rc 0)
00000100:00100000:3.0:1789431558.627983:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.628609:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933363584
00000100:00100000:0.0:1789431558.628619:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933363584
00000100:00100000:0.0:1789431558.628666:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295586
00000100:00100000:0.0:1789431558.628676:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+392:14616:x1876351933363584:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.628701:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.628722:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63523a91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c822e expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.628810:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63523a98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.628827:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63523a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.628839:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63523a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431558.629770:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:0.0:1789431558.629775:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431558.629802:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63523a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.629841:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63523a91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c822e expref: 394 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.630414:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63523a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c822e expref: 393 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.630424:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.630473:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431558.630478:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a000, rc 0)
00000100:00100000:0.0:1789431558.630943:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+393:14616:x1876351933363584:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2265us (2957us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431558.630965:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295586
00000100:00100000:1.0:1789431558.631121:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+392:14617:x1876351933363200:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 14700us (24111us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431558.631129:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295584
00000100:00100000:0.0:1789431558.638195:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933363712
00000100:00100000:0.0:1789431558.638211:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933363712
00000100:00100000:0.0:1789431558.638300:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295587
00000100:00100000:0.0:1789431558.638313:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+392:14617:x1876351933363712:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.638344:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.638376:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523a9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8235 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638464:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523aa6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638483:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638496:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638514:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523aad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638521:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638528:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638772:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638786:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523aa6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638794:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638801:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.638807:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638815:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523aa6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638830:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431558.638833:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.638839:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523aa6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638845:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523aa6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638861:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638867:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523aad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638874:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638878:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.638882:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638888:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523aad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638895:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x7b807097 (ffff90cf3afe7f00)
00010000:00010000:0.0:1789431558.638897:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.638900:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523aad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638906:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523aad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638947:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523a9f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8235 expref: 393 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638958:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431558.638960:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.638964:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523a9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8235 expref: 393 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.638974:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6be00, rc 0)
00000100:00100000:0.0:1789431558.639084:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+392:14617:x1876351933363712:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 772us (1421us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431558.639093:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295587
00000100:00100000:3.0:1789431558.639187:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.639273:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933363840
00000100:00100000:1.0:1789431558.639281:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933363840
00000100:00100000:1.0:1789431558.639336:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12358
00000100:00100000:1.0:1789431558.639348:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+392:14616:x1876351933363840:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431558.644409:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+392:14616:x1876351933363840:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 5048us (5207us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431558.644427:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12358
00000100:00100000:3.0:1789431558.652026:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.652114:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933364096
00000100:00100000:1.0:1789431558.652130:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933364096
00000100:00100000:1.0:1789431558.652214:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295588
00000100:00100000:1.0:1789431558.652227:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+392:14617:x1876351933364096:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431558.652258:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431558.652262:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:1.0:1789431558.652298:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523765 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8132 expref: 392 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.652327:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431558.652334:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431558.652351:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523ab4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c823c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.652502:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523abb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.652520:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523abb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.652532:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523abb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.652550:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523ac2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.652559:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523ac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.652566:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523ac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:1.0:1789431558.655400:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x502:0x0], index 0: 0
00010000:00010000:1.0:1789431558.656875:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523ac9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a80:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.656896:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a80:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.656914:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a80:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.656955:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523abb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.656962:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523abb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.657153:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523abb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.657159:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431558.657164:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523abb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.657172:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523abb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.657185:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431558.657188:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.657193:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523abb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.657199:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523abb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431558.657215:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000084071cce reply state 00000000c50f25be transno 4295120779 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523ac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.657226:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431558.657264:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523ab4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c823c expref: 394 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.657281:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a80:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c823c expref: 393 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.657288:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a80:0x0].0x0 (ffff90cf11d83d00)
00010000:00010000:1.0:1789431558.657290:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431558.657293:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4800, rc 0)
00000100:00100000:1.0:1789431558.657872:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+394:14617:x1876351933364096:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 5645us (5865us total) trans 4295120779 rc 0/0
00000100:00100000:1.0:1789431558.657881:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295588
00000100:00100000:3.0:1789431558.661126:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933364224
00000100:00100000:3.0:1789431558.661144:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933364224
00000100:00100000:3.0:1789431558.661231:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295589
00000100:00100000:3.0:1789431558.661244:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+394:14616:x1876351933364224:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.661275:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.661317:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63523ad7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8243 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.661416:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb63523ade lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.661437:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb63523ade lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.661452:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb63523ade lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.661473:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523ae5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.661481:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.661488:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.661576:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb63523ade lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.661598:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb63523ade lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.662140:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb63523ade lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.662151:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce20f06e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.662156:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb63523ade lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.662166:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb63523ade lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.662182:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431558.662185:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.662192:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb63523ade lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.662198:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb63523ade lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.662218:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.662225:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523ae5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.662231:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.662235:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00031400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.662239:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.662244:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.662251:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x22737f46 (ffff90ce2154d500)
00010000:00010000:3.0:1789431558.662254:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.662257:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523ae5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.662263:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523ae5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.663083:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63523ad7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8243 expref: 395 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.663102:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431558.663106:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.663111:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63523ad7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8243 expref: 395 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.663127:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce20f06c00, rc 0)
00010000:00010000:1.0:1789431558.667872:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523ac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.667891:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523ac2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.667900:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523ac2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.667907:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431558.667912:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523ac2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.667921:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523ac2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.667940:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x7b807097 (ffff90cf11d83600)
00010000:00010000:1.0:1789431558.667943:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.667949:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523ac2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.667956:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63523ac2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431558.671786:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.671968:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933364480
00000100:00100000:3.0:1789431558.671981:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933364480
00000100:00100000:3.0:1789431558.672100:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295590
00000100:00100000:3.0:1789431558.672112:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+393:14616:x1876351933364480:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.672147:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.672151:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431558.672193:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63523a98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c822e expref: 393 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.672221:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431558.672226:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431558.672243:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523aec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c824a expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.672395:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523af3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.672412:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523af3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.672423:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523af3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.672439:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523afa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.672446:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523afa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.672452:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523afa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.680951:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933364608
00000100:00100000:1.0:1789431558.680975:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933364608
00010000:00010000:0.0:1789431558.681029:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523afa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.681085:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8162
00010000:00010000:0.0:1789431558.681095:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523afa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.681109:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+112:2348:x1876351933364608:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.681117:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523afa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.681127:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431558.681131:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.681134:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523afa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.681146:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523afa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.681156:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055378d58/0xd8e438fb63523b0f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8251 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.681171:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x22737f46 (ffff90ce2154d400)
00010000:00010000:0.0:1789431558.681176:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.681183:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523afa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789431558.681187:0:14497:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x502:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431558.681191:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523afa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.681213:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x502:0x0].0x0 since=3016s v=(0 0)
00010000:00010000:1.0:1789431558.681221:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x502:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431558.681232:0:14497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055378d58/0xd8e438fb63523b0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8251 expref: 113 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.681250:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055378d58/0xd8e438fb63523b0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8251 expref: 113 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.681263:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4e00, rc 0)
00000100:00100000:1.0:1789431558.681336:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+113:2348:x1876351933364608:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 237us (482us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431558.681344:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8162
00000100:00100000:0.0:1789431558.694040:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.700357:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933364992
00000100:00100000:3.0:1789431558.700372:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933364992
00000100:00100000:3.0:1789431558.702574:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12359
00000100:00100000:3.0:1789431558.702609:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+394:14617:x1876351933364992:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431558.703775:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+395:14617:x1876351933364992:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 1168us (3643us total) trans 4295120781 rc 0/0
00000100:00100000:3.0:1789431558.703788:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12359
00000100:00100000:0.0:1789431558.704082:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.716459:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.716601:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.716690:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933365760
00000100:00100000:3.0:1789431558.716697:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933365760
00000100:00100000:3.0:1789431558.716748:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295591
00000100:00100000:3.0:1789431558.716770:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+397:14616:x1876351933365760:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431558.716832:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431558.716866:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523b01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a81:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c824a expref: 397 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.716890:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a81:0x0].0x0 (ffff90cf22651900)
00010000:00010000:3.0:1789431558.716906:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431558.716935:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523b1d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.716954:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523b1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.716967:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523b1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.716986:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523b24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.716994:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.717001:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.717178:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523b2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a81:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.717188:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523b2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.717196:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523b2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431558.717809:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1199, 64 off84992
00010000:00010000:3.0:1789431558.717867:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523b32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a81:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.717879:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523b32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.717888:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523b32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.717898:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523b32 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.717906:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523b32 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.717913:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523b32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.717943:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431558.717960:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523b2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a81:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.717972:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523b2b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a81:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.717980:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523b2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a81:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.717986:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.717992:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523b2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a81:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.718001:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523b2b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a81:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.718011:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a81:0x0].0x0 (ffff90ce2154d300)
00010000:00010000:3.0:1789431558.718015:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431558.718020:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523b2b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a81:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.718027:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523b2b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a81:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.718089:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523b1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.718102:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523b1d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.718113:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523b1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.718124:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.718131:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523b1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.718146:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523b1d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.718166:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431558.718170:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.718174:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523b1d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.718186:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523b1d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431558.718203:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007d1280df reply state 000000009071601e transno 4295120784 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.718214:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431558.723317:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431558.727722:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.727744:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523b24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.727753:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523b24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.727770:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae2e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.727784:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523b24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.727799:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523b24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.727819:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x22737f46 (ffff90ce2154d500)
00010000:00010000:3.0:1789431558.727823:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.727829:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523b24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.727836:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523b24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.728800:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.729179:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933366144
00000100:00100000:0.0:1789431558.729193:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933366144
00000100:00100000:0.0:1789431558.729264:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295593
00000100:00100000:0.0:1789431558.729277:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+397:14616:x1876351933366144:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.729319:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.729349:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523b4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c825f expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729435:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729455:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729469:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729485:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729493:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729500:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729575:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729582:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729589:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729595:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.729599:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729610:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729622:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.729625:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.729629:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729634:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729649:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729655:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729660:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729665:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6b800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.729668:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729674:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729682:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x22737f46 (ffff90cf3afe7f00)
00010000:00010000:0.0:1789431558.729684:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.729687:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729694:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729730:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523b4e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c825f expref: 398 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729741:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.729743:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.729747:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523b4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c825f expref: 398 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.729767:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6ae00, rc 0)
00000100:00100000:0.0:1789431558.729859:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+397:14616:x1876351933366144:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 584us (1068us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431558.729868:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295593
00010000:00010000:1.0:1789431558.731813:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431558.731824:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523b63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a80:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.731839:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac43c00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431558.731845:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523b63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a80:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.731859:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523b63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a80:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.731877:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a80:0x0].0x0 (ffff90cf0240cc00)
00010000:00010000:1.0:1789431558.731884:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431558.731888:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523b63 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a80:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.731902:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523b63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a80:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.731927:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431558.731931:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431558.731933:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431558.736911:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431558.737211:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43600/0xd8e438fb63523b40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.737229:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43600/0xd8e438fb63523b40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.737238:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43600/0xd8e438fb63523b40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.737245:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac43600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.737252:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43600/0xd8e438fb63523b40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.737267:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43600/0xd8e438fb63523b40 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.737297:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x7b807097 (ffff90cf08772400)
00010000:00010000:0.0:1789431558.737301:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.737307:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43600/0xd8e438fb63523b40 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.737314:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43600/0xd8e438fb63523b40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.737654:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933366272
00000100:00100000:1.0:1789431558.737671:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933366272
00000100:00100000:1.0:1789431558.737746:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295594
00000100:00100000:1.0:1789431558.737769:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+397:14616:x1876351933366272:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431558.737807:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431558.737831:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523b6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8266 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.737922:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb63523b71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.737939:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb63523b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.737950:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb63523b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431558.737997:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:1.0:1789431558.738001:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431558.738026:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb63523b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.738080:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523b6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8266 expref: 399 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.738099:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb63523b71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8266 expref: 398 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.738107:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431558.738110:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431558.738113:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b506200, rc 0)
00000100:00100000:1.0:1789431558.738202:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+398:14616:x1876351933366272:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 445us (1304us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431558.738210:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295594
00000100:00100000:1.0:1789431558.743552:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.743610:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.743680:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933366528
00000100:00100000:0.0:1789431558.743696:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933366528
00000100:00100000:0.0:1789431558.743791:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295595
00000100:00100000:0.0:1789431558.743804:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+398:14617:x1876351933366528:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.743838:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.743870:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523b78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c826d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.743959:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b7f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.743979:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.743994:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744011:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744019:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744026:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744145:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744154:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b7f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744162:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744181:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6b800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.744187:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744195:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744210:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431558.744213:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.744219:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744227:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523b7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744241:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744248:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744255:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744261:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.744264:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744271:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744278:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x6ed7d01b (ffff90cf3afe7f00)
00010000:00010000:0.0:1789431558.744296:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.744300:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744307:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523b86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744346:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523b78 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c826d expref: 399 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744358:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431558.744360:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.744364:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523b78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c826d expref: 399 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.744379:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6ae00, rc 0)
00000100:00100000:0.0:1789431558.744461:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+398:14617:x1876351933366528:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 660us (849us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431558.744470:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295595
00000100:00100000:3.0:1789431558.744787:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933366400
00000100:00100000:3.0:1789431558.744795:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933366400
00000100:00100000:3.0:1789431558.744846:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12362
00000100:00100000:3.0:1789431558.744856:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0776bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+398:14616:x1876351933366400:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431558.750468:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.752558:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933366656
00000100:00100000:3.0:1789431558.752570:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933366656
00000100:00100000:3.0:1789431558.752766:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295596
00000100:00100000:3.0:1789431558.752780:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+398:14617:x1876351933366656:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.752807:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.752836:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523b8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8274 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.752929:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523b94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.752954:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.752969:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431558.753017:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:3.0:1789431558.753021:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431558.753040:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.753147:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae2e00/0xd8e438fb63523b8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8274 expref: 400 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.753225:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523b94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8274 expref: 399 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.753236:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431558.753239:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431558.753245:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3200, rc 0)
00000100:00100000:3.0:1789431558.753372:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+399:14617:x1876351933366656:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 594us (2917us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431558.753380:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295596
00000100:00100000:0.0:1789431558.765627:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933367040
00000100:00100000:0.0:1789431558.765642:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933367040
00000100:00100000:1.0:1789431558.765647:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933366784
00000100:00100000:1.0:1789431558.765655:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933366784
00000100:00100000:1.0:1789431558.765728:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12363
00000100:00100000:0.0:1789431558.765730:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295597
00000100:00100000:1.0:1789431558.765746:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+400:14617:x1876351933366784:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431558.765747:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+400:14616:x1876351933367040:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.765791:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.765824:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523b9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c827b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.765937:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523ba2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.765958:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.765973:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.765991:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523ba9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.765999:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.766006:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.766134:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.766143:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523ba2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.766150:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.766157:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.766162:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.766171:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523ba2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.766186:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.766189:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.766195:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523ba2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.766202:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523ba2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.766218:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.766224:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.766230:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.766236:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6b800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.766239:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.766246:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.766254:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x22737f46 (ffff90cf3afe7f00)
00010000:00010000:0.0:1789431558.766257:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.766260:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523ba9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.766266:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523ba9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.766305:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523b9b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c827b expref: 401 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.766317:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.766319:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:0.0:1789431558.766323:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523b9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c827b expref: 401 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.766333:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6ae00, rc 0)
00000100:00100000:0.0:1789431558.766411:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+400:14616:x1876351933367040:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 669us (880us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431558.766420:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295597
00000100:00100000:1.0:1789431558.769920:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+399:14617:x1876351933366784:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 4160us (4446us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431558.769941:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12363
00000100:00100000:0.0:1789431558.773853:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.774011:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933367296
00000100:00100000:1.0:1789431558.774026:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933367296
00000100:00100000:1.0:1789431558.774142:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295598
00000100:00100000:1.0:1789431558.774154:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+399:14616:x1876351933367296:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431558.774183:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431558.774187:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:1.0:1789431558.774223:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb63523b71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8266 expref: 399 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.774247:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431558.774253:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431558.774272:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523bb0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8282 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.774430:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523bb7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.774447:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523bb7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.774463:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523bb7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.774480:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bbe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.774488:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.774495:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:1.0:1789431558.775541:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x503:0x0], index 0: 0
00010000:00010000:1.0:1789431558.776250:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63523bc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.776272:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63523bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a82:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.776285:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63523bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a82:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.776333:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523bb7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.776342:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523bb7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.776351:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523bb7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.776362:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e74200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431558.776367:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523bb7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.776375:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523bb7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.776390:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431558.776393:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.776399:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523bb7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.776406:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523bb7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431558.776421:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000797c3a1b reply state 000000005ac9c816 transno 4295120786 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.776430:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431558.776474:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523bb0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8282 expref: 401 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.776492:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63523bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a82:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8282 expref: 400 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.776500:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a82:0x0].0x0 (ffff90cf11d83400)
00010000:00010000:1.0:1789431558.776503:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431558.776506:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b274400, rc 0)
00000100:00100000:1.0:1789431558.777500:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+401:14616:x1876351933367296:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3338us (3650us total) trans 4295120786 rc 0/0
00000100:00100000:1.0:1789431558.777513:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295598
00000100:00100000:0.0:1789431558.783602:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933367552
00000100:00100000:0.0:1789431558.783820:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933367552
00000100:00100000:0.0:1789431558.784215:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295599
00000100:00100000:0.0:1789431558.784229:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+401:14617:x1876351933367552:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.784260:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.784293:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523bd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8289 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.784398:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523bda lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.784419:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523bda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.784434:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523bda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.784453:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523be1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.784460:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.784468:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.784540:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523bda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.784549:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523bda lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.784561:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523bda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.784568:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6b800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.784573:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523bda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.784583:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523bda lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.784597:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431558.784601:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.784607:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523bda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.785046:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523bda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.785081:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.785087:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523be1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.785094:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523be1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.785110:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.785113:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523be1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.785125:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523be1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.785134:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x6ed7d01b (ffff90cf3afe7f00)
00010000:00010000:0.0:1789431558.785137:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.785140:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523be1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.785146:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523be1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.785193:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523bd3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8289 expref: 402 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.785205:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431558.785208:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:0.0:1789431558.785212:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523bd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8289 expref: 402 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.785223:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6ae00, rc 0)
00000100:00100000:0.0:1789431558.785301:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+401:14617:x1876351933367552:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1074us (1841us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431558.785309:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295599
00010000:00010000:3.0:1789431558.790740:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.790785:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bbe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.790801:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.790808:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b507800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.790814:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.790825:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bbe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.790848:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x22737f46 (ffff90cf11d83d00)
00010000:00010000:3.0:1789431558.790851:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.790857:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bbe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.790864:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bbe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.804862:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933367680
00000100:00100000:3.0:1789431558.804880:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933367680
00000100:00100000:3.0:1789431558.804968:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8164
00000100:00100000:3.0:1789431558.804981:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+113:2347:x1876351933367680:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.805006:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.805036:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf2f1417/0xd8e438fb63523be8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8290 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431558.805098:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x503:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431558.805125:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x503:0x0].0x0 since=3016s v=(0 0)
00010000:00010000:3.0:1789431558.805132:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x503:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431558.805144:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf2f1417/0xd8e438fb63523be8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8290 expref: 114 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.805167:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cf2f1417/0xd8e438fb63523be8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8290 expref: 114 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.805184:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3600, rc 0)
00000100:00100000:3.0:1789431558.805278:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+114:2347:x1876351933367680:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 300us (853us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431558.805285:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8164
00000100:00100000:0.0:1789431558.806959:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.807095:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933367808
00000100:00100000:1.0:1789431558.807108:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933367808
00000100:00100000:1.0:1789431558.807177:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295600
00000100:00100000:1.0:1789431558.807189:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+400:14617:x1876351933367808:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431558.807219:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431558.807247:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523bef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8297 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.807345:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523bf6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.807364:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.807378:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.807403:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.807411:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.807418:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.807492:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.807506:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523bf6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.807513:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.807519:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e74a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431558.807525:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.807533:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523bf6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.807547:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431558.807550:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.807557:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523bf6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.807564:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523bf6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.807583:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.807589:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.807596:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.807601:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b507800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431558.807604:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.808540:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.808557:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x7b807097 (ffff90cf11d83b00)
00010000:00010000:1.0:1789431558.808561:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.808566:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.808572:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523bfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.808659:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523bef lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8297 expref: 401 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.808671:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431558.808674:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.808678:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523bef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8297 expref: 401 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.808692:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37e74200, rc 0)
00000100:00100000:1.0:1789431558.809941:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+400:14617:x1876351933367808:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2744us (2982us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431558.809955:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295600
00000100:00100000:1.0:1789431558.812495:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.812603:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933367936
00000100:00100000:3.0:1789431558.812631:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933367936
00000100:00100000:3.0:1789431558.812714:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8165
00000100:00100000:3.0:1789431558.812728:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+114:14616:x1876351933367936:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.812754:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.812992:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de873613/0xd8e438fb63523c04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c829e expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.813041:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf2f1417/0xd8e438fb63523be8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8290 expref: 115 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.813091:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x503:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431558.813096:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x503:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431558.813102:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de873613/0xd8e438fb63523c04 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c829e expref: 115 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.813155:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cf2f1417/0xd8e438fb63523be8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8290 expref: 115 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.813173:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cf2f1417/0xd8e438fb63523be8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8290 expref: 115 pid: 6698 timeout: 3116 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.813190:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b2c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1876351894194304:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431558.813333:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3a8150c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431558.816844:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b2c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1876351894194304:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431558.816897:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000de873613/0xd8e438fb63523c04 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c829e expref: 115 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.816924:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae2e00, rc 0)
00000100:00100000:3.0:1789431558.817008:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+115:14616:x1876351933367936:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4283us (4527us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431558.817019:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8165
00000100:00100000:1.0:1789431558.819594:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.827541:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933368320
00000100:00100000:0.0:1789431558.827557:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933368320
00000100:00100000:0.0:1789431558.827648:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295601
00000100:00100000:0.0:1789431558.827659:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+400:14617:x1876351933368320:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.827697:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.827701:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431558.827734:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523b94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8274 expref: 400 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.827764:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431558.827770:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431558.827889:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523c0b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c82a5 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.828039:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523c12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.828094:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523c12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.828106:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523c12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.828122:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523c19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.828130:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.828136:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431558.829151:0:6797:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x503:0x0], index 1: 0
00000100:00100000:1.0:1789431558.829546:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d509880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5832:1876351894194432:192.168.203.4@tcp:105:
00010000:00010000:1.0:1789431558.829581:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431558.829838:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523c20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a83:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.829859:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a83:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.829874:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a83:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.829923:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523c12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.829933:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523c12 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.829941:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523c12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.829948:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.829954:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523c12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.829963:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523c12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.829978:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431558.829981:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.829987:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523c12 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.829994:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523c12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431558.830010:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fb3e5714 reply state 00000000bed85495 transno 4295120787 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431558.830021:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431558.830087:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523c0b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82a5 expref: 402 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.830105:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523c20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a83:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82a5 expref: 401 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.830114:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a83:0x0].0x0 (ffff90cf3afe7600)
00010000:00010000:0.0:1789431558.830117:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431558.830119:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6aa00, rc 0)
00000100:00100000:0.0:1789431558.830204:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+402:14617:x1876351933368320:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2545us (2955us total) trans 4295120787 rc 0/0
00000100:00100000:0.0:1789431558.830214:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295601
00010000:00010000:0.0:1789431558.835905:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.835928:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523c19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.835938:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523c19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.835946:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6b800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.835953:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523c19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.835963:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523c19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.835990:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x7b807097 (ffff90cf3afe7f00)
00010000:00010000:0.0:1789431558.835994:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.836000:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523c19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.836007:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523c19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431558.837254:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.837584:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933368448
00000100:00100000:1.0:1789431558.837598:0:14502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933368448
00000100:00100000:1.0:1789431558.837681:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8166
00000100:00100000:1.0:1789431558.837694:0:14502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+109:2350:x1876351933368448:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431558.837720:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431558.837746:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5e11983/0xd8e438fb63523c2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c82ac expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789431558.837801:0:14502:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x503:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:1.0:1789431558.837828:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x503:0x0].0x0 since=3016s v=(0 0)
00010000:00010000:1.0:1789431558.837833:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x503:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431558.837845:0:14502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5e11983/0xd8e438fb63523c2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82ac expref: 110 pid: 14502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.837866:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d5e11983/0xd8e438fb63523c2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82ac expref: 110 pid: 14502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.837883:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b506200, rc 0)
00000100:00100000:1.0:1789431558.837967:0:14502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+110:2350:x1876351933368448:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 276us (724us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431558.837976:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8166
00000100:00100000:0.0:1789431558.848226:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933368704
00000100:00100000:0.0:1789431558.848251:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933368704
00000100:00100000:0.0:1789431558.848425:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12364
00000100:00100000:0.0:1789431558.848439:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+401:14617:x1876351933368704:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431558.849008:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+402:14617:x1876351933368704:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 570us (3779us total) trans 4295120788 rc 0/0
00000100:00100000:0.0:1789431558.849019:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12364
00000100:00100000:3.0:1789431558.855230:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.855882:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12365
00000100:00100000:1.0:1789431558.855901:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+402:14616:x1876351933368960:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431558.857681:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+403:14616:x1876351933368960:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 1775us (2459us total) trans 4295120789 rc 0/0
00000100:00100000:1.0:1789431558.857696:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12365
00000100:00100000:1.0:1789431558.862793:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431558.868175:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523c3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.868191:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523c3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.868200:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523c3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.868207:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac43800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431558.868213:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523c3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.868222:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523c3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.868242:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x7b807097 (ffff90cf0240ca00)
00010000:00010000:1.0:1789431558.868246:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.868251:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523c3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.868258:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523c3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.868475:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933369344
00000100:00100000:3.0:1789431558.868488:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933369344
00000100:00100000:3.0:1789431558.868560:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295603
00000100:00100000:3.0:1789431558.868573:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+403:14616:x1876351933369344:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.868601:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.868623:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523c51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c82b3 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868711:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523c58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868728:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523c58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868740:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523c58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868777:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523c5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x9aad1cc4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868786:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x9aad1cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868792:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x9aad1cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868863:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523c58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868870:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523c58 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868877:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523c58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868882:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.868885:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523c58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868896:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523c58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868905:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431558.868907:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.868911:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523c58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868916:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523c58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868927:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x9aad1cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868933:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523c5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x9aad1cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868939:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x9aad1cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868944:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.868947:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x9aad1cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868952:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523c5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x9aad1cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868958:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x9aad1cc4 (ffff90ce2154da00)
00010000:00010000:3.0:1789431558.868961:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.868963:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523c5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x9aad1cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.868970:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3600/0xd8e438fb63523c5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x9aad1cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.869003:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523c51 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82b3 expref: 404 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.869013:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431558.869016:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.869019:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523c51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82b3 expref: 404 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.869028:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3800, rc 0)
00000100:00100000:3.0:1789431558.869128:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+403:14616:x1876351933369344:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 557us (1133us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431558.869135:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295603
00000100:00100000:3.0:1789431558.871239:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431558.872977:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431558.872991:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523c4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a83:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.873002:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431558.873005:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523c4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a83:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.873014:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523c4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a83:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.873030:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a83:0x0].0x0 (ffff90cf0240cb00)
00010000:00010000:0.0:1789431558.873034:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431558.873039:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523c4a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a83:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.873072:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523c4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a83:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.873097:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431558.873100:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431558.873102:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431558.874304:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.874492:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933369600
00000100:00100000:0.0:1789431558.874504:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933369600
00000100:00100000:0.0:1789431558.874579:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295605
00000100:00100000:0.0:1789431558.874593:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+403:14616:x1876351933369600:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.874620:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.874646:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523c7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c82c1 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.874726:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523c82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.874744:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.874770:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431558.874830:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:0.0:1789431558.874834:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431558.874857:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.874891:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523c7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82c1 expref: 405 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.874910:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523c82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82c1 expref: 404 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.874920:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.874923:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431558.874927:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6ae00, rc 0)
00000100:00100000:0.0:1789431558.875004:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+404:14616:x1876351933369600:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 414us (723us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431558.875011:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295605
00000100:00100000:3.0:1789431558.876977:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.881812:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.881886:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.882776:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12367
00000100:00100000:3.0:1789431558.882790:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0776b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+406:14617:x1876351933369984:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431558.887823:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0776b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+405:14617:x1876351933369984:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 5038us (5936us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431558.887831:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12367
00000100:00100000:3.0:1789431558.892156:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.893602:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.893844:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933370368
00000100:00100000:0.0:1789431558.893853:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933370368
00000100:00100000:0.0:1789431558.893899:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295608
00000100:00100000:0.0:1789431558.893909:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+405:14616:x1876351933370368:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.893921:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.893937:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523cac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c82d6 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.893989:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523cb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894005:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894014:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894029:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523cba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x425ecf6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894036:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523cba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x425ecf6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894042:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523cba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x425ecf6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894108:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894116:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523cb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894122:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523cb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894128:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6be00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.894131:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523cb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894137:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523cb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894150:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.894153:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.894156:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523cb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894162:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523cb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894173:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523cba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x425ecf6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894180:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523cba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x425ecf6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894187:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523cba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x425ecf6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894192:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.894195:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523cba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x425ecf6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894201:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523cba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x425ecf6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894209:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x425ecf6b (ffff90cf3afe7f00)
00010000:00010000:0.0:1789431558.894211:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.894214:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523cba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x425ecf6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894220:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523cba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x425ecf6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894249:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523cac lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82d6 expref: 406 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894257:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.894260:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.894264:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523cac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82d6 expref: 406 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.894273:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6a800, rc 0)
00000100:00100000:0.0:1789431558.894324:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+405:14616:x1876351933370368:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 417us (722us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431558.894332:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295608
00000100:00100000:3.0:1789431558.896781:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.898288:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.898455:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933370624
00000100:00100000:0.0:1789431558.898465:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933370624
00000100:00100000:0.0:1789431558.898519:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295610
00000100:00100000:0.0:1789431558.898530:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+405:14616:x1876351933370624:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.898595:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.898616:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523cd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c82e4 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.898770:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523cdd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.898794:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523cdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.898806:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523cdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.898824:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523ce4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x4f0278e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.898832:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4f0278e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.898839:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4f0278e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.898890:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523cdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.898898:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523cdd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.898905:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523cdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.898912:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.898917:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523cdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.898924:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523cdd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.898936:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.898939:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.898944:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523cdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.898951:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523cdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.898966:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4f0278e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.898973:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523ce4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4f0278e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.898979:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523ce4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4f0278e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.898985:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.898988:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523ce4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4f0278e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.898994:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523ce4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4f0278e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.899002:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x4f0278e7 (ffff90cf3afe7600)
00010000:00010000:0.0:1789431558.899004:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.899007:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523ce4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x4f0278e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.899014:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523ce4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x4f0278e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.899044:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523cd6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82e4 expref: 406 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.899082:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.899085:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.899090:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523cd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82e4 expref: 406 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.899099:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6b800, rc 0)
00000100:00100000:0.0:1789431558.899164:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+405:14616:x1876351933370624:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 635us (888us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431558.899171:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295610
00000100:00100000:1.0:1789431558.902268:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.902448:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933370880
00000100:00100000:0.0:1789431558.902462:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933370880
00000100:00100000:0.0:1789431558.902542:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295611
00000100:00100000:0.0:1789431558.902554:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+405:14617:x1876351933370880:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.902581:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.902585:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431558.902624:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63523c90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82c8 expref: 405 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.902649:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431558.902655:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431558.902674:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63523ceb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c82eb expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.902972:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63523cf2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.902992:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63523cf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.903005:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63523cf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.903031:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63523cf9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.903039:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63523cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.903087:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63523cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.903739:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.903835:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933371008
00000100:00100000:1.0:1789431558.903854:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933371008
00000100:00100000:1.0:1789431558.903911:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295612
00000100:00100000:1.0:1789431558.903921:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+406:14616:x1876351933371008:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431558.903938:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431558.903954:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523d00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c82f2 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431558.903979:0:12181:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x504:0x0], index 0: 0
00010000:00010000:1.0:1789431558.904014:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904026:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904036:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904076:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523d0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x622c68bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904084:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523d0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x622c68bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904091:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523d0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x622c68bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904128:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904136:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904143:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904150:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431558.904155:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904162:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904175:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431558.904177:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.904182:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904188:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.904197:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63523d15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a84:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904200:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523d0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x622c68bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.904206:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63523d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904206:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523d0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x622c68bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904213:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523d0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x622c68bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.904214:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63523d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904219:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431558.904221:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523d0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x622c68bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904226:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523d0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x622c68bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904237:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x622c68bf (ffff90cf11d83e00)
00010000:00010000:1.0:1789431558.904239:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.904242:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523d0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x622c68bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904247:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523d0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x622c68bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.904248:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63523cf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.904254:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63523cf2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.904260:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63523cf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.904264:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.904267:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63523cf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.904273:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63523cf2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904278:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523d00 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82f2 expref: 408 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904288:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431558.904290:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.904293:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523d00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82f2 expref: 408 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.904304:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b507800, rc 0)
00000100:00100000:1.0:1789431558.904372:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+407:14616:x1876351933371008:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 453us (638us total) trans 0 rc 301/301
00010000:00010000:0.0:1789431558.904377:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431558.904380:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00000100:00100000:1.0:1789431558.904380:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295612
00010000:00010000:0.0:1789431558.904385:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63523cf2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.904391:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63523cf2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431558.904403:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001270327f reply state 00000000fb52053f transno 4295120791 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63523cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431558.904412:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431558.904440:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63523ceb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82eb expref: 407 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.904453:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63523d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82eb expref: 406 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.904460:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a84:0x0].0x0 (ffff90cf062f5600)
00010000:00010000:0.0:1789431558.904462:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431558.904464:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3e00, rc 0)
00000100:00100000:0.0:1789431558.904492:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+407:14617:x1876351933370880:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1942us (2241us total) trans 4295120791 rc 0/0
00000100:00100000:0.0:1789431558.904498:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295611
00010000:00010000:0.0:1789431558.907033:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63523cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.907118:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63523cf9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.907127:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63523cf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.907134:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.907139:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63523cf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.907149:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63523cf9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.907173:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x7b807097 (ffff90cf08772400)
00010000:00010000:0.0:1789431558.907176:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.907183:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63523cf9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.907190:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63523cf9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.907957:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.908161:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933371136
00000100:00100000:0.0:1789431558.908174:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933371136
00000100:00100000:0.0:1789431558.908252:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295613
00000100:00100000:0.0:1789431558.908264:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+406:14616:x1876351933371136:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431558.908293:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431558.908319:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523d23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c82f9 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908414:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523d2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908435:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523d2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908448:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523d2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908466:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523d31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x9fa70bab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908473:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x9fa70bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908480:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x9fa70bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908554:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523d2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908561:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523d2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908567:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523d2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908573:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.908577:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523d2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908587:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523d2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908599:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.908602:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.908607:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523d2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908614:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523d2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908627:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x9fa70bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908634:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523d31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x9fa70bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908640:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x9fa70bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908645:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6be00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.908648:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x9fa70bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908655:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523d31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x9fa70bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908662:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x9fa70bab (ffff90cf3afe7f00)
00010000:00010000:0.0:1789431558.908810:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.908816:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523d31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x9fa70bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908825:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6be00/0xd8e438fb63523d31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x9fa70bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908870:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523d23 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82f9 expref: 407 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908881:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431558.908884:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.908888:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523d23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82f9 expref: 407 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.908897:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6a800, rc 0)
00000100:00100000:0.0:1789431558.908981:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+406:14616:x1876351933371136:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 719us (1034us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431558.908989:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295613
00000100:00100000:1.0:1789431558.912443:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.912836:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.913127:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933371264
00000100:00100000:3.0:1789431558.913133:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933371264
00000100:00100000:3.0:1789431558.913215:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8167
00000100:00100000:3.0:1789431558.913223:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+114:2347:x1876351933371264:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.913233:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.913257:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf2f1417/0xd8e438fb63523d3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8300 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431558.913351:0:14486:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x504:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431558.913371:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x504:0x0].0x0 since=3016s v=(0 0)
00010000:00010000:3.0:1789431558.913376:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x504:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431558.913385:0:14486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf2f1417/0xd8e438fb63523d3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8300 expref: 115 pid: 14486 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.913401:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cf2f1417/0xd8e438fb63523d3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8300 expref: 115 pid: 14486 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.913416:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3600, rc 0)
00000100:00100000:3.0:1789431558.913491:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+115:2347:x1876351933371264:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 268us (1066us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431558.913498:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8167
00000100:00100000:3.0:1789431558.919856:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.919951:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.920025:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933371776
00000100:00100000:1.0:1789431558.920041:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933371776
00000100:00100000:1.0:1789431558.920232:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295615
00000100:00100000:1.0:1789431558.920246:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+407:14616:x1876351933371776:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431558.920277:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431558.920313:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523d5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c830e expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.920452:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.920473:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6350e8e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c1b18 expref: 408 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.920482:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63523d54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8307 expref: 408 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.920492:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d62 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.920546:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63523d54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8307 expref: 408 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.920561:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63523d54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8307 expref: 408 pid: 12775 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.920577:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894194560:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431558.920721:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6350e8e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c1b18 expref: 408 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.920730:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6350e8e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c1b18 expref: 408 pid: 6797 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.920739:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce36219c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894194688:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431558.921133:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f39c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431558.921170:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933371520
00000100:00100000:0.0:1789431558.921178:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933371520
00010000:00010000:0.0:1789431558.921218:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63523d54 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8307 expref: 409 pid: 12775 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431558.921310:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16387
00000100:00100000:0.0:1789431558.921321:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+409:2349:x1876351933371520:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431558.921334:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:3.0:1789431558.921340:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431558.921342:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63523d54 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8307 expref: 409 pid: 12775 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.921361:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63523d54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8307 expref: 409 pid: 12775 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.921383:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00010000:00010000:0.0:1789431558.921388:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.921396:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.921401:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431558.921434:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+409:2349:x1876351933371520:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 115us (1592us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431558.921441:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16387
00000100:00100000:1.0:1789431558.921500:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933372032
00000100:00100000:1.0:1789431558.921505:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933372032
00000100:00100000:1.0:1789431558.921549:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12368
00000100:00100000:1.0:1789431558.921557:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+409:14617:x1876351933372032:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431558.922233:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+410:14617:x1876351933372032:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 673us (888us total) trans 4295120792 rc 0/0
00000100:00100000:1.0:1789431558.922243:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12368
00010000:00010000:1.0:1789431558.925588:0:12181:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@00000000060da210 x1876351894194560) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63523d54 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8307 expref: 409 pid: 12775 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.926135:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63523d54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8307 expref: 409 pid: 12775 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.926161:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894194560:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431558.926186:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce36219c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894194688:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431558.926223:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00010000:00010000:1.0:1789431558.926230:0:12181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.926241:0:12181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.926253:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.927361:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.927410:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933372160
00000100:00100000:1.0:1789431558.927424:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933372160
00010000:00010000:1.0:1789431558.927481:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6350e8e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c1b18 expref: 409 pid: 6797 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.927590:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16388
00000100:00100000:1.0:1789431558.927840:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+409:2348:x1876351933372160:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431558.927865:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431558.927873:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6350e8e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c1b18 expref: 409 pid: 6797 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.927890:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6350e8e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c1b18 expref: 409 pid: 6797 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.927918:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6350e8e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c1b18 expref: 409 pid: 6797 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.927936:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00010000:00010000:1.0:1789431558.927942:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.927953:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.927967:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d62 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.928087:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431558.928161:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+408:2348:x1876351933372160:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 561us (812us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431558.928169:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16388
00010000:00010000:0.0:1789431558.928258:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.928267:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431558.928349:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100ba:0x0]: returning size 260096
00010000:00010000:0.0:1789431558.928559:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523d5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c830e expref: 409 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.928579:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c830e expref: 408 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.928587:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00010000:00010000:0.0:1789431558.928590:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431558.928593:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ac42400, rc 0)
00000100:00100000:0.0:1789431558.929187:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+408:14616:x1876351933371776:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8941us (9231us total) trans 4295120793 rc 0/0
00000100:00100000:0.0:1789431558.929198:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295615
00000100:00100000:3.0:1789431558.931935:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933372416
00000100:00100000:3.0:1789431558.931950:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933372416
00000100:00100000:3.0:1789431558.932024:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295616
00000100:00100000:3.0:1789431558.932036:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+408:14617:x1876351933372416:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431558.932141:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431558.932176:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63523d15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82eb expref: 408 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.932199:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a84:0x0].0x0 (ffff90cf062f5600)
00010000:00010000:3.0:1789431558.932214:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431558.932243:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523d70 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.932261:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523d70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.932273:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523d70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.932355:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523d77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.932366:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523d77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.932374:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523d77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.932521:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523d7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a84:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.932530:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523d7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a84:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.932543:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523d7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a84:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.934470:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.934633:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933372544
00000100:00100000:1.0:1789431558.934649:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933372544
00000100:00100000:1.0:1789431558.934749:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295617
00000100:00100000:1.0:1789431558.934770:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+408:14616:x1876351933372544:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431558.934804:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431558.934832:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523d85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100ba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8315 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.934944:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523d8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.934961:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d62 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c830e expref: 409 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.934969:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523d8c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.935011:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c830e expref: 409 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.935026:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523d62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c830e expref: 409 pid: 12181 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.935042:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce36219c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894194816:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431558.935192:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3f00 going to sleep for 11 seconds
00010000:00010000:3.0:1789431558.937451:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431558.937463:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63523d93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a84:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.937472:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431558.937476:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63523d93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a84:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.937485:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63523d93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a84:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.937495:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a84:0x0].0x0 (ffff90ce2154d300)
00010000:00010000:3.0:1789431558.937498:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431558.937501:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63523d93 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a84:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.937507:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63523d93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a84:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.937525:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431558.937527:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431558.937529:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431558.944501:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.944579:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.945127:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce36219c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894194816:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431558.945178:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523d8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.945626:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523d77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.945638:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523d77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.945646:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523d77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.945652:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431558.945658:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523d77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.945667:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523d77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.945681:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x7b807097 (ffff90ce2154d600)
00010000:00010000:1.0:1789431558.945684:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431558.945690:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523d77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.945696:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523d77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.946250:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.946259:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431558.946381:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100ba:0x0]: returning size 260096
00000004:00200000:0.0:1789431558.946387:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431558.946413:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.946451:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523d85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100ba:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8315 expref: 410 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.946468:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523d8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8315 expref: 409 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.946476:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00010000:00010000:0.0:1789431558.946478:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431558.946481:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ac43800, rc 0)
00000100:00100000:0.0:1789431558.946510:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+409:14616:x1876351933372544:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11753us (12054us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431558.946516:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295617
00000100:00100000:3.0:1789431558.953158:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.955268:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.955366:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933373184
00000100:00100000:1.0:1789431558.955377:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933373184
00000100:00100000:1.0:1789431558.955443:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295619
00000100:00100000:1.0:1789431558.955455:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+409:14617:x1876351933373184:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431558.955484:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431558.955513:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523daf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8323 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.956814:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523db6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.956844:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523db6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.957177:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523db6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431558.957243:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:1.0:1789431558.957248:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431558.957275:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523db6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.957320:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523daf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8323 expref: 411 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.957343:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523db6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8323 expref: 410 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.957354:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431558.957358:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431558.957363:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ac43c00, rc 0)
00000100:00100000:1.0:1789431558.957830:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+410:14617:x1876351933373184:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2374us (2569us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431558.957842:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295619
00000100:00100000:1.0:1789431558.960144:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.966967:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.967167:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933373440
00000100:00100000:1.0:1789431558.967183:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933373440
00000100:00100000:1.0:1789431558.967260:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12370
00000100:00100000:1.0:1789431558.967274:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+411:14617:x1876351933373440:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431558.972092:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.972198:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.972332:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933373824
00000100:00100000:3.0:1789431558.972346:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933373824
00000100:00100000:3.0:1789431558.972820:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295621
00000100:00100000:3.0:1789431558.972830:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+412:14616:x1876351933373824:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.972853:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.972874:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523dd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8331 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.973023:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523de0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.973041:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523d8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8315 expref: 413 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.973084:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523de0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.973128:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523d8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8315 expref: 412 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.973143:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523d8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8315 expref: 412 pid: 5848 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.973159:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1a568e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894194944:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431558.973221:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3a815300 going to sleep for 11 seconds
00000100:00100000:1.0:1789431558.974560:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+412:14617:x1876351933373440:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 7274us (7595us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431558.974573:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12370
00000100:00100000:3.0:1789431558.977471:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1a568e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894194944:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431558.977515:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523de0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.979862:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.980475:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933373952
00000100:00100000:0.0:1789431558.980489:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933373952
00010000:00010000:0.0:1789431558.980546:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523d8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8315 expref: 412 pid: 5848 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431558.980738:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16390
00000100:00100000:0.0:1789431558.980751:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+412:2347:x1876351933373952:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431558.980781:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431558.980790:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523d8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8315 expref: 412 pid: 5848 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.980805:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523d8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8315 expref: 412 pid: 5848 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.980833:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523d8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8315 expref: 412 pid: 5848 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.980854:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00010000:00010000:0.0:1789431558.980861:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523de0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.980872:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523de0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.980882:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523de0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.980919:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431558.980996:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+411:2347:x1876351933373952:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 248us (1147us total) trans 0 rc 0/0
00010000:00010000:3.0:1789431558.981084:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523de0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.981093:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523de0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431558.981118:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100ba:0x0]: returning size 260096
00010000:00010000:3.0:1789431558.981336:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523dd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8331 expref: 413 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.981356:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523de0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8331 expref: 412 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.981364:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00010000:00010000:3.0:1789431558.981367:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431558.981370:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3000, rc 0)
00000100:00100000:3.0:1789431558.981400:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+412:14616:x1876351933373824:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8572us (9201us total) trans 4295120796 rc 0/0
00000100:00100000:3.0:1789431558.981407:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295621
00000100:00100000:0.0:1789431558.982847:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16390
00000100:00100000:0.0:1789431558.987978:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431558.988029:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431558.988046:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933374208
00000100:00100000:3.0:1789431558.988089:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933374208
00000100:00100000:3.0:1789431558.988162:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933374336
00000100:00100000:3.0:1789431558.988166:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933374336
00000100:00100000:3.0:1789431558.988188:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295622
00000100:00100000:3.0:1789431558.988199:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+412:14617:x1876351933374208:12345-192.168.203.4@tcp:101:dbench.0
00000100:00100000:1.0:1789431558.988215:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295623
00000100:00100000:1.0:1789431558.988226:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+412:14616:x1876351933374336:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431558.988228:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431558.988232:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:1.0:1789431558.988239:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431558.988264:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63523dee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100ba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c833f expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.988266:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523db6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8323 expref: 412 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.988287:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431558.988293:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431558.988302:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523df5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8338 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.988384:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.988399:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523de0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8331 expref: 413 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.988408:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523dfc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.988415:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523e03 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.988426:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523e03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.988436:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523e03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.988449:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523de0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8331 expref: 413 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.988453:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523e0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.988460:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.988465:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523de0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8331 expref: 413 pid: 5847 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.988466:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.988482:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3621ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894195072:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431558.988586:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f39c0 going to sleep for 11 seconds
00000004:00080000:3.0:1789431558.989557:0:12775:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x504:0x0], index 1: 0
00010000:00010000:3.0:1789431558.989904:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523e11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a85:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.989922:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a85:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.989936:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a85:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.989979:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523e03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.989987:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523e03 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.989995:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523e03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.990002:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf42157200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431558.990008:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523e03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.990017:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523e03 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.990029:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431558.990032:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431558.990037:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523e03 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.990044:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523e03 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431558.990109:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000484ce670 reply state 0000000079457310 transno 4295120797 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.990119:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431558.990161:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523df5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8338 expref: 415 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.990180:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523e11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a85:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8338 expref: 414 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431558.990187:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a85:0x0].0x0 (ffff90ce2154d400)
00010000:00010000:3.0:1789431558.990189:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431558.990191:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd5800, rc 0)
00000100:00100000:3.0:1789431558.990269:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+415:14617:x1876351933374208:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2070us (2305us total) trans 4295120797 rc 0/0
00000100:00100000:3.0:1789431558.990278:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295622
00010000:00010000:0.0:1789431558.995472:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.995497:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523e0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.995506:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523e0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.995513:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431558.995521:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523e0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.995528:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523e0a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.995551:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x7b807097 (ffff90ce2154d300)
00010000:00010000:0.0:1789431558.995554:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431558.995560:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523e0a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431558.995571:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb63523e0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431558.996856:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3621ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894195072:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431558.996900:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431558.996946:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431558.997188:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933374464
00000100:00100000:1.0:1789431558.997197:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933374464
00000100:00100000:1.0:1789431558.997273:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8168
00000100:00100000:1.0:1789431558.997284:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+110:2348:x1876351933374464:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431558.997370:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431558.997396:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004789398b/0xd8e438fb63523e1f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8346 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789431558.997434:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x504:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:1.0:1789431558.997461:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x504:0x0].0x0 since=3017s v=(0 0)
00010000:00010000:1.0:1789431558.997466:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x504:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431558.997477:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004789398b/0xd8e438fb63523e1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8346 expref: 111 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.997501:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004789398b/0xd8e438fb63523e1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8346 expref: 111 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431558.997517:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ac43600, rc 0)
00000100:00100000:1.0:1789431558.997977:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+111:2348:x1876351933374464:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 693us (1031us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431558.997985:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8168
00000100:00100000:1.0:1789431559.002511:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933374592
00000100:00100000:1.0:1789431559.002531:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933374592
00010000:00010000:1.0:1789431559.002603:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523de0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8331 expref: 414 pid: 5847 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.002849:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16391
00000100:00100000:1.0:1789431559.002861:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+414:2347:x1876351933374592:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431559.002888:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431559.002896:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523de0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8331 expref: 414 pid: 5847 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.002913:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523de0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8331 expref: 414 pid: 5847 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.002942:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523de0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8331 expref: 414 pid: 5847 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.002965:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00010000:00010000:1.0:1789431559.002973:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.002985:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.002993:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523dfc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.003043:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431559.003143:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+413:2347:x1876351933374592:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 284us (3498us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431559.003152:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16391
00000100:00100000:3.0:1789431559.003844:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.010888:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.013157:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.013218:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933375360
00000100:00100000:1.0:1789431559.013229:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933375360
00000100:00100000:1.0:1789431559.013295:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295624
00000100:00100000:1.0:1789431559.013308:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf087a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+414:14617:x1876351933375360:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431559.013381:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431559.013674:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63523e11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a85:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8338 expref: 414 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.013699:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a85:0x0].0x0 (ffff90ce2154d400)
00010000:00010000:1.0:1789431559.013713:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431559.013745:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523e26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.013777:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523e26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.013789:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523e26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.013807:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523e2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.013815:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523e2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.013821:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523e2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.013970:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523e34 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a85:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.013980:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523e34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a85:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.013987:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523e34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a85:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431559.015906:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1201, 64 off85120
00010000:00010000:1.0:1789431559.016014:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523e3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a85:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.016033:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523e3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.016067:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523e3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.016079:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523e3b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.016085:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523e3b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.016091:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523e3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.016109:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431559.016150:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523e34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.016161:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523e34 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.016167:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523e34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.016548:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b507800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.016554:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523e34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a85:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.016561:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523e34 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a85:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.016571:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a85:0x0].0x0 (ffff90cf11d83d00)
00010000:00010000:1.0:1789431559.016574:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431559.016577:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523e34 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a85:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.016584:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523e34 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a85:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.016612:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523e26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.016619:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523e26 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.016625:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523e26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.016630:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac43c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.016634:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523e26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.016640:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523e26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.016648:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00000100:00100000:3.0:1789431559.016648:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933375488
00010000:00010000:1.0:1789431559.016651:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.016654:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523e26 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431559.016659:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933375488
00010000:00010000:1.0:1789431559.016660:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63523e26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431559.016671:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bc3c8889 reply state 000000003b6cc96e transno 4295120800 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523e2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.016680:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431559.016766:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295625
00000100:00100000:3.0:1789431559.016787:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+416:14616:x1876351933375488:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431559.016811:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431559.016827:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523e42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c834d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.016894:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523e49 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.016906:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523e49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.016921:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523e49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.016938:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523e50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x14be06ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.016945:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.016952:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017045:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523e57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017084:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017091:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431559.017130:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100ba:0x0]: returning size 260096
00000004:00200000:3.0:1789431559.017136:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431559.017154:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017166:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017174:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523e49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017186:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523e49 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017193:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523e49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017198:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.017202:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523e49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017207:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523e49 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017216:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431559.017218:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.017222:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523e49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017228:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63523e49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017239:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017246:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523e50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017252:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523e50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017257:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.017261:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523e50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017266:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523e50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017273:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x14be06ab (ffff90ce2154d300)
00010000:00010000:3.0:1789431559.017275:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.017278:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523e50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017283:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63523e50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017322:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb63523e42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c834d expref: 418 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017337:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523e57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c834d expref: 417 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.017345:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00000100:00100000:1.0:1789431559.017347:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf087a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+417:14617:x1876351933375360:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 4032us (4187us total) trans 4295120800 rc 0/0
00010000:00010000:3.0:1789431559.017348:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431559.017351:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf42157200, rc 0)
00000100:00100000:1.0:1789431559.017355:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295624
00000100:00100000:3.0:1789431559.017377:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+416:14616:x1876351933375488:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 603us (831us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431559.017384:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295625
00010000:00010000:1.0:1789431559.024806:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523e2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.024829:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523e2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.024839:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523e2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.024846:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac43800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.024852:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523e2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.024861:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523e2d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.024883:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x7b807097 (ffff90cf11d83f00)
00010000:00010000:1.0:1789431559.024886:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.024893:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523e2d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.024900:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63523e2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.026964:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933375616
00000100:00100000:0.0:1789431559.026980:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933375616
00000100:00100000:0.0:1789431559.027087:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14329
00000100:00100000:0.0:1789431559.027101:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+415:2349:x1876351933375616:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431559.027123:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431559.027158:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63523e57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c834d expref: 415 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.027180:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00010000:00010000:0.0:1789431559.027187:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431559.027266:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+414:2349:x1876351933375616:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 168us (508us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431559.027273:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14329
00000100:00100000:0.0:1789431559.027913:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.027952:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.030021:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295627
00000100:00100000:0.0:1789431559.030045:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf087a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+416:14617:x1876351933376000:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.030080:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.030100:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523e6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c835b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030166:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523e73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030182:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030195:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030213:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030220:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030227:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030368:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030378:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523e73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030385:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523e73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030392:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.030398:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523e73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030406:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523e73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030425:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.030428:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.030433:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523e73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030439:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523e73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030452:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030458:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030464:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030470:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.030473:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030479:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030485:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xd940be10 (ffff90cf3afe7f00)
00010000:00010000:0.0:1789431559.030487:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.030490:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030495:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030534:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523e6c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c835b expref: 417 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030543:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.030546:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.030550:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523e6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c835b expref: 417 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.030560:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6aa00, rc 0)
00000100:00100000:0.0:1789431559.030627:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf087a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+416:14617:x1876351933376000:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 593us (2673us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431559.030634:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295627
00000100:00100000:0.0:1789431559.038312:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.038412:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.038412:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894195200:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431559.038455:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63523e65 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.038492:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933376256
00000100:00100000:1.0:1789431559.038500:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933376256
00000100:00100000:1.0:1789431559.038569:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295628
00000100:00100000:1.0:1789431559.038581:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+416:14617:x1876351933376256:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.038607:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.038632:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523e81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8362 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.038715:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523e88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.038734:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.038752:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431559.038802:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933376128
00000100:00100000:3.0:1789431559.038808:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933376128
00000004:00200000:1.0:1789431559.038826:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:1.0:1789431559.038832:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00010000:00010000:3.0:1789431559.038832:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523dfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c833f expref: 418 pid: 6797 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431559.038860:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431559.038879:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16392
00000100:00100000:3.0:1789431559.038888:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf087a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+419:2347:x1876351933376128:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431559.038896:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523e81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8362 expref: 419 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.038899:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431559.038910:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523dfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c833f expref: 419 pid: 6797 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.038926:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523e88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8362 expref: 418 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.038928:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c833f expref: 418 pid: 6797 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.038951:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431559.038955:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431559.038961:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37e74200, rc 0)
00010000:00010000:3.0:1789431559.038965:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63523dfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c833f expref: 418 pid: 6797 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.038979:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00010000:00010000:3.0:1789431559.038984:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63523e65 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.038997:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63523e65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.039008:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63523e65 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.039030:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+417:14617:x1876351933376256:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 450us (618us total) trans 0 rc 0/0
00010000:00010000:3.0:1789431559.039034:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431559.039041:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295628
00000100:00100000:3.0:1789431559.039085:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf087a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+416:2347:x1876351933376128:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 197us (786us total) trans 0 rc 0/0
00010000:00010000:1.0:1789431559.039092:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63523e65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431559.039093:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16392
00010000:00010000:1.0:1789431559.039104:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63523e65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431559.039121:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100ba:0x0]: returning size 260096
00010000:00010000:1.0:1789431559.039293:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63523e5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8354 expref: 417 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.039310:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63523e65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8354 expref: 416 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.039318:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00010000:00010000:1.0:1789431559.039320:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431559.039323:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985e800, rc 0)
00000100:00100000:1.0:1789431559.039348:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf087a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+416:14616:x1876351933375872:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10726us (11440us total) trans 4295120801 rc 0/0
00000100:00100000:1.0:1789431559.039356:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295626
00000100:00100000:0.0:1789431559.048404:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933376384
00000100:00100000:0.0:1789431559.048418:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933376384
00000100:00100000:0.0:1789431559.048498:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295629
00000100:00100000:0.0:1789431559.048510:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+416:14616:x1876351933376384:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.048544:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.048579:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523e96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100ba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8369 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.048700:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.048716:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63523e65 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8354 expref: 417 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.048726:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e9d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.048792:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63523e65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8354 expref: 417 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.048808:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63523e65 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8354 expref: 417 pid: 6797 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.048823:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894195328:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431559.048936:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c10c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431559.051113:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933376512
00000100:00100000:3.0:1789431559.051127:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933376512
00000100:00100000:3.0:1789431559.052880:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894195328:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431559.052926:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.055411:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12373
00000100:00100000:0.0:1789431559.055432:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0776a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+418:14617:x1876351933376512:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431559.055692:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933376640
00000100:00100000:1.0:1789431559.055703:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933376640
00010000:00010000:1.0:1789431559.055741:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63523e65 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8354 expref: 419 pid: 6797 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.055797:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16393
00000100:00100000:1.0:1789431559.055806:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+419:2347:x1876351933376640:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431559.055823:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431559.055832:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63523e65 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8354 expref: 419 pid: 6797 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.055847:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63523e65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8354 expref: 419 pid: 6797 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.055875:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63523e65 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8354 expref: 419 pid: 6797 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.055900:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00010000:00010000:1.0:1789431559.055907:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.055919:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.055928:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e9d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.055963:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431559.056029:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+418:2347:x1876351933376640:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 224us (419us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431559.056038:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16393
00010000:00010000:3.0:1789431559.056586:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.056598:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431559.056657:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100ba:0x0]: returning size 260096
00000004:00200000:3.0:1789431559.056663:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431559.056691:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.056736:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523e96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100ba:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8369 expref: 418 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.056767:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8369 expref: 417 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.056777:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00010000:00010000:3.0:1789431559.056780:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431559.056783:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6a600, rc 0)
00000100:00100000:3.0:1789431559.056833:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+418:14616:x1876351933376384:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8325us (8597us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431559.056842:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295629
00000100:00100000:0.0:1789431559.061045:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0776a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+416:14617:x1876351933376512:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 5602us (11141us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431559.061089:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12373
00000100:00100000:1.0:1789431559.065946:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933376896
00000100:00100000:1.0:1789431559.065959:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933376896
00000100:00100000:1.0:1789431559.066033:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12374
00000100:00100000:1.0:1789431559.066045:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+416:14616:x1876351933376896:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431559.066505:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+417:14616:x1876351933376896:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 459us (671us total) trans 4295120802 rc 0/0
00000100:00100000:1.0:1789431559.066514:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12374
00000100:00100000:0.0:1789431559.073840:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.073926:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933377280
00000100:00100000:0.0:1789431559.073927:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.073942:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933377280
00000100:00100000:3.0:1789431559.074030:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933377024
00000100:00100000:3.0:1789431559.074034:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933377024
00000100:00100000:3.0:1789431559.074103:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295630
00000100:00100000:3.0:1789431559.074115:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+418:14617:x1876351933377280:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431559.074147:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431559.074151:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431559.074187:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63523e88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8362 expref: 418 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.074218:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431559.074225:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431559.074243:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523ea4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8377 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.076665:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523ec7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.076692:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523ec7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.076707:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523ec7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.076729:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523ece lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.076737:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523ece lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.076744:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523ece lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431559.079815:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.079987:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933377408
00000100:00100000:0.0:1789431559.080000:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933377408
00000100:00100000:0.0:1789431559.080111:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14330
00000100:00100000:0.0:1789431559.080123:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+419:2348:x1876351933377408:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431559.080142:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431559.080176:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63523ec0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8370 expref: 419 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.080200:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00010000:00010000:0.0:1789431559.080206:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431559.080274:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+418:2348:x1876351933377408:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 153us (475us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431559.080283:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14330
00000004:00080000:1.0:1789431559.082672:0:12775:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x505:0x0], index 0: 0
00010000:00010000:1.0:1789431559.083209:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb63523ed5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a86:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.083231:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb63523ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a86:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.083245:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb63523ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a86:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.083375:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523ec7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.083385:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523ec7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.083394:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523ec7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.083402:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e74a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.083407:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523ec7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.083416:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523ec7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.083431:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431559.083434:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.083442:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523ec7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.083449:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63523ec7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431559.083469:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000090c31083 reply state 00000000e2416fa8 transno 4295120803 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523ece lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.083479:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431559.083529:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63523ea4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8377 expref: 419 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.083550:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb63523ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a86:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8377 expref: 418 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.083558:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a86:0x0].0x0 (ffff90cf11d83d00)
00010000:00010000:1.0:1789431559.083561:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431559.083563:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb2f800, rc 0)
00000100:00100000:1.0:1789431559.083716:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+419:14617:x1876351933377280:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9601us (9892us total) trans 4295120803 rc 0/0
00000100:00100000:1.0:1789431559.083725:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295630
00000100:00100000:3.0:1789431559.087610:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431559.088367:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523ece lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.088383:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523ece lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.088392:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523ece lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.088399:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b507800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.088406:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523ece lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.088414:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523ece lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.088435:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xd940be10 (ffff90cf11d83f00)
00010000:00010000:0.0:1789431559.088439:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.088445:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523ece lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.088452:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63523ece lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.088962:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933377664
00000100:00100000:1.0:1789431559.088977:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933377664
00000100:00100000:1.0:1789431559.089192:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295632
00000100:00100000:1.0:1789431559.089206:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+418:14616:x1876351933377664:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.089233:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.089260:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523ee3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c837e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.089404:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523eea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.089420:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8369 expref: 419 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.089431:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523eea lrc: 4/0,1 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.089475:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8369 expref: 419 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.089492:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8369 expref: 419 pid: 5847 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.089509:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3621ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894195456:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431559.089796:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3900 going to sleep for 11 seconds
00000100:00100000:1.0:1789431559.092862:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3621ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894195456:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431559.092903:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523eea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.092982:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933377792
00000100:00100000:0.0:1789431559.092992:0:14490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933377792
00000100:00100000:0.0:1789431559.093115:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8169
00000100:00100000:0.0:1789431559.093129:0:14490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+115:2347:x1876351933377792:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.093149:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.093174:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000569b40c5/0xd8e438fb63523ef1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8385 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789431559.093213:0:14490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x505:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431559.093241:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x505:0x0].0x0 since=3017s v=(0 0)
00010000:00010000:0.0:1789431559.093246:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x505:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431559.093257:0:14490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000569b40c5/0xd8e438fb63523ef1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8385 expref: 116 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.093282:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000569b40c5/0xd8e438fb63523ef1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8385 expref: 116 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.093644:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6be00, rc 0)
00000100:00100000:0.0:1789431559.093965:0:14490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+116:2347:x1876351933377792:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 836us (1278us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431559.093974:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8169
00000100:00100000:3.0:1789431559.094177:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.094327:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933377920
00000100:00100000:0.0:1789431559.094336:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933377920
00010000:00010000:0.0:1789431559.094367:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8369 expref: 420 pid: 5847 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.094401:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16394
00000100:00100000:0.0:1789431559.094410:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb58450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+420:2348:x1876351933377920:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431559.094426:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431559.094434:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8369 expref: 420 pid: 5847 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.094463:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8369 expref: 420 pid: 5847 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.094487:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523e9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8369 expref: 420 pid: 5847 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.094504:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00010000:00010000:0.0:1789431559.094510:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523eea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.094521:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523eea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.094530:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523eea lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.094559:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431559.094605:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb58450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+419:2348:x1876351933377920:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 195us (428us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431559.094612:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16394
00010000:00010000:1.0:1789431559.095386:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523eea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.095399:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523eea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431559.095426:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100ba:0x0]: returning size 260096
00010000:00010000:1.0:1789431559.095648:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523ee3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c837e expref: 420 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.095671:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523eea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c837e expref: 419 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.095680:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00010000:00010000:1.0:1789431559.095684:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431559.095688:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37f77c00, rc 0)
00000100:00100000:1.0:1789431559.095740:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+419:14616:x1876351933377664:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6537us (8144us total) trans 4295120804 rc 0/0
00000100:00100000:1.0:1789431559.095749:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295632
00000100:00100000:3.0:1789431559.098554:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.100874:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933378304
00000100:00100000:1.0:1789431559.100885:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933378304
00000100:00100000:1.0:1789431559.100948:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295633
00000100:00100000:1.0:1789431559.100960:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+420:14616:x1876351933378304:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.100987:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.101017:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63523eff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100ba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c838c expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.101251:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1a00/0xd8e438fb63523f06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.101275:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523eea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c837e expref: 421 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.101285:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1a00/0xd8e438fb63523f06 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.101343:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523eea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c837e expref: 421 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.101362:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523eea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c837e expref: 421 pid: 5848 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.101380:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3621ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894195584:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431559.101482:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f39c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431559.108782:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933378432
00000100:00100000:3.0:1789431559.108798:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933378432
00010000:00010000:3.0:1789431559.108854:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523eea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c837e expref: 422 pid: 5848 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431559.108903:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16395
00000100:00100000:3.0:1789431559.108915:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+422:2347:x1876351933378432:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431559.108934:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431559.108944:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523eea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c837e expref: 422 pid: 5848 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.108960:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523eea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c837e expref: 422 pid: 5848 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.109574:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933378688
00000100:00100000:1.0:1789431559.109582:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933378688
00010000:00010000:3.0:1789431559.109584:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523eea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100ba:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c837e expref: 422 pid: 5848 timeout: 3117 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.109609:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00010000:00010000:3.0:1789431559.109616:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1a00/0xd8e438fb63523f06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.109628:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1a00/0xd8e438fb63523f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.109642:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1a00/0xd8e438fb63523f06 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.109677:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431559.109765:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+422:2347:x1876351933378432:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 841us (1355us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431559.109774:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16395
00010000:00010000:0.0:1789431559.110114:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1a00/0xd8e438fb63523f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.110123:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1a00/0xd8e438fb63523f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.110150:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295634
00000100:00100000:1.0:1789431559.110164:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+421:14617:x1876351933378688:12345-192.168.203.4@tcp:36:dbench.0
00000004:00200000:0.0:1789431559.110184:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100ba:0x0]: returning size 260096
00000004:00200000:0.0:1789431559.110191:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431559.110220:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1a00/0xd8e438fb63523f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.110238:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431559.110259:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb63523ed5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a86:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8377 expref: 422 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.110267:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63523eff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100ba:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c838c expref: 422 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.110277:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a86:0x0].0x0 (ffff90cf11d83d00)
00010000:00010000:0.0:1789431559.110291:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1a00/0xd8e438fb63523f06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ba:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c838c expref: 420 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.110294:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431559.110303:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ba:0x0].0x0 (ffff90ce2727aa00)
00010000:00010000:0.0:1789431559.110307:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431559.110310:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b5e1a00, rc 0)
00000100:00100000:0.0:1789431559.110352:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+420:14616:x1876351933378304:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9396us (9659us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431559.110358:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295633
00010000:00010000:1.0:1789431559.111109:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f0d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.111131:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.111146:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.111168:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63523f14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.111176:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63523f14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.111183:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63523f14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.111495:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63523f1b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a86:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.111503:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63523f1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.111510:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63523f1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431559.112392:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1200, 64 off84992
00000004:00080000:1.0:1789431559.112408:0:12181:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3017143358538ns, next at 3018143355077ns, rc = 0
00010000:00010000:1.0:1789431559.112498:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63523f22 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.112519:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63523f22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a86:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.112530:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63523f22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a86:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.112539:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63523f22 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a86:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.112546:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63523f22 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a86:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.112551:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63523f22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a86:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.112577:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431559.112605:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63523f1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.112612:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63523f1b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.112620:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63523f1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.112621:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431559.112631:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.112633:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63523f22 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a86:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.112637:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63523f1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a86:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.112648:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431559.112654:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63523f1b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.112655:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63523f22 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a86:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.112689:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63523f22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a86:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.112690:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a86:0x0].0x0 (ffff90cf04a08a00)
00010000:00010000:1.0:1789431559.112697:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431559.112704:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63523f1b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.112708:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a86:0x0].0x0 (ffff90cf04a08a00)
00010000:00010000:0.0:1789431559.112714:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431559.112717:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63523f1b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.112720:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63523f22 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a86:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.112732:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63523f22 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a86:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.112747:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.112753:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431559.112818:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431559.112820:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431559.113639:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f0d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.113650:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f0d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.113655:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b5e1800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.113659:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f0d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.113667:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f0d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.113680:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431559.113683:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.113687:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f0d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.113693:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f0d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431559.113715:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004e824078 reply state 0000000054e1ad44 transno 4295120806 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63523f14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.113726:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431559.113864:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+421:14617:x1876351933378688:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3697us (5325us total) trans 4295120806 rc 0/0
00000100:00100000:1.0:1789431559.113874:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295634
00010000:00010000:1.0:1789431559.117510:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63523f14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.117532:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63523f14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.117541:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63523f14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.117547:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a4a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.117553:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63523f14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.117560:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63523f14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.117580:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xd940be10 (ffff90cf11d83f00)
00010000:00010000:1.0:1789431559.117583:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.117589:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63523f14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.117595:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63523f14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431559.120558:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.121082:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933378816
00000100:00100000:0.0:1789431559.121099:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933378816
00000100:00100000:0.0:1789431559.121225:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295635
00000100:00100000:0.0:1789431559.121238:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+420:14617:x1876351933378816:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.121272:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.122582:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523f29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8393 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.122695:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523f30 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.122715:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523f30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.122729:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523f30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.122749:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.122768:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.122784:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.122861:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523f30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.122869:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523f30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.122876:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523f30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.122883:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.122888:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523f30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.122897:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523f30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.122912:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.122915:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.122921:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523f30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.122927:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523f30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.122944:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.122951:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.122957:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.122962:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.122965:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.124981:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.125005:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xd940be10 (ffff90cf08772400)
00010000:00010000:0.0:1789431559.125009:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.125015:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.125024:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.125114:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523f29 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8393 expref: 421 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.125126:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.125129:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.125134:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523f29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8393 expref: 421 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.125145:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6a600, rc 0)
00000100:00100000:0.0:1789431559.125249:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+420:14617:x1876351933378816:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4011us (4702us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431559.125259:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295635
00000100:00100000:3.0:1789431559.127578:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933378944
00000100:00100000:3.0:1789431559.127598:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933378944
00000100:00100000:3.0:1789431559.127731:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295636
00000100:00100000:3.0:1789431559.127745:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+420:14616:x1876351933378944:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431559.127792:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431559.127826:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523f3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c839a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.127920:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523f45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.127940:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523f45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.127953:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523f45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.128099:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523f4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.128109:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.128118:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.128198:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523f45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.128207:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523f45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.128214:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523f45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.128221:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f77c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.128226:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523f45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.128239:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523f45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.128253:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431559.128256:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.128263:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523f45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.128270:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523f45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.128283:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.128716:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523f4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.128724:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.128729:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f77a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.128732:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.128739:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523f4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.128748:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x7b807097 (ffff90ce2154d300)
00010000:00010000:3.0:1789431559.128751:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.128766:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523f4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.129123:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431559.129213:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523f4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.129268:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523f3e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c839a expref: 421 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.129280:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431559.129283:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.129287:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523f3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c839a expref: 421 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.129390:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933379072
00000100:00100000:0.0:1789431559.129400:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933379072
00000100:00100000:0.0:1789431559.129453:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295637
00000100:00100000:0.0:1789431559.129465:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+422:14617:x1876351933379072:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.129484:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.129503:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523f53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c83a1 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.129571:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523f5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.129586:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.129598:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431559.129642:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:0.0:1789431559.129646:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431559.129670:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.129689:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523f53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83a1 expref: 424 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.129707:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523f5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83a1 expref: 423 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.129715:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.129718:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431559.129720:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6aa00, rc 0)
00010000:00010000:3.0:1789431559.129931:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf00030e00, rc 0)
00000100:00100000:3.0:1789431559.131045:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+422:14616:x1876351933378944:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3295us (8536us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431559.131080:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295636
00000100:00100000:0.0:1789431559.131735:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+421:14617:x1876351933379072:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1703us (2049us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431559.131748:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295637
00000100:00100000:0.0:1789431559.143723:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933379328
00000100:00100000:0.0:1789431559.143738:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933379328
00000100:00100000:0.0:1789431559.143826:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295638
00000100:00100000:0.0:1789431559.143838:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+421:14616:x1876351933379328:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.144862:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.144871:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431559.144918:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ae00/0xd8e438fb63523c82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82c1 expref: 421 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.144945:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431559.144953:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431559.144972:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523f61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c83a8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.145194:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431559.146545:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523f68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.146575:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523f68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.146590:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523f68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.146610:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.146618:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.146625:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431559.147701:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x505:0x0], index 1: 0
00010000:00010000:0.0:1789431559.147954:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523f76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a87:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.147970:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a87:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.148301:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a87:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.148355:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523f68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.148364:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523f68 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.148378:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523f68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.148386:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.148392:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523f68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.148401:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523f68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.148415:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431559.148418:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.148425:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523f68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.148431:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523f68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431559.148449:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ce8faf94 reply state 0000000047e5de33 transno 4295120807 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.148459:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431559.148507:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523f61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83a8 expref: 425 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.148526:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523f76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a87:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83a8 expref: 424 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.148535:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a87:0x0].0x0 (ffff90ce0f6c6f00)
00010000:00010000:0.0:1789431559.148539:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431559.148541:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6a800, rc 0)
00000100:00100000:0.0:1789431559.148636:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+425:14616:x1876351933379328:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4800us (5430us total) trans 4295120807 rc 0/0
00000100:00100000:0.0:1789431559.148647:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295638
00010000:00010000:0.0:1789431559.151107:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.151129:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.151138:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.151145:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.151151:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.151161:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.151180:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x7b807097 (ffff90cf08772400)
00010000:00010000:0.0:1789431559.151184:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.151191:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.151199:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523f6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431559.155675:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.155749:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933379584
00000100:00100000:0.0:1789431559.155777:0:14501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933379584
00000100:00100000:0.0:1789431559.155846:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8170
00000100:00100000:0.0:1789431559.155859:0:14501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+111:2348:x1876351933379584:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.155883:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.155910:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e6d2028/0xd8e438fb63523f84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c83af expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789431559.155954:0:14501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x505:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431559.155981:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x505:0x0].0x0 since=3017s v=(0 0)
00010000:00010000:0.0:1789431559.155987:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x505:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431559.155998:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e6d2028/0xd8e438fb63523f84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83af expref: 112 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.156018:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e6d2028/0xd8e438fb63523f84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83af expref: 112 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.156035:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6ae00, rc 0)
00000100:00100000:0.0:1789431559.156712:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+112:2348:x1876351933379584:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 850us (1046us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431559.156721:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8170
00000100:00100000:1.0:1789431559.159804:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.160228:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933379840
00000100:00100000:0.0:1789431559.160241:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933379840
00000100:00100000:0.0:1789431559.160619:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295639
00000100:00100000:0.0:1789431559.160634:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+422:14617:x1876351933379840:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.160670:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.160674:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431559.160712:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523f5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83a1 expref: 422 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.160738:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.160745:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431559.160780:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523f8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c83b6 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.160961:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.160991:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.161002:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.161020:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63523f99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.161029:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63523f99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.161036:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63523f99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431559.161787:0:6797:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x506:0x0], index 0: 0
00010000:00010000:0.0:1789431559.162012:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523fa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a88:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.162027:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a88:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.162044:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a88:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.162119:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.162127:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f92 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.162135:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.162143:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b5e1800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.162148:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.162157:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.162170:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.162174:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.162180:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f92 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.162186:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63523f92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431559.162202:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001b1c23e2 reply state 00000000960d5a61 transno 4295120808 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63523f99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.162211:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431559.162253:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523f8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83b6 expref: 424 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.162273:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a88:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83b6 expref: 423 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.162282:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a88:0x0].0x0 (ffff90cf08772400)
00010000:00010000:0.0:1789431559.162285:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431559.162288:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6ba00, rc 0)
00000100:00100000:0.0:1789431559.162385:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+424:14617:x1876351933379840:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1754us (2594us total) trans 4295120808 rc 0/0
00000100:00100000:0.0:1789431559.162396:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295639
00000100:00100000:3.0:1789431559.164254:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431559.167550:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63523f99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.167570:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63523f99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.167578:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63523f99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.167584:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b5e1c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.167983:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63523f99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.167998:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431559.167999:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63523f99 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.168025:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xd940be10 (ffff90ce0f6c6600)
00010000:00010000:3.0:1789431559.168029:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.168035:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63523f99 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.168043:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63523f99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431559.174614:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933380480
00000100:00100000:3.0:1789431559.174627:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933380480
00000100:00100000:3.0:1789431559.174693:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933380736
00000100:00100000:3.0:1789431559.174697:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933380736
00000100:00100000:3.0:1789431559.174793:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12378
00000100:00100000:3.0:1789431559.174807:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+425:14616:x1876351933380480:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431559.175152:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+426:14616:x1876351933380480:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 346us (734us total) trans 4295120810 rc 0/0
00000100:00100000:3.0:1789431559.175161:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12378
00000100:00100000:3.0:1789431559.175183:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12379
00000100:00100000:3.0:1789431559.175190:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0776a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+425:14617:x1876351933380736:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431559.175572:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0776a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+426:14617:x1876351933380736:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 380us (1077us total) trans 4295120811 rc 0/0
00000100:00100000:3.0:1789431559.175579:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12379
00000100:00100000:0.0:1789431559.190694:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.190816:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933380992
00000100:00100000:3.0:1789431559.190831:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933380992
00000100:00100000:3.0:1789431559.190996:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295640
00000100:00100000:3.0:1789431559.191009:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+426:14616:x1876351933380992:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431559.191120:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431559.191161:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63523f76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a87:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83a8 expref: 426 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.191186:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a87:0x0].0x0 (ffff90ce0f6c6f00)
00010000:00010000:3.0:1789431559.191201:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431559.191233:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523fb5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.191250:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523fb5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.191262:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523fb5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.191279:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523fbc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.191417:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523fbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.191428:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523fbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.191578:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63523fc3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a87:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.191588:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63523fc3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a87:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.191596:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63523fc3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a87:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431559.192937:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1202, 64 off85184
00010000:00010000:3.0:1789431559.193026:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523fca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193043:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523fca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a87:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193080:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523fca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a87:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193089:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523fca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a87:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193097:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523fca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a87:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193103:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523fca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a87:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193121:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431559.193148:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63523fc3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a87:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193154:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63523fc3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a87:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193161:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63523fc3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a87:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193172:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f76400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.193176:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63523fc3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a87:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193185:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63523fc3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a87:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193196:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a87:0x0].0x0 (ffff90ce2154d600)
00010000:00010000:3.0:1789431559.193199:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431559.193205:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63523fc3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a87:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193209:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63523fc3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a87:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193228:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523fb5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193232:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523fb5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193236:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523fb5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193239:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f77a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.193241:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523fb5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193244:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523fb5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193253:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431559.193256:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.193258:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523fb5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.193264:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63523fb5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431559.193273:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006c2085d9 reply state 00000000113a6945 transno 4295120812 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63523fbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431559.193283:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431559.193400:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+427:14616:x1876351933380992:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2388us (2717us total) trans 4295120812 rc 0/0
00000100:00100000:3.0:1789431559.193410:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295640
00010000:00010000:0.0:1789431559.193741:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431559.193750:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523fca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a87:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.193768:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00030e00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431559.193773:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523fca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a87:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.193781:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523fca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a87:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.193792:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a87:0x0].0x0 (ffff90ce2154d600)
00010000:00010000:0.0:1789431559.193795:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431559.193798:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523fca lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a87:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.193805:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63523fca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a87:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.193826:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431559.193829:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431559.193831:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431559.195524:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.195726:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933381248
00000100:00100000:0.0:1789431559.195739:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933381248
00000100:00100000:0.0:1789431559.195818:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295641
00000100:00100000:0.0:1789431559.195831:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+427:14617:x1876351933381248:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431559.195907:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431559.195938:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63523fa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a88:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83b6 expref: 427 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.195957:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a88:0x0].0x0 (ffff90cf08772400)
00010000:00010000:0.0:1789431559.195970:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431559.195999:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523fd1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.196016:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523fd1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.196028:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523fd1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.196045:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523fd8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.196084:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.196091:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.196236:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523fdf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a88:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.196246:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523fdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a88:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.196254:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523fdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a88:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:0.0:1789431559.196974:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1201, 64 off85056
00010000:00010000:0.0:1789431559.197092:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523fe6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a88:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.197106:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a88:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.197116:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a88:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.197126:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523fe6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a88:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.197133:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523fe6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a88:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.197141:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb63523fe6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a88:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.197167:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431559.197193:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523fdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a88:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.197205:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523fdf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a88:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.197211:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523fdf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a88:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.197217:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.197223:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523fdf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a88:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.197231:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523fdf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a88:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.197241:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a88:0x0].0x0 (ffff90ce2e707c00)
00010000:00010000:0.0:1789431559.197244:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431559.197248:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523fdf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a88:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.197255:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63523fdf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a88:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.197276:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523fd1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.197282:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523fd1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.200084:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523fd1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.200092:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6b800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.200096:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523fd1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.200104:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523fd1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.200118:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.200121:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.200124:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523fd1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.200130:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63523fd1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431559.200152:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000078d8eb85 reply state 00000000251deef0 transno 4295120813 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.200163:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431559.200303:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+427:14617:x1876351933381248:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 4467us (4785us total) trans 4295120813 rc 0/0
00000100:00100000:0.0:1789431559.200314:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295641
00000100:00100000:1.0:1789431559.201306:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431559.205998:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.206024:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523fd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.206033:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523fd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.206040:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.206045:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523fd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.206081:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523fd8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.206107:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xd940be10 (ffff90ce2e707100)
00010000:00010000:3.0:1789431559.206110:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.206117:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523fd8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.206124:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63523fd8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.209304:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.209540:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.209827:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933381504
00000100:00100000:0.0:1789431559.209841:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933381504
00000100:00100000:0.0:1789431559.209998:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933381632
00000100:00100000:0.0:1789431559.210003:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933381632
00000100:00100000:3.0:1789431559.210044:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295643
00000100:00100000:3.0:1789431559.210080:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+427:14616:x1876351933381504:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431559.210114:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431559.210142:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63524002 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c83cb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210229:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524009 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210248:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210261:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431559.210320:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:3.0:1789431559.210324:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431559.210349:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210382:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63524002 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83cb expref: 429 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210409:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524009 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83cb expref: 428 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210420:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431559.210423:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431559.210428:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf00030e00, rc 0)
00000100:00100000:3.0:1789431559.210514:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+428:14616:x1876351933381504:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 439us (1229us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431559.210522:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295643
00000100:00100000:3.0:1789431559.210548:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295644
00000100:00100000:3.0:1789431559.210556:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+427:14617:x1876351933381632:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431559.210565:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431559.210576:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524010 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c83d2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210612:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524017 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210623:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524017 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210630:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524017 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210648:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352401e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210660:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352401e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210667:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352401e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210738:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524017 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210746:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524017 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210763:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524017 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210770:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f77a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.210775:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524017 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210783:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524017 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210794:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431559.210796:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.210801:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524017 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210807:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524017 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210818:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352401e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210825:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352401e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210831:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352401e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210836:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f76400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.210839:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352401e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210846:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352401e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210853:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xec46fc5c (ffff90ce2154d300)
00010000:00010000:3.0:1789431559.210856:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.210859:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352401e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210865:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352401e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210910:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524010 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83d2 expref: 428 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210922:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431559.210926:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.210930:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524010 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83d2 expref: 428 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.210945:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37f77c00, rc 0)
00000100:00100000:3.0:1789431559.210974:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+427:14617:x1876351933381632:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 419us (1435us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431559.210982:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295644
00000100:00100000:0.0:1789431559.218395:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933381760
00000100:00100000:0.0:1789431559.218409:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933381760
00000100:00100000:0.0:1789431559.218485:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295645
00000100:00100000:0.0:1789431559.218497:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+427:14617:x1876351933381760:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.218525:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.218554:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524025 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c83d9 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.218644:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb6352402c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.218663:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb6352402c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.218678:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb6352402c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431559.218728:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:0.0:1789431559.218737:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431559.218771:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb6352402c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.218801:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524025 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83d9 expref: 429 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.218823:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb6352402c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83d9 expref: 428 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.218832:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.218835:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431559.218840:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6a600, rc 0)
00000100:00100000:0.0:1789431559.218920:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+428:14617:x1876351933381760:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 425us (650us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431559.218927:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295645
00000100:00100000:1.0:1789431559.227446:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933381888
00000100:00100000:1.0:1789431559.227461:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933381888
00000100:00100000:1.0:1789431559.227537:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12380
00000100:00100000:1.0:1789431559.227551:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+428:14616:x1876351933381888:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431559.235629:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933382016
00000100:00100000:3.0:1789431559.235642:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933382016
00000100:00100000:3.0:1789431559.235767:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12381
00000100:00100000:3.0:1789431559.235789:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+429:14617:x1876351933382016:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431559.239480:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+430:14616:x1876351933381888:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 11914us (12201us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431559.239500:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12380
00000100:00100000:3.0:1789431559.241377:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+428:14617:x1876351933382016:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 5576us (6042us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431559.241392:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12381
00000100:00100000:1.0:1789431559.249557:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.251828:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933382272
00000100:00100000:3.0:1789431559.251850:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933382272
00000100:00100000:3.0:1789431559.251933:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295646
00000100:00100000:3.0:1789431559.251945:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+428:14616:x1876351933382272:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431559.251972:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431559.252002:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524033 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c83e0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.252421:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933382528
00000100:00100000:1.0:1789431559.252427:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933382528
00000100:00100000:1.0:1789431559.252473:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295647
00000100:00100000:1.0:1789431559.252482:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+430:14617:x1876351933382528:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.252492:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.252495:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:1.0:1789431559.252523:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb6352402c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83d9 expref: 430 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.252543:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431559.252551:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431559.252560:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352403a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c83e7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.252693:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63524041 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.252711:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63524041 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.252723:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63524041 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.252741:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524048 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.252748:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524048 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.252765:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524048 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:1.0:1789431559.253461:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x506:0x0], index 1: 0
00010000:00010000:1.0:1789431559.253698:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb6352404f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a89:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.253711:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb6352404f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a89:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.253721:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb6352404f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a89:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.253786:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63524041 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.253794:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63524041 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.253801:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63524041 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.253808:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a4a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.253814:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63524041 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.253822:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63524041 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.253835:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431559.253838:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.253842:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63524041 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.253849:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63524041 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431559.253863:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001b8a311a reply state 00000000880bd4fc transno 4295120814 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524048 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.253873:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431559.253910:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352403a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83e7 expref: 432 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.253930:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb6352404f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a89:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83e7 expref: 431 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.253938:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a89:0x0].0x0 (ffff90cf11d83f00)
00010000:00010000:1.0:1789431559.253940:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431559.253943:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce387a5400, rc 0)
00000100:00100000:1.0:1789431559.254037:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+432:14617:x1876351933382528:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1555us (1702us total) trans 4295120814 rc 0/0
00000100:00100000:1.0:1789431559.254046:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295647
00010000:00010000:3.0:1789431559.255273:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352405d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255481:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352405d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255495:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352405d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255517:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524064 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255525:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255532:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255593:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352405d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255602:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352405d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255608:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352405d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255615:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f76400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.255619:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352405d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255626:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352405d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255638:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431559.255640:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.255645:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352405d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255652:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352405d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255668:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255674:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524064 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255680:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524064 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255685:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f77a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.255688:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524064 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255694:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524064 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255702:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x6ed7d01b (ffff90ce2154d300)
00010000:00010000:3.0:1789431559.255704:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.255706:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524064 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255712:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63524064 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255765:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524033 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83e0 expref: 431 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255777:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431559.255779:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:3.0:1789431559.255783:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524033 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83e0 expref: 431 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.255793:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37f77c00, rc 0)
00000100:00100000:3.0:1789431559.255870:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+430:14616:x1876351933382272:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3927us (6328us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431559.255879:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295646
00010000:00010000:0.0:1789431559.265205:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524048 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.265232:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524048 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.265241:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524048 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.265249:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.265255:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524048 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.265263:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524048 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.265295:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xec46fc5c (ffff90cf04a08a00)
00010000:00010000:0.0:1789431559.265300:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.265307:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524048 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.265314:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524048 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.266485:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.267870:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933382656
00000100:00100000:0.0:1789431559.267881:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933382656
00000100:00100000:0.0:1789431559.267988:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295648
00000100:00100000:0.0:1789431559.267999:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+429:14616:x1876351933382656:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.268023:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.268045:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524072 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c83ee expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268159:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524079 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268176:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524079 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268190:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524079 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268208:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524080 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268215:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268222:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268433:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524079 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268442:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524079 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268449:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524079 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268455:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.268460:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524079 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268473:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524079 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268486:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431559.268489:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.268496:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524079 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268503:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524079 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268518:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268524:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524080 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268530:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268535:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6b800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.268538:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268544:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524080 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268550:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x7b807097 (ffff90ce2e707100)
00010000:00010000:0.0:1789431559.268553:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.268555:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524080 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268562:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524080 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268598:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524072 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83ee expref: 430 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268610:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431559.268613:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.268617:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524072 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83ee expref: 430 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.268626:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6ba00, rc 0)
00000100:00100000:0.0:1789431559.268832:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+429:14616:x1876351933382656:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 834us (3321us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431559.268841:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295648
00000100:00100000:1.0:1789431559.274558:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.281111:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.281226:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933383296
00000100:00100000:0.0:1789431559.281241:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933383296
00000100:00100000:0.0:1789431559.281322:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295649
00000100:00100000:0.0:1789431559.281336:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+430:14616:x1876351933383296:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.281366:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.281370:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431559.281414:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524009 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83cb expref: 430 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.281440:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431559.281448:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431559.281467:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63524087 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c83fc expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.281621:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352408e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.281638:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352408e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.281649:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352408e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.281668:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524095 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.281675:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524095 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.281682:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524095 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431559.282356:0:12775:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x507:0x0], index 0: 0
00010000:00010000:0.0:1789431559.282578:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb6352409c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a8a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.282590:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb6352409c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.282598:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb6352409c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.282642:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352408e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.282650:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352408e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.282657:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352408e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.282663:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.282668:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352408e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.282676:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352408e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.282688:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431559.282691:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.282696:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352408e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.282702:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb6352408e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431559.282716:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ccfecd5f reply state 00000000fb46abae transno 4295120816 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524095 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.282725:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431559.282772:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63524087 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83fc expref: 432 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.282788:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb6352409c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83fc expref: 431 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.282802:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8a:0x0].0x0 (ffff90cf04a08a00)
00010000:00010000:0.0:1789431559.282804:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431559.282807:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b5e1c00, rc 0)
00000100:00100000:0.0:1789431559.282906:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+432:14616:x1876351933383296:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1573us (1856us total) trans 4295120816 rc 0/0
00000100:00100000:0.0:1789431559.282915:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295649
00010000:00010000:3.0:1789431559.288332:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524095 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.288358:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524095 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.288367:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524095 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.288373:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.288379:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524095 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.288389:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524095 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.288410:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x7b807097 (ffff90ce2e707c00)
00010000:00010000:3.0:1789431559.288413:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.288419:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524095 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.288425:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524095 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431559.293208:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.293506:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933383552
00000100:00100000:0.0:1789431559.293522:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933383552
00000100:00100000:0.0:1789431559.293612:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295650
00000100:00100000:0.0:1789431559.293624:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+431:14617:x1876351933383552:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431559.293714:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431559.293750:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb6352404f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a89:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83e7 expref: 431 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.293782:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a89:0x0].0x0 (ffff90cf11d83f00)
00010000:00010000:0.0:1789431559.293799:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431559.293885:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635240aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.293905:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635240aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.293917:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635240aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.293936:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635240b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.293944:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635240b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.293951:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635240b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.294129:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635240b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a89:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.294139:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635240b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a89:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.294146:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635240b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a89:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431559.294811:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1203, 64 off85248
00010000:00010000:1.0:1789431559.294887:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635240bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a89:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.294899:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635240bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a89:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.294908:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635240bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a89:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.294916:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635240bf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a89:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.294923:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635240bf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a89:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.294930:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635240bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a89:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.294948:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431559.294977:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635240b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a89:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.294988:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635240b8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a89:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.294994:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635240b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a89:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.294999:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.295004:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635240b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a89:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.295012:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635240b8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a89:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.295023:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a89:0x0].0x0 (ffff90cf04d11600)
00010000:00010000:1.0:1789431559.295026:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431559.295031:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635240b8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a89:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.295038:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635240b8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a89:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.295077:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635240aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.295084:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635240aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.295090:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635240aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.295095:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.295098:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635240aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.295105:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635240aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.295112:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431559.295115:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.295118:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635240aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.295125:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635240aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431559.295136:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ddca446c reply state 00000000d0c58fd8 transno 4295120817 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635240b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.295145:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431559.295263:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+432:14617:x1876351933383552:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1637us (2063us total) trans 4295120817 rc 0/0
00000100:00100000:1.0:1789431559.295272:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295650
00000100:00100000:1.0:1789431559.296742:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.316777:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933384064
00000100:00100000:1.0:1789431559.316801:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933384064
00000100:00100000:1.0:1789431559.316997:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12383
00000100:00100000:1.0:1789431559.317016:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+432:14616:x1876351933384064:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431559.317519:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+433:14616:x1876351933384064:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 507us (1310us total) trans 4295120818 rc 0/0
00010000:00010000:0.0:1789431559.317594:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635240b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.317609:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635240b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.317620:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635240b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.317628:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.317635:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635240b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.317645:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635240b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.317666:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xec46fc5c (ffff90cf11d83d00)
00010000:00010000:0.0:1789431559.317670:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.317676:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635240b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.317683:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635240b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.320384:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933383808
00000100:00100000:0.0:1789431559.320406:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933383808
00000100:00100000:0.0:1789431559.320504:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295651
00000100:00100000:0.0:1789431559.320518:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+433:14617:x1876351933383808:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.320546:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.320589:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb635240cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c840a expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.320684:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635240d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.320704:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635240d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.320719:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635240d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.320743:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635240db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.320751:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635240db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.320769:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635240db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.320847:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635240d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.320856:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635240d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.320863:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635240d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.320870:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.320874:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635240d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.320883:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635240d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.321171:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.321175:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.321183:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635240d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.321190:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635240d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.321205:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635240db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.321212:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635240db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.321218:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635240db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.321223:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.321226:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635240db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.321232:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635240db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.321238:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x6ed7d01b (ffff90cf11d83f00)
00010000:00010000:0.0:1789431559.321241:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.321244:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635240db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.321249:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635240db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.321294:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb635240cd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c840a expref: 434 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.321306:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.321309:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.321313:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb635240cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c840a expref: 434 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.321324:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b5e1800, rc 0)
00000100:00100000:0.0:1789431559.321410:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+433:14617:x1876351933383808:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 895us (5402us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431559.321418:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295651
00000100:00100000:1.0:1789431559.324072:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12383
00000100:00100000:0.0:1789431559.337728:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933384192
00000100:00100000:0.0:1789431559.337743:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933384192
00000100:00100000:0.0:1789431559.337823:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933384448
00000100:00100000:0.0:1789431559.337827:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933384448
00000100:00100000:0.0:1789431559.337872:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295652
00000100:00100000:0.0:1789431559.337885:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+433:14617:x1876351933384192:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.337927:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.337955:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635240e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8411 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.338083:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635240e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.338101:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635240e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.338113:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635240e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431559.338160:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:0.0:1789431559.338164:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431559.338186:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635240e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.338221:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb635240e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8411 expref: 435 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.338245:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635240e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8411 expref: 434 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.338256:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.338259:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431559.338264:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6a800, rc 0)
00000100:00100000:0.0:1789431559.338350:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+434:14617:x1876351933384192:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 468us (809us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431559.338358:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295652
00000100:00100000:0.0:1789431559.338386:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295653
00000100:00100000:0.0:1789431559.338394:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+433:14616:x1876351933384448:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431559.338427:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431559.338446:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb6352409c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83fc expref: 433 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.338457:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8a:0x0].0x0 (ffff90cf04a08a00)
00010000:00010000:0.0:1789431559.338467:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431559.338482:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635240f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.338493:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635240f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.338500:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635240f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.338516:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb635240f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.338523:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb635240f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.338529:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb635240f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.338669:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635240fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a8a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.338678:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635240fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a8a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.338685:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635240fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a8a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:0.0:1789431559.339386:0:12775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1202, 64 off85120
00010000:00010000:0.0:1789431559.339462:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524105 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a8a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339474:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524105 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a8a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339483:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524105 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a8a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339492:0:12775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524105 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a8a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339498:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524105 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a8a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339506:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524105 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a8a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339534:0:12775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431559.339555:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635240fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a8a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339561:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635240fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a8a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339568:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635240fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a8a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339574:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6b800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.339579:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635240fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a8a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339587:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635240fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a8a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339597:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8a:0x0].0x0 (ffff90cf11d83d00)
00010000:00010000:0.0:1789431559.339599:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431559.339604:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635240fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a8a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339611:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635240fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a8a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339631:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635240f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339642:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635240f0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339648:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635240f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339653:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.339656:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635240f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339662:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635240f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339670:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431559.339673:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.339676:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635240f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.339682:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6bc00/0xd8e438fb635240f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431559.339691:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001954f182 reply state 000000006b5b36ea transno 4295120819 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb635240f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.339700:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431559.339791:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+434:14616:x1876351933384448:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1394us (2168us total) trans 4295120819 rc 0/0
00000100:00100000:0.0:1789431559.339799:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295653
00010000:00010000:3.0:1789431559.339809:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431559.339818:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524105 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a8a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.339824:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431559.339828:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524105 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a8a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.339834:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524105 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a8a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.339845:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8a:0x0].0x0 (ffff90cf11d83d00)
00010000:00010000:3.0:1789431559.339847:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431559.339850:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524105 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a8a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.340124:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524105 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a8a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.340143:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431559.340145:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431559.340146:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431559.345548:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb635240f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.345572:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb635240f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.345581:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb635240f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.345589:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.345595:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb635240f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.345605:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb635240f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.345626:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x7b807097 (ffff90cf11d83f00)
00010000:00010000:3.0:1789431559.345629:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.345634:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb635240f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.345641:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb635240f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.348404:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933384576
00000100:00100000:0.0:1789431559.348419:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933384576
00000100:00100000:0.0:1789431559.348504:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295654
00000100:00100000:0.0:1789431559.348517:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+433:14616:x1876351933384576:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.348552:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.348581:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352410c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8418 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.348672:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524113 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.348689:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524113 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.348703:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524113 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.348721:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb6352411a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.348730:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb6352411a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.348736:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb6352411a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.348816:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524113 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.348825:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524113 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.348832:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524113 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.348840:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b5e1c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.348845:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524113 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.348854:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524113 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.348869:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431559.348872:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.348878:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524113 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.348885:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524113 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.349015:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb6352411a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.349022:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb6352411a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.349028:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb6352411a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.349032:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b5e1800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.349035:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb6352411a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.349040:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb6352411a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.349189:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x6ed7d01b (ffff90cf04a08a00)
00010000:00010000:0.0:1789431559.349191:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.349195:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb6352411a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.349201:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb6352411a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.349241:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352410c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8418 expref: 434 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.349252:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431559.349254:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.349258:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352410c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8418 expref: 434 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.349269:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6aa00, rc 0)
00000100:00100000:0.0:1789431559.349393:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+433:14616:x1876351933384576:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 878us (1271us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431559.349401:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295654
00000100:00100000:0.0:1789431559.349505:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933384704
00000100:00100000:0.0:1789431559.349513:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933384704
00000100:00100000:0.0:1789431559.349556:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12384
00000100:00100000:0.0:1789431559.349565:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07768050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+433:14617:x1876351933384704:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431559.362965:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.362966:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07768050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+433:14617:x1876351933384704:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 13395us (14703us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431559.362981:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12384
00000100:00100000:3.0:1789431559.363011:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933384832
00000100:00100000:3.0:1789431559.363022:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933384832
00000100:00100000:3.0:1789431559.363090:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295655
00000100:00100000:3.0:1789431559.363102:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+433:14616:x1876351933384832:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431559.363128:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431559.363157:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524121 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c841f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.363252:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524128 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.363272:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.363292:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431559.363692:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:3.0:1789431559.363698:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431559.363722:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.363770:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524121 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c841f expref: 435 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.363793:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c841f expref: 434 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.363804:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431559.363808:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431559.363813:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6a600, rc 0)
00000100:00100000:3.0:1789431559.364075:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+434:14616:x1876351933384832:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 753us (901us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431559.364084:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295655
00000100:00100000:0.0:1789431559.368904:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.368991:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933384960
00000100:00100000:3.0:1789431559.369005:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933384960
00000100:00100000:3.0:1789431559.369104:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12385
00000100:00100000:3.0:1789431559.369117:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf087a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+434:14616:x1876351933384960:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431559.372847:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.382221:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf087a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+434:14616:x1876351933384960:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 13089us (13322us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431559.382239:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12385
00000100:00100000:0.0:1789431559.393716:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.393905:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933385600
00000100:00100000:1.0:1789431559.393920:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933385600
00000100:00100000:1.0:1789431559.394003:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295657
00000100:00100000:1.0:1789431559.394016:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+434:14616:x1876351933385600:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.394045:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.394122:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63524144 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8434 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394246:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352414b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394266:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352414b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394281:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352414b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394300:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524152 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394378:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394386:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394479:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352414b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394489:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352414b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394497:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352414b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394504:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.394510:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352414b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394518:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352414b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394531:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.394534:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.394540:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352414b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394547:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352414b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394563:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394570:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524152 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394576:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394581:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.394585:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394591:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524152 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394598:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x6ed7d01b (ffff90cf04d11b00)
00010000:00010000:1.0:1789431559.394601:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.394604:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524152 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394610:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524152 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394653:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63524144 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8434 expref: 435 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394665:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.394668:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:1.0:1789431559.394672:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63524144 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8434 expref: 435 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.394682:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522200, rc 0)
00000100:00100000:1.0:1789431559.394985:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+434:14616:x1876351933385600:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 969us (1283us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431559.394995:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295657
00000100:00100000:0.0:1789431559.402587:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.404027:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933385344
00000100:00100000:1.0:1789431559.404044:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933385344
00000100:00100000:1.0:1789431559.404175:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295658
00000100:00100000:1.0:1789431559.404187:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+434:14617:x1876351933385344:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.404214:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.404242:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63524159 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c842d expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404336:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524160 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404355:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524160 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404368:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524160 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404384:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524167 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404391:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404397:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404463:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524160 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404470:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524160 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404477:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524160 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404484:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.404490:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524160 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404499:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524160 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404511:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431559.404515:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.404520:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524160 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404527:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63524160 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404543:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404549:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524167 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404555:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404560:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.404563:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404568:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524167 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404574:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xec46fc5c (ffff90cf04d11b00)
00010000:00010000:1.0:1789431559.404576:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.404579:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524167 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404586:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524167 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404617:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63524159 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c842d expref: 435 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404626:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431559.404628:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.404632:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63524159 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c842d expref: 435 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.404641:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522200, rc 0)
00000100:00100000:1.0:1789431559.404716:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+434:14617:x1876351933385344:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 532us (2144us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431559.404723:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295658
00000100:00100000:1.0:1789431559.409798:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933385728
00000100:00100000:1.0:1789431559.409813:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933385728
00000100:00100000:1.0:1789431559.409911:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295659
00000100:00100000:1.0:1789431559.409924:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+434:14616:x1876351933385728:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.409953:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.409982:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352416e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c843b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.410107:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524175 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.410132:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524175 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.410148:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524175 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.410164:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352417c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.410171:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352417c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.410178:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352417c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.410251:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524175 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.410260:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524175 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.410268:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524175 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.410275:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.410280:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524175 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.411354:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524175 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.411376:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.411379:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.411386:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524175 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.411394:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524175 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.411412:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352417c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.411419:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352417c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.411426:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352417c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.411432:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.411435:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352417c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.411441:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352417c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.411449:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x7b807097 (ffff90cf04d11b00)
00010000:00010000:1.0:1789431559.411452:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.411454:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352417c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.411459:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352417c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.411510:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352416e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c843b expref: 435 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.411521:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.411524:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.411527:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352416e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c843b expref: 435 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.411537:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522200, rc 0)
00000100:00100000:1.0:1789431559.411631:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+434:14616:x1876351933385728:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1709us (1968us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431559.411641:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295659
00000100:00100000:1.0:1789431559.425133:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933385984
00000100:00100000:1.0:1789431559.425149:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933385984
00000100:00100000:1.0:1789431559.425228:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295660
00000100:00100000:1.0:1789431559.425242:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+434:14617:x1876351933385984:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.425269:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.425273:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:1.0:1789431559.425318:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635240e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8411 expref: 434 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.425344:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431559.425350:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431559.425368:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63524183 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8442 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.425523:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352418a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.425541:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352418a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.425553:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352418a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.425569:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524191 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.425577:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524191 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.425584:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524191 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:1.0:1789431559.426293:0:12181:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x507:0x0], index 1: 0
00010000:00010000:1.0:1789431559.426502:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63524198 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a8b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.426517:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63524198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.426526:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63524198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.426563:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352418a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.426576:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352418a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.426584:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352418a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.426591:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.426597:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352418a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.426606:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352418a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.426617:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431559.426621:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.426626:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352418a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.426633:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352418a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431559.426647:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004868a45b reply state 0000000070d3e332 transno 4295120820 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524191 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.426657:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431559.426692:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63524183 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8442 expref: 436 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.426707:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63524198 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8442 expref: 435 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.426721:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8b:0x0].0x0 (ffff90cf04d11600)
00010000:00010000:1.0:1789431559.426724:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431559.426727:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523a00, rc 0)
00000100:00100000:1.0:1789431559.426825:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+436:14617:x1876351933385984:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1586us (2083us total) trans 4295120820 rc 0/0
00000100:00100000:1.0:1789431559.426834:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295660
00000100:00100000:3.0:1789431559.427632:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933386112
00000100:00100000:3.0:1789431559.427644:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933386112
00002000:00100000:3.0:1789431559.427698:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4b3:0x0] (0->4095)  req@ffff90cf37e3d500 x1876351933386112/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 4584/0 e 0 to 0 dl 1789431570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431559.427710:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e3d500 with x1876351933386112 ext(0->4095)
00002000:00010000:3.0:1789431559.427717:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf37e3d500
00000100:00100000:3.0:1789431559.427741:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1527
00000100:00100000:3.0:1789431559.427751:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+118:2348:x1876351933386112:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:3.0:1789431559.428422:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+120:2348:x1876351933386112:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 665us (3565us total) trans 4294969576 rc 0/0
00000100:00100000:3.0:1789431559.428433:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1527
00002000:00100000:3.0:1789431559.428441:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4b3:0x0] (0->4095)  req@ffff90cf37e3d500 x1876351933386112/t4294969576(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 4584/448 e 0 to 0 dl 1789431570 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431559.428452:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e3d500 with x1876351933386112 ext(0->4095)
00002000:00010000:3.0:1789431559.428458:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf37e3d500
00000100:00100000:1.0:1789431559.429232:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.435654:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.435687:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933386496
00000100:00100000:1.0:1789431559.435698:0:14532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933386496
00002000:00100000:1.0:1789431559.435765:0:14532:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x4b6:0x0] (0->4095)  req@ffff90cf3c155500 x1876351933386496/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 4584/0 e 0 to 0 dl 1789431570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431559.435778:0:14532:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3c155500 with x1876351933386496 ext(0->4095)
00002000:00010000:1.0:1789431559.435785:0:14532:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3c155500
00000100:00100000:1.0:1789431559.435812:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1528
00000100:00100000:1.0:1789431559.435828:0:14532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+120:2348:x1876351933386496:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:1.0:1789431559.436419:0:14532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+122:2348:x1876351933386496:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 593us (767us total) trans 4294969577 rc 0/0
00000100:00100000:1.0:1789431559.436429:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1528
00002000:00100000:1.0:1789431559.436438:0:14532:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x4b6:0x0] (0->4095)  req@ffff90cf3c155500 x1876351933386496/t4294969577(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 4584/448 e 0 to 0 dl 1789431570 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431559.436448:0:14532:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3c155500 with x1876351933386496 ext(0->4095)
00002000:00010000:1.0:1789431559.436453:0:14532:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3c155500
00000100:00100000:1.0:1789431559.436585:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.436703:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933386624
00000100:00100000:1.0:1789431559.436710:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933386624
00002000:00100000:1.0:1789431559.436737:0:14440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x4b7:0x0] (0->19583)  req@ffff90ce36219c00 x1876351933386624/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 488/0 e 0 to 0 dl 1789431570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431559.436746:0:14440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce36219c00 with x1876351933386624 ext(0->19583)
00002000:00010000:1.0:1789431559.436750:0:14440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce36219c00
00000100:00100000:1.0:1789431559.436783:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1529
00000100:00100000:1.0:1789431559.436793:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+122:2347:x1876351933386624:12345-192.168.203.4@tcp:4:dbench.0
00010000:00010000:3.0:1789431559.437379:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524191 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.437396:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524191 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.437405:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524191 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.437412:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.437418:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524191 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.437431:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524191 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.437451:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xec46fc5c (ffff90cf04d11b00)
00010000:00010000:3.0:1789431559.437454:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.437460:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524191 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.437467:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63524191 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431559.437776:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+437:14616:x1876351933386368:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 5116us (8544us total) trans 4295120821 rc 0/0
00000100:00100000:2.0:1789431559.437789:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295661
00000100:00100000:0.0:1789431559.440598:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.440711:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933386752
00000100:00100000:2.0:1789431559.440724:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933386752
00002000:00100000:2.0:1789431559.440799:0:14461:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x4b8:0x0] (0->4095)  req@ffff90ce1a568e00 x1876351933386752/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 4584/0 e 0 to 0 dl 1789431570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431559.440811:0:14461:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce1a568e00 with x1876351933386752 ext(0->4095)
00002000:00010000:2.0:1789431559.440818:0:14461:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce1a568e00
00000100:00100000:2.0:1789431559.440858:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1530
00000100:00100000:2.0:1789431559.440869:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+124:2347:x1876351933386752:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:2.0:1789431559.441533:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+126:2347:x1876351933386752:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 660us (943us total) trans 4294969578 rc 0/0
00000100:00100000:2.0:1789431559.441543:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1530
00002000:00100000:2.0:1789431559.441553:0:14461:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x4b8:0x0] (0->4095)  req@ffff90ce1a568e00 x1876351933386752/t4294969578(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 4584/448 e 0 to 0 dl 1789431570 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431559.441562:0:14461:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce1a568e00 with x1876351933386752 ext(0->4095)
00002000:00010000:2.0:1789431559.441567:0:14461:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce1a568e00
00010000:00010000:3.0:1789431559.442251:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635241b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.442268:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635241b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.442277:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635241b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.442284:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.442289:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635241b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.442299:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635241b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.442319:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x7b807097 (ffff90ce359c6d00)
00010000:00010000:3.0:1789431559.442323:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.442330:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635241b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.442339:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635241b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431559.443440:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+126:2347:x1876351933386624:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 6635us (6842us total) trans 4294969579 rc 0/0
00000100:00100000:2.0:1789431559.443454:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1529
00002000:00100000:2.0:1789431559.443469:0:14440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x4b7:0x0] (0->19583)  req@ffff90ce36219c00 x1876351933386624/t4294969579(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 488/448 e 0 to 0 dl 1789431570 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431559.443480:0:14440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce36219c00 with x1876351933386624 ext(0->19583)
00002000:00010000:2.0:1789431559.443488:0:14440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce36219c00
00000100:00100000:1.0:1789431559.449395:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.449507:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933386880
00000100:00100000:2.0:1789431559.449521:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933386880
00002000:00100000:2.0:1789431559.449587:0:14439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x27:0x0] (0->4095)  req@ffff90cf3bc0a450 x1876351933386880/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 4584/0 e 0 to 0 dl 1789431570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431559.449599:0:14439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3bc0a450 with x1876351933386880 ext(0->4095)
00002000:00010000:2.0:1789431559.449607:0:14439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3bc0a450
00000100:00100000:2.0:1789431559.449649:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1531
00000100:00100000:2.0:1789431559.449661:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bc0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+126:2347:x1876351933386880:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:2.0:1789431559.450562:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bc0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+128:2347:x1876351933386880:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 894us (1174us total) trans 4294969580 rc 0/0
00000100:00100000:2.0:1789431559.450573:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1531
00002000:00100000:2.0:1789431559.450582:0:14439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x27:0x0] (0->4095)  req@ffff90cf3bc0a450 x1876351933386880/t4294969580(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 4584/448 e 0 to 0 dl 1789431570 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431559.450593:0:14439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3bc0a450 with x1876351933386880 ext(0->4095)
00002000:00010000:2.0:1789431559.450599:0:14439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3bc0a450
00000100:00100000:1.0:1789431559.457828:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.458258:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933387008
00000100:00100000:3.0:1789431559.458272:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933387008
00002000:00100000:3.0:1789431559.458339:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x26:0x0] (0->4095)  req@ffff90ce3621b480 x1876351933387008/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 4584/0 e 0 to 0 dl 1789431570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431559.458352:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce3621b480 with x1876351933387008 ext(0->4095)
00002000:00010000:3.0:1789431559.458361:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce3621b480
00000100:00100000:3.0:1789431559.458408:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1532
00000100:00100000:3.0:1789431559.458419:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+128:2348:x1876351933387008:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:3.0:1789431559.459011:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+130:2348:x1876351933387008:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 589us (1194us total) trans 4294969581 rc 0/0
00000100:00100000:3.0:1789431559.459020:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1532
00002000:00100000:3.0:1789431559.459029:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x26:0x0] (0->4095)  req@ffff90ce3621b480 x1876351933387008/t4294969581(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 4584/448 e 0 to 0 dl 1789431570 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431559.459037:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce3621b480 with x1876351933387008 ext(0->4095)
00002000:00010000:3.0:1789431559.459042:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce3621b480
00000100:00100000:2.0:1789431559.459368:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.459487:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.459511:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933387264
00000100:00100000:2.0:1789431559.459519:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933387264
00002000:00100000:2.0:1789431559.459557:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x27:0x0] (0->4095)  req@ffff90cf37e3d500 x1876351933387264/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 4584/0 e 0 to 0 dl 1789431570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431559.459568:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e3d500 with x1876351933387264 ext(0->4095)
00002000:00010000:2.0:1789431559.459572:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf37e3d500
00000100:00100000:2.0:1789431559.459588:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933387520
00000100:00100000:2.0:1789431559.459592:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933387520
00002000:00100000:2.0:1789431559.459610:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x26:0x0] (0->4095)  req@ffff90cf37e3e300 x1876351933387520/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 4584/0 e 0 to 0 dl 1789431570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431559.459618:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e3e300 with x1876351933387520 ext(0->4095)
00002000:00010000:2.0:1789431559.459622:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf37e3e300
00000100:00100000:2.0:1789431559.459641:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1533
00000100:00100000:2.0:1789431559.459651:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+114:2348:x1876351933387264:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:2.0:1789431559.460097:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+116:2348:x1876351933387264:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 446us (730us total) trans 4294969967 rc 0/0
00000100:00100000:2.0:1789431559.460106:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1533
00002000:00100000:2.0:1789431559.460113:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x27:0x0] (0->4095)  req@ffff90cf37e3d500 x1876351933387264/t4294969967(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 4584/448 e 0 to 0 dl 1789431570 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431559.460122:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e3d500 with x1876351933387264 ext(0->4095)
00002000:00010000:2.0:1789431559.460125:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf37e3d500
00000100:00100000:2.0:1789431559.460143:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1534
00000100:00100000:2.0:1789431559.460151:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+115:2348:x1876351933387520:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:2.0:1789431559.460367:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+117:2348:x1876351933387520:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 216us (879us total) trans 4294969968 rc 0/0
00000100:00100000:2.0:1789431559.460375:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1534
00002000:00100000:2.0:1789431559.460381:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x26:0x0] (0->4095)  req@ffff90cf37e3e300 x1876351933387520/t4294969968(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 4584/448 e 0 to 0 dl 1789431570 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431559.460390:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e3e300 with x1876351933387520 ext(0->4095)
00002000:00010000:2.0:1789431559.460393:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf37e3e300
00000100:00100000:2.0:1789431559.460453:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.460523:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.460545:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933387392
00000100:00100000:2.0:1789431559.460551:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933387392
00002000:00100000:2.0:1789431559.460572:0:14440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x25:0x0] (0->4095)  req@ffff90cf37e3c700 x1876351933387392/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 4584/0 e 0 to 0 dl 1789431570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431559.460582:0:14440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e3c700 with x1876351933387392 ext(0->4095)
00002000:00010000:2.0:1789431559.460586:0:14440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf37e3c700
00000100:00100000:2.0:1789431559.460609:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933387648
00000100:00100000:2.0:1789431559.460612:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933387648
00002000:00100000:2.0:1789431559.460626:0:14440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x25:0x0] (0->4095)  req@ffff90cf37e3c000 x1876351933387648/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 4584/0 e 0 to 0 dl 1789431570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431559.460635:0:14440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e3c000 with x1876351933387648 ext(0->4095)
00002000:00010000:2.0:1789431559.460639:0:14440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf37e3c000
00000100:00100000:2.0:1789431559.460653:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1535
00000100:00100000:2.0:1789431559.460661:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+117:2348:x1876351933387392:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:2.0:1789431559.460885:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+119:2348:x1876351933387392:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 223us (430us total) trans 4294969969 rc 0/0
00000100:00100000:2.0:1789431559.460893:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1535
00002000:00100000:2.0:1789431559.460899:0:14440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x25:0x0] (0->4095)  req@ffff90cf37e3c700 x1876351933387392/t4294969969(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 4584/448 e 0 to 0 dl 1789431570 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431559.460906:0:14440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e3c700 with x1876351933387392 ext(0->4095)
00002000:00010000:2.0:1789431559.460910:0:14440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf37e3c700
00000100:00100000:2.0:1789431559.460924:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1536
00000100:00100000:2.0:1789431559.460931:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+130:2348:x1876351933387648:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:2.0:1789431559.461183:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+132:2348:x1876351933387648:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 250us (657us total) trans 4294969582 rc 0/0
00000100:00100000:2.0:1789431559.461191:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1536
00002000:00100000:2.0:1789431559.461197:0:14440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x25:0x0] (0->4095)  req@ffff90cf37e3c000 x1876351933387648/t4294969582(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:30/0 lens 4584/448 e 0 to 0 dl 1789431570 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431559.461205:0:14440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e3c000 with x1876351933387648 ext(0->4095)
00002000:00010000:2.0:1789431559.461209:0:14440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf37e3c000
00000100:00100000:1.0:1789431559.462098:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.462220:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933387136
00000100:00100000:3.0:1789431559.462230:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933387136
00000100:00100000:3.0:1789431559.462285:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8174
00000100:00100000:3.0:1789431559.462296:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+119:2350:x1876351933387136:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431559.462313:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431559.462340:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cf5851c/0xd8e438fb635241c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8450 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431559.462371:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x507:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431559.462394:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x507:0x0].0x0 since=3017s v=(0 0)
00010000:00010000:3.0:1789431559.462400:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x507:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431559.462410:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cf5851c/0xd8e438fb635241c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8450 expref: 120 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.462433:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009cf5851c/0xd8e438fb635241c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8450 expref: 120 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.462448:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6bc00, rc 0)
00000100:00100000:3.0:1789431559.462493:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+120:2350:x1876351933387136:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 200us (402us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431559.462500:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8174
00000100:00100000:1.0:1789431559.464858:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.465032:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933387776
00000100:00100000:3.0:1789431559.465045:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933387776
00000100:00100000:2.0:1789431559.465421:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8175
00000100:00100000:2.0:1789431559.465434:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+132:2350:x1876351933387776:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431559.465457:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431559.465485:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c35d39f9/0xd8e438fb635241d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8457 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789431559.465523:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x508:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:2.0:1789431559.465548:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x508:0x0].0x0 since=3017s v=(0 0)
00010000:00010000:2.0:1789431559.465554:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x508:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431559.465566:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c35d39f9/0xd8e438fb635241d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8457 expref: 133 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.465586:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c35d39f9/0xd8e438fb635241d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8457 expref: 133 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.465602:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce249e3400, rc 0)
00000100:00100000:2.0:1789431559.465677:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+133:2350:x1876351933387776:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 246us (834us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431559.465685:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8175
00000100:00100000:2.0:1789431559.466355:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.466536:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933388032
00000100:00100000:3.0:1789431559.466542:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933388032
00000100:00100000:3.0:1789431559.466582:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12386
00000100:00100000:3.0:1789431559.466591:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+436:14617:x1876351933388032:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431559.467230:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+437:14617:x1876351933388032:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 635us (872us total) trans 4295120822 rc 0/0
00000100:00100000:3.0:1789431559.467240:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12386
00000100:00100000:0.0:1789431559.470197:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.470297:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933388288
00000100:00100000:1.0:1789431559.470310:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933388288
00000100:00100000:1.0:1789431559.470384:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12387
00000100:00100000:1.0:1789431559.470396:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+437:14616:x1876351933388288:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431559.471016:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+438:14616:x1876351933388288:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 618us (830us total) trans 4295120823 rc 0/0
00000100:00100000:1.0:1789431559.471027:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12387
00010000:00010000:0.0:1789431559.472182:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431559.473008:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.473217:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933388544
00000100:00100000:2.0:1789431559.473229:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933388544
00000100:00100000:2.0:1789431559.473335:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295662
00000100:00100000:2.0:1789431559.473348:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+438:14617:x1876351933388544:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431559.473456:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431559.473491:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63524198 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a8b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8442 expref: 438 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.473516:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8b:0x0].0x0 (ffff90cf04d11600)
00010000:00010000:2.0:1789431559.473533:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431559.473565:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635241d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.473581:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635241d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.473591:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635241d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.473609:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635241de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.473615:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635241de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.473622:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635241de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.473787:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635241e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a8b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.473796:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635241e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a8b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.473804:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635241e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a8b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431559.474730:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1204, 64 off85312
00010000:00010000:2.0:1789431559.474828:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635241ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a8b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.474843:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635241ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a8b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.474853:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635241ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a8b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.474862:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635241ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a8b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.474869:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635241ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a8b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.474875:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635241ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a8b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.475522:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431559.475559:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635241e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a8b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.475574:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635241e5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a8b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.475582:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635241e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a8b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.475589:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e1a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.475594:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635241e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a8b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.475603:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635241e5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a8b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.475618:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8b:0x0].0x0 (ffff90ce359c6b00)
00010000:00010000:2.0:1789431559.475621:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431559.475626:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635241e5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a8b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.475633:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635241e5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a8b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.475659:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635241d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.475667:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635241d7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.475673:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635241d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.475678:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce27814e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.475682:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635241d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.475688:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635241d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.475696:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.475699:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.475702:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635241d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.475709:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb635241d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431559.475718:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cb66654e reply state 000000008fe11f4c transno 4295120824 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635241de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431559.475728:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431559.475861:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+439:14617:x1876351933388544:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2510us (2856us total) trans 4295120824 rc 0/0
00000100:00100000:2.0:1789431559.475872:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295662
00010000:00010000:3.0:1789431559.476740:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431559.476764:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635241ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a8b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.476778:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e0000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431559.476781:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635241ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a8b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.476791:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635241ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a8b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.476806:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8b:0x0].0x0 (ffff90ce359c6b00)
00010000:00010000:3.0:1789431559.476809:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431559.476813:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635241ec lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a8b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.476819:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635241ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a8b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431559.476821:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431559.476947:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431559.476950:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431559.476952:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431559.477033:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933388800
00000100:00100000:1.0:1789431559.477045:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933388800
00000100:00100000:1.0:1789431559.477132:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295663
00000100:00100000:1.0:1789431559.477145:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+439:14616:x1876351933388800:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431559.477223:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431559.477246:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635241bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a8c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8449 expref: 439 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.477259:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8c:0x0].0x0 (ffff90ce359c6400)
00010000:00010000:1.0:1789431559.477266:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431559.477380:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635241f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.477398:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635241f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.477410:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635241f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.477429:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635241fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.477437:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635241fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.477444:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635241fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.477608:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524201 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a8c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.477618:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524201 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a8c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.477626:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524201 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a8c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431559.479730:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1203, 64 off85184
00000100:00100000:3.0:1789431559.480672:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.480774:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933388928
00000100:00100000:2.0:1789431559.480786:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933388928
00000100:00100000:2.0:1789431559.480857:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295664
00000100:00100000:2.0:1789431559.480871:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07452050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+440:14617:x1876351933388928:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431559.480969:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431559.480998:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb63524208 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c845e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481117:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352420f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481135:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352420f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481148:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352420f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481166:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524216 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481174:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481181:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481240:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352420f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481248:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352420f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481255:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352420f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481261:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.481266:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352420f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481275:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352420f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481471:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.481476:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.481482:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352420f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481489:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352420f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481508:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481514:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524216 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481520:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481526:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.481529:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481534:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524216 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481542:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x6ed7d01b (ffff90ce359c6a00)
00010000:00010000:2.0:1789431559.481544:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.481547:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524216 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481554:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524216 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481593:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb63524208 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c845e expref: 441 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481604:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.481607:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.481610:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb63524208 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c845e expref: 441 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.481620:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce156e0200, rc 0)
00010000:00010000:1.0:1789431559.481877:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb6352421d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a8c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.481899:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb6352421d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.481909:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb6352421d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.481917:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb6352421d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.481923:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb6352421d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.481929:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb6352421d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.481950:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431559.481973:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431559.481979:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb6352421d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.481985:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431559.481989:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb6352421d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.481998:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb6352421d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.482010:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8c:0x0].0x0 (ffff90ce03149900)
00010000:00010000:1.0:1789431559.482013:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431559.482016:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb6352421d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.482021:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb6352421d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.482032:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431559.482034:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431559.482036:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431559.482067:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524201 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a8c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.482074:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524201 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a8c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.482080:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524201 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a8c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.482086:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.482090:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524201 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a8c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.482095:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524201 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a8c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.482103:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8c:0x0].0x0 (ffff90ce03149900)
00010000:00010000:1.0:1789431559.482105:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431559.482108:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524201 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a8c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.482114:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524201 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a8c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.482137:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635241f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.482144:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635241f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.482150:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635241f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.482155:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a4a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.482158:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635241f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.482163:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635241f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.482172:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.482174:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.482177:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635241f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.482184:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635241f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431559.482197:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005c1098e1 reply state 0000000082c9bbaf transno 4295120825 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635241fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.482207:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431559.482225:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635241de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.482238:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635241de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.482247:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635241de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.482254:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e1800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.482258:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635241de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.482265:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635241de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.482277:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xec46fc5c (ffff90ce359c6700)
00010000:00010000:0.0:1789431559.482281:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.482285:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635241de lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431559.482317:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07452050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+441:14617:x1876351933388928:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1448us (1651us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431559.482328:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295664
00010000:00010000:0.0:1789431559.482416:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635241de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.482452:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+439:14616:x1876351933388800:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 5309us (5632us total) trans 4295120825 rc 0/0
00000100:00100000:1.0:1789431559.482462:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295663
00000100:00100000:1.0:1789431559.489462:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.489508:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.489584:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933389056
00000100:00100000:2.0:1789431559.489597:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933389056
00000100:00100000:2.0:1789431559.489667:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933389184
00000100:00100000:2.0:1789431559.489670:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933389184
00000100:00100000:2.0:1789431559.489703:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295665
00000100:00100000:2.0:1789431559.489715:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+440:14617:x1876351933389056:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431559.489747:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431559.489794:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524224 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8465 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.489805:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295666
00000100:00100000:0.0:1789431559.489819:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+441:14616:x1876351933389184:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.489829:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.489845:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb6352422b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c846c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.489884:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524232 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.489892:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63524239 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.489923:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63524239 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.489938:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63524239 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.489951:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524240 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.489960:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635241fa lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.489978:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524240 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.489998:0:5848:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635241fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.490008:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.490012:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524240 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.490026:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431559.490130:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:2.0:1789431559.490135:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431559.490159:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.490190:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524224 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8465 expref: 443 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.490208:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8465 expref: 442 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.490218:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.490221:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:2.0:1789431559.490224:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:2.0:1789431559.490470:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+442:14617:x1876351933389056:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 756us (1021us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431559.490478:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295665
00010000:00010000:3.0:1789431559.490615:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635241fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.490625:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635241fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.490634:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635241fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.490640:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.490644:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635241fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.490652:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635241fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.490665:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x7b807097 (ffff90cf04d11b00)
00010000:00010000:3.0:1789431559.490668:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.490671:0:3297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524240 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.490679:0:3297:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.490685:0:3297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524240 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.490718:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635241fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.490725:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635241fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.490798:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.490808:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.490883:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63524239 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.490891:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63524239 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.490898:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63524239 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.490903:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b5e1800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.490906:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63524239 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.490913:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63524239 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.490923:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431559.490925:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.490929:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63524239 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.490935:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1800/0xd8e438fb63524239 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.490946:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.490952:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524240 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.490958:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524240 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.490974:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e1800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.490978:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524240 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.490985:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524240 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.490993:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x7b807097 (ffff90cf04d11b00)
00010000:00010000:0.0:1789431559.490995:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.490998:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524240 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.491004:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524240 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.491038:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb6352422b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c846c expref: 440 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.491066:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431559.491069:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.491073:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb6352422b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c846c expref: 440 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.491084:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b5e1c00, rc 0)
00000100:00100000:0.0:1789431559.491120:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+439:14616:x1876351933389184:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1304us (1610us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431559.491128:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295666
00000100:00100000:2.0:1789431559.497375:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.497465:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933389312
00000100:00100000:3.0:1789431559.497479:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933389312
00000100:00100000:3.0:1789431559.497553:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295667
00000100:00100000:3.0:1789431559.497567:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+439:14616:x1876351933389312:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431559.497594:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431559.497623:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524247 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8473 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.497709:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6352424e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.497728:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6352424e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.497745:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6352424e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431559.497813:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:3.0:1789431559.497817:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431559.497839:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6352424e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.497871:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524247 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8473 expref: 441 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.497901:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6352424e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8473 expref: 440 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.497911:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431559.497914:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431559.497919:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6ba00, rc 0)
00000100:00100000:3.0:1789431559.498006:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+440:14616:x1876351933389312:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 441us (645us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431559.498013:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295667
00000100:00100000:1.0:1789431559.504178:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.504236:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.504337:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933389440
00000100:00100000:2.0:1789431559.504351:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933389440
00000100:00100000:2.0:1789431559.504411:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933389568
00000100:00100000:2.0:1789431559.504414:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933389568
00000100:00100000:2.0:1789431559.504447:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12388
00000100:00100000:2.0:1789431559.504457:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+441:14617:x1876351933389440:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431559.505342:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12389
00000100:00100000:0.0:1789431559.505362:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2acfc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+441:14616:x1876351933389568:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:2.0:1789431559.510909:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+442:14617:x1876351933389440:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 6427us (6724us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431559.510927:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12388
00000100:00100000:0.0:1789431559.512552:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2acfc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+440:14616:x1876351933389568:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 7182us (8298us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431559.512568:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12389
00000100:00100000:1.0:1789431559.519463:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.519551:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933389824
00000100:00100000:3.0:1789431559.519564:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933389824
00000100:00100000:3.0:1789431559.519633:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295668
00000100:00100000:3.0:1789431559.519646:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+440:14616:x1876351933389824:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431559.519674:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431559.519677:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431559.519712:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6352424e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8473 expref: 440 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.519731:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431559.519735:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431559.519748:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524255 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c847a expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.519940:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb6352425c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.519962:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb6352425c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.519976:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb6352425c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.519994:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524263 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.520002:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.520009:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431559.521030:0:12775:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x508:0x0], index 1: 0
00010000:00010000:0.0:1789431559.521346:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb6352426a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a8d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.521364:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb6352426a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.521376:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb6352426a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.521422:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb6352425c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.521430:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb6352425c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.521438:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb6352425c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.521445:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.521450:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb6352425c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.521459:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb6352425c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.521471:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431559.521475:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.521481:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb6352425c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.521488:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb6352425c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431559.521503:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000078d8eb85 reply state 00000000e53d9578 transno 4295120826 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.521513:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431559.521554:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524255 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c847a expref: 442 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.521571:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb6352426a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a8d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c847a expref: 441 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.521579:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8d:0x0].0x0 (ffff90cf04a08a00)
00010000:00010000:0.0:1789431559.521582:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431559.521584:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce156e1800, rc 0)
00000100:00100000:0.0:1789431559.521688:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+442:14616:x1876351933389824:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2045us (2239us total) trans 4295120826 rc 0/0
00000100:00100000:0.0:1789431559.521698:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295668
00010000:00010000:0.0:1789431559.527080:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.527105:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524263 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.527114:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524263 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.527121:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.527127:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524263 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.527136:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524263 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.527158:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x7b807097 (ffff90ce2154d400)
00010000:00010000:0.0:1789431559.527162:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.527168:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524263 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.527175:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524263 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.528346:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.529221:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933390080
00000100:00100000:3.0:1789431559.529237:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933390080
00000100:00100000:3.0:1789431559.529483:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295669
00000100:00100000:3.0:1789431559.529513:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+441:14617:x1876351933390080:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431559.529538:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431559.529561:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63524278 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8481 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.529636:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6352427f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.529652:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6352427f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.529664:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6352427f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.529681:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524286 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.529689:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.529696:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.529937:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6352427f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.529946:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6352427f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.529953:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6352427f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.529959:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.529963:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6352427f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.529973:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6352427f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.529984:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431559.529987:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.529992:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6352427f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.530570:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb6352427f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.530591:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.530600:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524286 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.530606:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524286 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.530612:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f894a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.530616:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524286 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.530622:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524286 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.530632:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x6ed7d01b (ffff90cf11d83f00)
00010000:00010000:3.0:1789431559.530635:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.530638:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524286 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.530644:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524286 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.530689:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63524278 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8481 expref: 442 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.530699:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431559.530702:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:3.0:1789431559.530706:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63524278 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8481 expref: 442 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.530716:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6aa00, rc 0)
00000100:00100000:2.0:1789431559.531239:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.531399:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933390208
00000100:00100000:1.0:1789431559.531414:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933390208
00000100:00100000:1.0:1789431559.531502:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8176
00000100:00100000:1.0:1789431559.531514:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+120:2347:x1876351933390208:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.531537:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.531564:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017a8e0de/0xd8e438fb6352428d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8488 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.531575:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+441:14617:x1876351933390080:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2068us (3234us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431559.531592:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295669
00002000:00010000:1.0:1789431559.531610:0:8217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x508:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:1.0:1789431559.531639:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x508:0x0].0x0 since=3017s v=(0 0)
00010000:00010000:1.0:1789431559.531644:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x508:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431559.531664:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017a8e0de/0xd8e438fb6352428d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8488 expref: 121 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.531685:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000017a8e0de/0xd8e438fb6352428d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8488 expref: 121 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.531702:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf01520200, rc 0)
00000100:00100000:1.0:1789431559.531789:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+121:2347:x1876351933390208:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 276us (552us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431559.531797:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8176
00000100:00100000:1.0:1789431559.540172:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.541477:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933390464
00000100:00100000:2.0:1789431559.541493:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933390464
00000100:00100000:2.0:1789431559.541569:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12390
00000100:00100000:2.0:1789431559.541580:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+441:14616:x1876351933390464:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431559.542161:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+442:14616:x1876351933390464:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 579us (2001us total) trans 4295120827 rc 0/0
00000100:00100000:2.0:1789431559.542170:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12390
00000100:00100000:3.0:1789431559.546352:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.546607:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933390592
00000100:00100000:2.0:1789431559.546618:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933390592
00000100:00100000:2.0:1789431559.546683:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295670
00000100:00100000:2.0:1789431559.546693:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+442:14617:x1876351933390592:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431559.546711:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431559.546731:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524294 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c848f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.546809:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352429b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.546835:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352429b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.546850:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352429b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.546868:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.546874:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.546880:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.546956:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352429b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.546964:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352429b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.546970:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352429b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.546976:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.546980:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352429b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.546987:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352429b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.547000:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.547003:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.547009:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352429b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.547015:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352429b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.547029:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.547034:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.547039:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.547044:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.547394:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.547404:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.547414:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x897a18fd (ffff90ce359c6a00)
00010000:00010000:2.0:1789431559.547417:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.547420:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.547426:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.547462:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524294 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c848f expref: 443 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.547477:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.547480:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.547484:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524294 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c848f expref: 443 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.547494:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:2.0:1789431559.547550:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+442:14617:x1876351933390592:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 859us (1208us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431559.547557:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295670
00000100:00100000:2.0:1789431559.551629:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.551718:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933390848
00000100:00100000:1.0:1789431559.551727:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933390848
00000100:00100000:1.0:1789431559.551794:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295671
00000100:00100000:1.0:1789431559.551805:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+442:14616:x1876351933390848:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431559.551876:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431559.551902:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb6352426a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a8d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c847a expref: 442 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.551919:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8d:0x0].0x0 (ffff90cf04a08a00)
00010000:00010000:1.0:1789431559.551930:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431559.551950:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635242a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.551965:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635242a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.551974:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635242a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.551988:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635242b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.551995:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635242b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.552001:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635242b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.552490:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635242b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a8d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.552500:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635242b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a8d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.552507:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635242b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a8d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431559.554488:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1205, 64 off85376
00010000:00010000:1.0:1789431559.554567:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb635242be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a8d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554582:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb635242be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a8d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554593:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb635242be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a8d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554602:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb635242be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a8d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554608:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb635242be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a8d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554614:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb635242be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a8d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554641:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431559.554662:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635242b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a8d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554673:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635242b7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a8d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554679:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635242b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a8d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554686:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a4a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.554690:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635242b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a8d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554696:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635242b7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a8d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554707:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8d:0x0].0x0 (ffff90ce03149800)
00010000:00010000:1.0:1789431559.554709:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431559.554713:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635242b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a8d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554718:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635242b7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a8d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554736:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635242a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554743:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635242a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554749:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635242a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554766:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01521a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.554770:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635242a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554775:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635242a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554783:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.554785:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.554788:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635242a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.554794:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635242a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431559.554806:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fc7021fb reply state 00000000fdfc45ea transno 4295120828 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635242b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.554814:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431559.554925:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+443:14616:x1876351933390848:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3118us (3300us total) trans 4295120828 rc 0/0
00000100:00100000:1.0:1789431559.554933:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295671
00010000:00010000:3.0:1789431559.555644:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431559.555652:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb635242be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a8d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.555661:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431559.555664:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb635242be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a8d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.555672:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb635242be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a8d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.555683:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8d:0x0].0x0 (ffff90ce03149800)
00010000:00010000:3.0:1789431559.555686:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431559.555690:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb635242be lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a8d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.555700:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb635242be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a8d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.555717:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431559.555719:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431559.555720:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431559.558649:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635242b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.558674:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635242b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.558682:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635242b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.558688:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.558694:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635242b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.558702:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635242b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.558722:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x7b807097 (ffff90ce03149100)
00010000:00010000:3.0:1789431559.558726:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.558732:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635242b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.558739:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb635242b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x7b807097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431559.570309:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.570454:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933390976
00000100:00100000:0.0:1789431559.570465:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933390976
00000100:00100000:0.0:1789431559.570525:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295672
00000100:00100000:0.0:1789431559.570535:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+442:14616:x1876351933390976:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.570559:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.570578:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635242c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8496 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570643:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635242cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570658:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635242cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570669:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635242cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570683:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635242d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570689:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635242d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570695:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635242d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570744:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635242cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570750:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635242cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570769:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635242cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570775:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e1a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.570779:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635242cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570786:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635242cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570810:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431559.570813:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.570817:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635242cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570835:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635242cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570848:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635242d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570854:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635242d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570859:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635242d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570864:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e1800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.570867:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635242d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570872:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635242d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570879:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xd940be10 (ffff90cf04a08a00)
00010000:00010000:0.0:1789431559.570882:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.570885:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635242d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570890:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635242d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570920:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635242c5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8496 expref: 443 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570929:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431559.570932:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.570936:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635242c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8496 expref: 443 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.570945:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce156e0000, rc 0)
00000100:00100000:0.0:1789431559.571005:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+442:14616:x1876351933390976:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 471us (704us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431559.571012:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295672
00000100:00100000:1.0:1789431559.574595:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.574690:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933391104
00000100:00100000:2.0:1789431559.574705:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933391104
00000100:00100000:2.0:1789431559.574791:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295673
00000100:00100000:2.0:1789431559.574802:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+442:14617:x1876351933391104:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431559.574946:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431559.574970:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635242da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c849d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575036:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575233:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575246:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575264:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635242e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575272:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635242e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575279:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635242e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575536:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575544:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575550:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575556:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.575560:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575568:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575579:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.575582:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.575587:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575593:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635242e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575606:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635242e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575612:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635242e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575618:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635242e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575624:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.575627:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635242e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575633:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635242e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575639:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xec46fc5c (ffff90ce359c6a00)
00010000:00010000:2.0:1789431559.575642:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.575645:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635242e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575650:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635242e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575683:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635242da lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c849d expref: 443 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575693:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.575696:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.575700:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635242da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c849d expref: 443 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.575708:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:2.0:1789431559.575788:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+442:14617:x1876351933391104:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 988us (1386us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431559.575796:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295673
00000100:00100000:3.0:1789431559.578550:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.580112:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933391232
00000100:00100000:0.0:1789431559.580133:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933391232
00000100:00100000:0.0:1789431559.580220:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295674
00000100:00100000:0.0:1789431559.580233:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+442:14616:x1876351933391232:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.580260:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.580301:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635242ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c84a4 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.580391:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635242f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.580409:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635242f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.580423:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635242f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431559.580472:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:0.0:1789431559.580476:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431559.580499:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635242f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.580530:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635242ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84a4 expref: 444 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.580553:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635242f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84a4 expref: 443 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.580563:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431559.580567:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431559.580572:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce156e1800, rc 0)
00000100:00100000:0.0:1789431559.580669:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+443:14616:x1876351933391232:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 438us (2134us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431559.580679:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295674
00000100:00100000:0.0:1789431559.589152:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.589207:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.589504:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933391488
00000100:00100000:1.0:1789431559.589519:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933391488
00000100:00100000:1.0:1789431559.589601:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295675
00000100:00100000:1.0:1789431559.589614:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+443:14617:x1876351933391488:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.589645:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.589649:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:1.0:1789431559.589688:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524232 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8465 expref: 443 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.589718:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431559.589724:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431559.589744:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635242fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c84ab expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.590152:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524304 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.590174:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524304 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.590185:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524304 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.590203:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352430b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.590209:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352430b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.590216:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352430b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431559.590561:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933391616
00000100:00100000:2.0:1789431559.590571:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933391616
00000100:00100000:2.0:1789431559.590637:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12391
00000100:00100000:2.0:1789431559.590648:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+444:14616:x1876351933391616:12345-192.168.203.4@tcp:37:dbench.0
00000004:00080000:1.0:1789431559.595650:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x509:0x0], index 0: 0
00010000:00010000:1.0:1789431559.596516:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524312 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a8e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.596541:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.596561:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.596614:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524304 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.596623:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524304 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.596630:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524304 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.596636:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.596642:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524304 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.596651:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524304 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.596666:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431559.596670:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.596677:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524304 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.596684:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524304 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431559.596702:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a0678269 reply state 000000007dd54654 transno 4295120829 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352430b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.596712:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431559.596775:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635242fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84ab expref: 447 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.596793:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84ab expref: 446 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.596801:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8e:0x0].0x0 (ffff90ce03149600)
00010000:00010000:1.0:1789431559.596803:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431559.596806:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce387a5200, rc 0)
00000100:00100000:1.0:1789431559.597342:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+447:14617:x1876351933391488:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7725us (8200us total) trans 4295120829 rc 0/0
00000100:00100000:1.0:1789431559.597354:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295675
00000100:00100000:0.0:1789431559.604909:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.605081:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933391744
00000100:00100000:1.0:1789431559.605095:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933391744
00000100:00100000:1.0:1789431559.605177:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8177
00000100:00100000:1.0:1789431559.605189:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+133:2347:x1876351933391744:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.605215:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.605244:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bca4ae2/0xd8e438fb63524320 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c84b2 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789431559.605282:0:14486:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x509:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:1.0:1789431559.605311:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x509:0x0].0x0 since=3017s v=(0 0)
00010000:00010000:1.0:1789431559.605317:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x509:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431559.605327:0:14486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bca4ae2/0xd8e438fb63524320 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84b2 expref: 134 pid: 14486 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.605349:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009bca4ae2/0xd8e438fb63524320 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84b2 expref: 134 pid: 14486 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.605365:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce387a4a00, rc 0)
00000100:00100000:1.0:1789431559.605434:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+134:2347:x1876351933391744:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 247us (542us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431559.605442:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8177
00010000:00010000:3.0:1789431559.606477:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352430b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.606495:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352430b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.606503:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352430b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.606509:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.606515:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352430b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.606523:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352430b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.606541:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xec46fc5c (ffff90ce03149e00)
00010000:00010000:3.0:1789431559.606544:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.606549:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352430b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.606555:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352430b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.608042:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+444:14616:x1876351933391616:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 17380us (18818us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431559.608086:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12391
00000100:00100000:0.0:1789431559.613630:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.614161:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933392000
00000100:00100000:1.0:1789431559.614176:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933392000
00000100:00100000:1.0:1789431559.614261:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295676
00000100:00100000:1.0:1789431559.614274:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+444:14616:x1876351933392000:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.614315:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.614319:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:1.0:1789431559.614357:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635242f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84a4 expref: 444 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.614381:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.614386:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431559.614402:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524327 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c84b9 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.614556:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352432e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.614575:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352432e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.614587:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352432e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.614606:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524335 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.614614:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524335 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.614620:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524335 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:1.0:1789431559.615615:0:12181:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x509:0x0], index 1: 0
00010000:00010000:1.0:1789431559.615947:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb6352433c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a8f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.615965:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb6352433c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a8f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.615977:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb6352433c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a8f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.616020:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352432e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.616028:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352432e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.616036:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352432e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.616099:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.616105:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352432e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.616114:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352432e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.616128:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.616131:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.616136:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352432e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.616141:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352432e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431559.616156:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004a5d4a6c reply state 00000000324d1c40 transno 4295120830 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524335 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.616166:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431559.616211:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524327 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84b9 expref: 446 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.616228:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb6352433c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a8f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84b9 expref: 445 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.616235:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8f:0x0].0x0 (ffff90ce03149b00)
00010000:00010000:1.0:1789431559.616238:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431559.616241:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb2f800, rc 0)
00000100:00100000:1.0:1789431559.616347:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+446:14616:x1876351933392000:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2075us (2731us total) trans 4295120830 rc 0/0
00000100:00100000:1.0:1789431559.616358:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295676
00000100:00100000:3.0:1789431559.618424:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.618700:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933392256
00000100:00100000:1.0:1789431559.618713:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933392256
00000100:00100000:1.0:1789431559.618794:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12392
00000100:00100000:1.0:1789431559.618807:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+446:14617:x1876351933392256:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431559.627276:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+447:14617:x1876351933392256:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 8450us (8846us total) trans 4295120831 rc 0/0
00000100:00100000:1.0:1789431559.627297:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12392
00000100:00100000:0.0:1789431559.627466:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431559.627847:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524335 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.627862:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524335 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.627872:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524335 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.627878:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01521a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.627884:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524335 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.627892:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524335 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.627912:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xd940be10 (ffff90ce03149500)
00010000:00010000:2.0:1789431559.627916:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.627923:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524335 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.627929:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524335 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.628009:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933392384
00000100:00100000:1.0:1789431559.628021:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933392384
00000100:00100000:1.0:1789431559.628185:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8178
00000100:00100000:1.0:1789431559.628197:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+121:2350:x1876351933392384:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.628220:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.628247:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008999eb73/0xd8e438fb6352434a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c84c0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789431559.628294:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x509:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:1.0:1789431559.628322:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x509:0x0].0x0 since=3017s v=(0 0)
00010000:00010000:1.0:1789431559.628328:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x509:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431559.628338:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008999eb73/0xd8e438fb6352434a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84c0 expref: 122 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.628357:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008999eb73/0xd8e438fb6352434a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84c0 expref: 122 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.628377:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37e74a00, rc 0)
00000100:00100000:1.0:1789431559.628446:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+122:2350:x1876351933392384:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 252us (981us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431559.628454:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8178
00000100:00100000:0.0:1789431559.636021:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.637544:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933392640
00000100:00100000:3.0:1789431559.637563:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933392640
00000100:00100000:3.0:1789431559.637648:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12393
00000100:00100000:3.0:1789431559.637660:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+446:14616:x1876351933392640:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431559.638522:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+447:14616:x1876351933392640:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 855us (2507us total) trans 4295120832 rc 0/0
00000100:00100000:3.0:1789431559.638537:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12393
00000100:00100000:0.0:1789431559.639670:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.639780:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933392896
00000100:00100000:1.0:1789431559.639792:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933392896
00000100:00100000:1.0:1789431559.639911:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295677
00000100:00100000:1.0:1789431559.639924:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+447:14617:x1876351933392896:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431559.639989:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431559.640024:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524312 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84ab expref: 447 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.640108:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8e:0x0].0x0 (ffff90ce03149600)
00010000:00010000:1.0:1789431559.640124:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431559.640172:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524351 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.640191:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524351 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.640203:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524351 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.640220:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524358 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.640227:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524358 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.640233:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524358 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.640384:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352435f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a8e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.640393:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352435f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a8e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.640400:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352435f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a8e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431559.641269:0:12775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1204, 64 off85248
00010000:00010000:1.0:1789431559.641602:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524366 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a8e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641617:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524366 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a8e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641629:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524366 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a8e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641639:0:12775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524366 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a8e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641647:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524366 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a8e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641654:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524366 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a8e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641717:0:12775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431559.641746:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352435f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641762:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352435f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641769:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352435f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641776:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.641782:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352435f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641790:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352435f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641802:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8e:0x0].0x0 (ffff90ce03149000)
00010000:00010000:1.0:1789431559.641805:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431559.641811:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352435f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641817:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352435f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641842:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524351 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641848:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524351 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641853:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524351 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641863:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e74200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.641866:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524351 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641871:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524351 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641879:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431559.641882:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.641886:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524351 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.641891:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524351 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431559.641915:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007fb10f7a reply state 0000000070d3e332 transno 4295120833 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524358 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.641926:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431559.642044:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+448:14617:x1876351933392896:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2119us (2377us total) trans 4295120833 rc 0/0
00000100:00100000:1.0:1789431559.642092:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295677
00010000:00010000:2.0:1789431559.645925:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524358 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.645950:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524358 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.645959:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524358 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.645965:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.645971:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524358 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.645980:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524358 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.646001:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xec46fc5c (ffff90ce03149200)
00010000:00010000:2.0:1789431559.646005:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.646012:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524358 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.646019:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524358 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.646790:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431559.646802:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524366 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a8e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.646817:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00030e00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431559.646821:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524366 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a8e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.646829:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524366 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a8e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.646844:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8e:0x0].0x0 (ffff90ce03149000)
00010000:00010000:0.0:1789431559.646847:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431559.646851:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524366 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a8e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.646858:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524366 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a8e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.646882:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431559.646884:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431559.646886:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431559.647875:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.647965:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933393024
00000100:00100000:2.0:1789431559.647978:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933393024
00000100:00100000:2.0:1789431559.648094:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295678
00000100:00100000:2.0:1789431559.648107:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+447:14617:x1876351933393024:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431559.648139:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431559.648165:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352436d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c84c7 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648248:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524374 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648266:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524374 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648291:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524374 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648309:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352437b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648317:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352437b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648323:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352437b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648393:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524374 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648401:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524374 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648408:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524374 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648423:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.648427:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524374 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648436:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524374 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648450:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.648454:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.648459:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524374 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648465:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524374 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648479:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352437b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648485:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352437b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648490:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352437b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648495:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.648498:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352437b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648503:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352437b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648514:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x897a18fd (ffff90ce359c6a00)
00010000:00010000:2.0:1789431559.648516:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.648518:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352437b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648523:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352437b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648558:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352436d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84c7 expref: 448 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648569:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.648571:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.648575:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352436d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84c7 expref: 448 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.648583:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309200, rc 0)
00000100:00100000:2.0:1789431559.648654:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+447:14617:x1876351933393024:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 549us (791us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431559.648661:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295678
00000100:00100000:3.0:1789431559.651489:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.651589:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933393280
00000100:00100000:2.0:1789431559.651602:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933393280
00000100:00100000:2.0:1789431559.651677:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295679
00000100:00100000:2.0:1789431559.651690:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+447:14616:x1876351933393280:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431559.651783:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431559.651821:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb6352433c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a8f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84b9 expref: 447 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.651852:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8f:0x0].0x0 (ffff90ce03149b00)
00010000:00010000:2.0:1789431559.651865:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431559.651892:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524382 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.651909:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524382 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.651920:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524382 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.651936:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524389 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.651943:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524389 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.651949:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524389 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.652141:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524390 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a8f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.652150:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524390 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a8f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.652157:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524390 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a8f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431559.652812:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1206, 64 off85440
00000004:00080000:2.0:1789431559.652823:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3017683773345ns, next at 3018683769963ns, rc = 0
00010000:00010000:2.0:1789431559.652898:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524397 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a8f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.652910:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a8f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.652920:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a8f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.652929:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524397 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a8f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.652936:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524397 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a8f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.652943:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524397 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a8f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.652968:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431559.652994:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524390 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a8f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.653000:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524390 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a8f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.653005:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524390 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a8f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.653011:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.653015:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524390 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a8f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.653027:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524390 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a8f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.653038:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8f:0x0].0x0 (ffff90ce359c6000)
00010000:00010000:2.0:1789431559.653041:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431559.653046:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524390 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a8f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.653083:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524390 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a8f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.653104:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524382 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.653110:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524382 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.653117:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524382 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.653123:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.653126:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524382 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.653132:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524382 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.653140:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431559.653143:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.653146:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524382 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.653156:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524382 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431559.653166:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ccd4e464 reply state 00000000885a68fa transno 4295120834 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524389 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431559.653178:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431559.653284:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+448:14616:x1876351933393280:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1593us (1806us total) trans 4295120834 rc 0/0
00000100:00100000:2.0:1789431559.653294:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295679
00010000:00010000:3.0:1789431559.654165:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431559.654178:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524397 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a8f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.654189:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01521a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431559.654192:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524397 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a8f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.654201:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524397 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a8f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.654215:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a8f:0x0].0x0 (ffff90ce359c6000)
00010000:00010000:3.0:1789431559.654218:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431559.654223:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524397 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a8f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.654229:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524397 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a8f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.654253:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431559.654255:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431559.654256:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431559.657544:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524389 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.657570:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524389 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.657582:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524389 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.657591:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.657597:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524389 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.657607:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524389 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.657634:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xd940be10 (ffff90ce359c6300)
00010000:00010000:2.0:1789431559.657638:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.657646:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524389 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.657654:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524389 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431559.660730:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.663275:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933393408
00000100:00100000:2.0:1789431559.663317:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933393408
00000100:00100000:2.0:1789431559.663491:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295680
00000100:00100000:2.0:1789431559.663506:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+447:14617:x1876351933393408:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431559.663539:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431559.663571:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb6352439e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c84ce expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.663665:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635243a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.663685:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635243a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.663697:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635243a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431559.663744:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:2.0:1789431559.663748:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431559.663789:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635243a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.663821:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb6352439e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84ce expref: 449 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.663846:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635243a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84ce expref: 448 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.663856:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.663860:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:2.0:1789431559.663864:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3800, rc 0)
00000100:00100000:2.0:1789431559.665621:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+448:14617:x1876351933393408:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2101us (4887us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431559.665637:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295680
00000100:00100000:1.0:1789431559.671933:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1789431559.672351:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.672394:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.672478:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933393664
00000100:00100000:3.0:1789431559.672490:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933393664
00000100:00100000:2.0:1789431559.672559:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933393536
00000100:00100000:3.0:1789431559.672562:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12394
00000100:00100000:2.0:1789431559.672565:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933393536
00000100:00100000:3.0:1789431559.672574:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e9d2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+449:14617:x1876351933393664:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:2.0:1789431559.672601:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295681
00000100:00100000:2.0:1789431559.672608:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+449:14616:x1876351933393536:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431559.672619:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431559.672646:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635243ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c84d5 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672719:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635243b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672736:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635243b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672749:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635243b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672783:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635243ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672790:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635243ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672797:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635243ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672867:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635243b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672875:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635243b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672882:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635243b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672888:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.672892:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635243b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672902:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635243b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672916:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431559.672920:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.672926:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635243b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672933:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb635243b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672948:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635243ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672955:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635243ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672962:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635243ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672967:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.672970:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635243ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672976:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635243ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672983:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xd940be10 (ffff90ce359c6a00)
00010000:00010000:2.0:1789431559.672985:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.672988:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635243ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.672994:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635243ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.673034:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635243ac lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84d5 expref: 450 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.673044:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431559.673077:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.673082:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb635243ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84d5 expref: 450 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.673093:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3000, rc 0)
00000100:00100000:2.0:1789431559.673172:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+449:14616:x1876351933393536:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 563us (827us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431559.673180:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295681
00000100:00100000:1.0:1789431559.673428:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894195712:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1789431559.673487:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431559.673622:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894195712
00000100:00100000:2.0:1789431559.673629:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894195712
00000100:00100000:2.0:1789431559.677274:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132
00000100:00100000:2.0:1789431559.677365:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876351894195712:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1789431559.677410:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 54525952 granted 444530688 pending 11927552 free 3835691008 avail 3833593856
00000100:00100000:2.0:1789431559.677532:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876351894195712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (4043us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431559.677539:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132
00000100:00080000:1.0:1789431559.677643:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1789431559.677698:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969575 gen 2
00000004:00080000:1.0:1789431559.677706:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf37e90a80, transno 4294969562
00000004:00080000:1.0:1789431559.677728:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf37e93b80, transno 4294969563
00000004:00080000:1.0:1789431559.677733:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf37e92d80, transno 4294969564
00000004:00080000:1.0:1789431559.677737:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3bbf6d80, transno 4294969565
00000004:00080000:1.0:1789431559.677739:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3bbf7480, transno 4294969566
00000004:00080000:1.0:1789431559.677743:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce3a047800, transno 4294969567
00000004:00080000:1.0:1789431559.677746:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf37e91f80, transno 4294969568
00000004:00080000:1.0:1789431559.677749:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1a56a300, transno 4294969569
00000004:00080000:1.0:1789431559.677762:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1a568380, transno 4294969570
00000004:00080000:1.0:1789431559.677765:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf087a1880, transno 4294969571
00000004:00080000:1.0:1789431559.677768:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf087a1c00, transno 4294969572
00000004:00080000:1.0:1789431559.678203:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1a56aa00, transno 4294969573
00000004:00080000:1.0:1789431559.678208:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1a569c00, transno 4294969574
00000100:00100000:1.0:1789431559.678239:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894195712:0@lo:13:osp-pre-0-0.0
00000004:00080000:2.0:1789431559.678944:0:6793:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 28 changes, 3 in progress, 0 in flight, 10 done
00000004:00080000:2.0:1789431559.679026:0:6793:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 28 changes, 0 in progress, 0 in flight, 3 done
00000100:00100000:2.0:1789431559.683254:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.683996:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933393792
00000100:00100000:3.0:1789431559.684012:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933393792
00000100:00100000:3.0:1789431559.684123:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295682
00000100:00100000:3.0:1789431559.684137:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+450:14616:x1876351933393792:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431559.684166:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431559.684196:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635243c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c84dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.684915:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635243c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.684942:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635243c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.684957:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635243c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431559.686606:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e9d2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+450:14617:x1876351933393664:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 14017us (14192us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431559.686622:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12394
00000004:00200000:3.0:1789431559.686746:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:3.0:1789431559.686760:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431559.686800:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635243c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.686850:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635243c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84dc expref: 450 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.686876:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635243c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84dc expref: 449 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.686888:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431559.686891:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431559.686895:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ac43800, rc 0)
00000100:00100000:3.0:1789431559.691815:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+449:14616:x1876351933393792:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7662us (8557us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431559.691832:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295682
00000100:00100000:2.0:1789431559.692105:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.695929:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933394048
00000100:00100000:0.0:1789431559.695952:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933394048
00000100:00100000:0.0:1789431559.696094:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295683
00000100:00100000:0.0:1789431559.696109:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+449:14617:x1876351933394048:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.696136:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.696167:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635243cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c84e3 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696273:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635243d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696459:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635243d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696475:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635243d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696495:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635243dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696503:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635243dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696510:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635243dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696586:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635243d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696594:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635243d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696602:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635243d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696608:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e0000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.696613:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635243d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696626:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635243d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696640:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.696644:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.696650:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635243d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696657:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635243d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696674:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635243dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696680:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635243dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696686:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635243dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696692:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e1a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.696695:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635243dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696702:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635243dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696709:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x897a18fd (ffff90cf04a08a00)
00010000:00010000:0.0:1789431559.696712:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.696715:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635243dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696721:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635243dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696933:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635243cf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84e3 expref: 450 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696946:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.696949:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:0.0:1789431559.696954:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635243cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84e3 expref: 450 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.696965:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce156e0200, rc 0)
00000100:00100000:0.0:1789431559.697272:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+449:14617:x1876351933394048:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1164us (5166us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431559.697294:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295683
00000100:00100000:0.0:1789431559.698519:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.699044:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933394176
00000100:00100000:2.0:1789431559.699686:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933394176
00000100:00100000:2.0:1789431559.703471:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12395
00000100:00100000:2.0:1789431559.703496:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+449:14616:x1876351933394176:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:2.0:1789431559.711076:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+449:14616:x1876351933394176:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 7558us (12538us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431559.711094:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12395
00000100:00100000:1.0:1789431559.712094:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.712628:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933394304
00000100:00100000:2.0:1789431559.712642:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933394304
00000100:00100000:2.0:1789431559.712780:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295684
00000100:00100000:2.0:1789431559.712793:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+449:14617:x1876351933394304:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431559.712821:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431559.712850:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635243e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c84ea expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.712938:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635243eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.712959:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635243eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.712973:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635243eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.712990:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635243f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.712997:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635243f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.713003:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635243f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.713118:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635243eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.713128:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635243eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.713136:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635243eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.713143:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.713148:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635243eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.713157:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635243eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.713171:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.713174:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.713180:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635243eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.713187:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635243eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.713201:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635243f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.713208:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635243f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.713214:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635243f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.713220:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.713224:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635243f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.713229:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635243f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.713237:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x4a14f308 (ffff90ce359c6a00)
00010000:00010000:2.0:1789431559.713240:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.713242:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635243f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.713249:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635243f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.713468:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635243e4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84ea expref: 450 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.713481:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.713483:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.713487:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635243e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84ea expref: 450 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.713498:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:2.0:1789431559.713584:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+449:14617:x1876351933394304:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 793us (1501us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431559.713591:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295684
00000100:00100000:3.0:1789431559.724306:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.724502:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933394560
00000100:00100000:2.0:1789431559.724517:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933394560
00000100:00100000:2.0:1789431559.724603:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295685
00000100:00100000:2.0:1789431559.724616:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+449:14616:x1876351933394560:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431559.724644:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431559.724649:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:2.0:1789431559.724686:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635243c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84dc expref: 449 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.724712:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431559.724718:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431559.724737:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635243f9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c84f1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.724910:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524400 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.724927:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524400 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.724941:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524400 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.724959:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524407 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.724967:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524407 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.724974:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524407 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431559.727728:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x50a:0x0], index 0: 0
00000100:00100000:1.0:1789431559.729352:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.729624:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933394688
00000100:00100000:3.0:1789431559.729639:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933394688
00000100:00100000:3.0:1789431559.729724:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295686
00000100:00100000:3.0:1789431559.729737:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+451:14617:x1876351933394688:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431559.729942:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431559.729983:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb6352440e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c84f8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.730112:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524415 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.730132:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524415 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.730145:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524415 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.730163:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb6352441c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.730171:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb6352441c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.730179:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb6352441c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.730253:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524415 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.730261:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524415 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.730269:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524415 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.730276:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac43c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.730892:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524415 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.730907:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524415 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.730926:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431559.730930:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.730937:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524415 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.730944:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524415 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.730964:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb6352441c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.730971:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb6352441c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.730979:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb6352441c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.730985:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.730988:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb6352441c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.730994:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb6352441c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.731001:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xec46fc5c (ffff90cf11d83f00)
00010000:00010000:3.0:1789431559.731004:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.731007:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb6352441c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.731012:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb6352441c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.731332:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb63524423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a90:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.731347:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb63524423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.731357:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb63524423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.731434:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524400 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.731447:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524400 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.731453:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524400 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.731458:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.731462:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524400 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.731467:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524400 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.731476:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431559.731479:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.731482:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524400 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.731488:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524400 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431559.731501:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f8c5dd42 reply state 00000000b4753a3f transno 4295120835 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524407 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.731511:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431559.731559:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635243f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84f1 expref: 453 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.731576:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb63524423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a90:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84f1 expref: 452 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.731696:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb6352440e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84f8 expref: 452 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.731709:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431559.731711:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.731716:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb6352440e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84f8 expref: 452 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.731727:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ac42400, rc 0)
00000100:00100000:3.0:1789431559.731978:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+451:14617:x1876351933394688:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2242us (2638us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431559.731989:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295686
00010000:00010000:0.0:1789431559.732171:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a90:0x0].0x0 (ffff90cf04a08a00)
00010000:00010000:0.0:1789431559.732174:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431559.732177:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce156e1a00, rc 0)
00000100:00100000:0.0:1789431559.732212:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+451:14616:x1876351933394560:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7599us (7934us total) trans 4295120835 rc 0/0
00000100:00100000:0.0:1789431559.732218:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295685
00000100:00100000:3.0:1789431559.737544:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431559.737879:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524407 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.737895:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524407 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.737904:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524407 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.737911:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.737917:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524407 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.737928:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524407 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.737949:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xd940be10 (ffff90ce359c6a00)
00010000:00010000:2.0:1789431559.737953:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.737959:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524407 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.737967:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524407 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.738595:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933394816
00000100:00100000:0.0:1789431559.738610:0:14490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933394816
00000100:00100000:0.0:1789431559.738690:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8179
00000100:00100000:0.0:1789431559.738703:0:14490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+134:2348:x1876351933394816:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.738727:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.738772:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb63524431 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c84ff expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789431559.738811:0:14490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x50a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431559.738840:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50a:0x0].0x0 since=3017s v=(0 0)
00010000:00010000:0.0:1789431559.738845:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50a:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431559.738856:0:14490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb63524431 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84ff expref: 135 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.738875:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb63524431 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84ff expref: 135 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.738890:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce156e0000, rc 0)
00000100:00100000:0.0:1789431559.738975:0:14490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+135:2348:x1876351933394816:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 275us (1448us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431559.738983:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8179
00000100:00100000:0.0:1789431559.745265:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.745416:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933395072
00000100:00100000:1.0:1789431559.745431:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933395072
00000100:00100000:1.0:1789431559.745510:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12396
00000100:00100000:1.0:1789431559.745524:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+450:14616:x1876351933395072:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431559.746147:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+451:14616:x1876351933395072:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 624us (895us total) trans 4295120836 rc 0/0
00000100:00100000:1.0:1789431559.746157:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12396
00000100:00100000:1.0:1789431559.752234:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.752439:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933395328
00000100:00100000:2.0:1789431559.752452:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933395328
00000100:00100000:2.0:1789431559.752569:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295687
00000100:00100000:2.0:1789431559.752582:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+451:14617:x1876351933395328:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431559.752619:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431559.752623:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:2.0:1789431559.752659:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb635243a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84ce expref: 451 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.752683:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.752690:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431559.752707:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524438 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8506 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.752877:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352443f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.752901:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352443f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.752914:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352443f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.752930:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524446 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.752938:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.752945:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:2.0:1789431559.753631:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x50a:0x0], index 1: 0
00010000:00010000:2.0:1789431559.753857:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352444d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a91:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.753871:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352444d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a91:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.753881:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352444d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a91:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.753924:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352443f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.753933:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352443f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.753946:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352443f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.753953:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.753957:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352443f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.753966:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352443f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.753978:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.753981:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.753986:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352443f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.753993:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352443f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431559.754008:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001671f730 reply state 000000008c66374c transno 4295120837 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431559.754017:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:2.0:1789431559.754104:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524438 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8506 expref: 453 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.754123:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352444d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a91:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8506 expref: 452 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.754130:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a91:0x0].0x0 (ffff90ce359c6f00)
00010000:00010000:2.0:1789431559.754133:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431559.754135:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:2.0:1789431559.754243:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+453:14617:x1876351933395328:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1664us (2022us total) trans 4295120837 rc 0/0
00000100:00100000:2.0:1789431559.754251:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295687
00000100:00100000:3.0:1789431559.758431:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.760238:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933395584
00000100:00100000:2.0:1789431559.760257:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933395584
00000100:00100000:2.0:1789431559.760446:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295688
00000100:00100000:2.0:1789431559.760460:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+453:14616:x1876351933395584:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431559.760544:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431559.760579:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb63524423 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84f1 expref: 453 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.760722:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a90:0x0].0x0 (ffff90cf04a08a00)
00010000:00010000:2.0:1789431559.760736:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431559.760782:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352445b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.760801:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352445b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.760815:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352445b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.760832:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63524462 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.760839:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63524462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.760851:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63524462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.760998:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524469 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a90:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.761007:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524469 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.761014:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524469 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431559.762231:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1205, 64 off85312
00010000:00010000:2.0:1789431559.762334:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524470 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762351:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a90:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762362:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a90:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762372:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524470 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a90:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762378:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524470 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a90:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762384:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a90:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762411:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431559.762446:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431559.762452:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524470 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a90:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762459:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431559.762463:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524470 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a90:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762471:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a90:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762484:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a90:0x0].0x0 (ffff90ce359c6c00)
00010000:00010000:2.0:1789431559.762487:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431559.762492:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524470 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a90:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762498:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524470 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a90:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762513:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431559.762515:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431559.762517:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431559.762535:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524469 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762542:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524469 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762547:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524469 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762553:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.762558:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524469 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762564:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524469 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762571:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a90:0x0].0x0 (ffff90ce359c6c00)
00010000:00010000:2.0:1789431559.762574:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431559.762577:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524469 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762593:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524469 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762619:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352445b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762626:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352445b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762631:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352445b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762636:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.762639:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352445b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762644:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352445b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762653:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431559.762655:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.762659:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352445b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.762665:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352445b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431559.762676:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006f7dcbd8 reply state 00000000e38663ff transno 4295120838 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63524462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431559.762685:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431559.762818:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+454:14616:x1876351933395584:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2357us (4399us total) trans 4295120838 rc 0/0
00000100:00100000:2.0:1789431559.762827:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295688
00000100:00100000:2.0:1789431559.764094:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.767386:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933395712
00000100:00100000:1.0:1789431559.767409:0:14501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933395712
00000100:00100000:1.0:1789431559.767509:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8180
00000100:00100000:1.0:1789431559.767523:0:14501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+122:2347:x1876351933395712:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.767548:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.767579:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb63524477 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c850d expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789431559.767629:0:14501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x50a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:1.0:1789431559.767658:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50a:0x0].0x0 since=3017s v=(0 0)
00010000:00010000:1.0:1789431559.767663:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50a:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431559.767674:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb63524477 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c850d expref: 123 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.767695:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb63524477 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c850d expref: 123 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.767710:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf00031400, rc 0)
00000100:00100000:1.0:1789431559.767816:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+123:2347:x1876351933395712:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 296us (3766us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431559.767824:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8180
00010000:00010000:3.0:1789431559.769536:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.769557:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524446 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.769566:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524446 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.769572:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.769579:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524446 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.769599:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524446 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.769620:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xec46fc5c (ffff90ce359c6300)
00010000:00010000:3.0:1789431559.769623:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.769629:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524446 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.769636:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524446 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431559.770444:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.772705:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933395840
00000100:00100000:1.0:1789431559.772729:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933395840
00000100:00100000:1.0:1789431559.772852:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295689
00000100:00100000:1.0:1789431559.772866:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+453:14616:x1876351933395840:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.772898:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.772927:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb6352447e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8514 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773010:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524485 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773033:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524485 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773046:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524485 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773085:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352448c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773093:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352448c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773100:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352448c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773176:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524485 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773183:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524485 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773191:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524485 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773198:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e74200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.773203:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524485 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773212:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524485 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773231:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.773234:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.773240:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524485 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773247:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524485 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773262:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352448c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773268:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352448c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773273:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352448c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773278:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.773294:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352448c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773301:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352448c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773308:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xec46fc5c (ffff90ce03149400)
00010000:00010000:1.0:1789431559.773311:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.773314:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352448c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773320:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352448c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773358:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb6352447e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8514 expref: 454 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773369:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.773371:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.773374:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb6352447e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8514 expref: 454 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.773385:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf00030e00, rc 0)
00000100:00100000:1.0:1789431559.773466:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+453:14616:x1876351933395840:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 603us (3030us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431559.773474:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295689
00000100:00100000:2.0:1789431559.778177:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.779735:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933396096
00000100:00100000:3.0:1789431559.779764:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933396096
00000100:00100000:3.0:1789431559.779859:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12397
00000100:00100000:3.0:1789431559.779874:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+453:14617:x1876351933396096:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431559.780398:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+454:14617:x1876351933396096:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 526us (2235us total) trans 4295120839 rc 0/0
00000100:00100000:3.0:1789431559.780408:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12397
00000100:00100000:3.0:1789431559.782455:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.782543:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933396224
00000100:00100000:1.0:1789431559.782557:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933396224
00000100:00100000:1.0:1789431559.782642:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295690
00000100:00100000:1.0:1789431559.782654:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+454:14616:x1876351933396224:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.782682:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.782713:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524493 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c851b expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.782824:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352449a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.782844:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352449a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.782859:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352449a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431559.782906:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:1.0:1789431559.782911:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431559.782935:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352449a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.782967:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63524493 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c851b expref: 456 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.782992:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352449a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c851b expref: 455 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.783002:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.783005:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431559.783009:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37f77c00, rc 0)
00000100:00100000:1.0:1789431559.783119:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+455:14616:x1876351933396224:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 467us (676us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431559.783126:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295690
00010000:00010000:0.0:1789431559.784350:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63524462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.784363:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63524462 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.784369:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63524462 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.784372:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.784376:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63524462 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.784383:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63524462 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.784397:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xd940be10 (ffff90ce359c6a00)
00010000:00010000:0.0:1789431559.784399:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.784403:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63524462 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.784407:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63524462 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xd940be10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.789986:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.790125:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933396352
00000100:00100000:0.0:1789431559.790139:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933396352
00000100:00100000:0.0:1789431559.790206:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12398
00000100:00100000:0.0:1789431559.790219:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+454:14616:x1876351933396352:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:2.0:1789431559.793251:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.795529:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+454:14616:x1876351933396352:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 5294us (5541us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431559.795546:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12398
00000100:00100000:1.0:1789431559.800578:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933396608
00000100:00100000:1.0:1789431559.800601:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933396608
00000100:00100000:1.0:1789431559.800758:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295691
00000100:00100000:1.0:1789431559.800779:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+454:14617:x1876351933396608:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431559.800852:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431559.800887:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352444d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a91:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8506 expref: 454 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.800917:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a91:0x0].0x0 (ffff90ce359c6f00)
00010000:00010000:1.0:1789431559.800932:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431559.800962:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.800979:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.800991:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.801007:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635244a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.801014:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635244a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.801020:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635244a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.801216:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635244af lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a91:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.801224:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635244af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a91:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.801231:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635244af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a91:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431559.802486:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1207, 64 off85504
00010000:00010000:1.0:1789431559.802589:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb635244b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a91:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802607:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb635244b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a91:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802620:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb635244b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a91:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802630:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb635244b6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a91:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802637:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb635244b6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a91:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802644:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb635244b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a91:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802783:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431559.802815:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635244af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802821:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635244af lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802829:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635244af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802835:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00030e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.802841:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635244af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802850:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635244af lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802866:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a91:0x0].0x0 (ffff90ce03149b00)
00010000:00010000:1.0:1789431559.802869:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431559.802874:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635244af lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802880:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635244af lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802906:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802912:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802919:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802924:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f77a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.802927:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802933:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802942:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431559.802944:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.802947:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.802954:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431559.802969:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004868a45b reply state 0000000082c9bbaf transno 4295120840 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635244a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.802979:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431559.803256:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+455:14617:x1876351933396608:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2481us (10015us total) trans 4295120840 rc 0/0
00000100:00100000:1.0:1789431559.803266:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295691
00010000:00010000:3.0:1789431559.804462:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431559.804479:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb635244b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a91:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.804490:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e74200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431559.804494:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb635244b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a91:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.804506:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb635244b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a91:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.804526:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a91:0x0].0x0 (ffff90ce03149b00)
00010000:00010000:3.0:1789431559.804529:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431559.804534:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb635244b6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a91:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.804541:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb635244b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a91:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.804568:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431559.804571:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431559.804573:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431559.804691:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.805268:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933396864
00000100:00100000:1.0:1789431559.805292:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933396864
00000100:00100000:1.0:1789431559.805372:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295692
00000100:00100000:1.0:1789431559.805385:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+455:14616:x1876351933396864:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.805415:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.805418:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:1.0:1789431559.805448:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352449a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c851b expref: 455 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.805468:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.805473:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431559.805498:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb635244bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8522 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.805650:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635244c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.805668:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635244c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.805680:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635244c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.805698:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635244cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.805704:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635244cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.805710:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635244cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:1.0:1789431559.809489:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x50b:0x0], index 0: 0
00010000:00010000:1.0:1789431559.809743:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635244d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a92:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.809969:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635244d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a92:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.809989:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635244d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a92:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.810036:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635244c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.810043:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635244c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.810076:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635244c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.810083:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.810089:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635244c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.810102:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635244c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.810117:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.810120:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.810125:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635244c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.810132:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635244c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431559.810148:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005c1098e1 reply state 000000002f47a899 transno 4295120841 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635244cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.810158:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431559.810200:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb635244bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8522 expref: 457 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.810216:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635244d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a92:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8522 expref: 456 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.810224:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a92:0x0].0x0 (ffff90ce03149200)
00010000:00010000:1.0:1789431559.810227:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431559.810229:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e3c00, rc 0)
00000100:00100000:1.0:1789431559.810872:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+457:14616:x1876351933396864:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 5485us (6181us total) trans 4295120841 rc 0/0
00000100:00100000:1.0:1789431559.810882:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295692
00010000:00010000:0.0:1789431559.811743:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635244a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.811773:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635244a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.811783:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635244a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.811789:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f76400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.811793:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635244a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.811801:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635244a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.811817:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xec46fc5c (ffff90ce03149400)
00010000:00010000:0.0:1789431559.811820:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.811825:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635244a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.811831:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635244a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.814332:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.817931:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933396992
00000100:00100000:1.0:1789431559.817954:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933396992
00000100:00100000:1.0:1789431559.818064:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295693
00000100:00100000:1.0:1789431559.818078:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+456:14617:x1876351933396992:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.818111:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.818139:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb635244e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8529 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818227:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635244e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818246:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635244e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818259:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635244e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818278:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818444:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818452:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818525:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635244e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818533:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635244e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818541:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635244e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818548:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.818553:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635244e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818562:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635244e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818577:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431559.818580:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.818586:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635244e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818593:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635244e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818608:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818614:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818619:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818624:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f77a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.818627:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818633:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818646:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x4a14f308 (ffff90ce03149500)
00010000:00010000:1.0:1789431559.818648:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.818651:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818658:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818699:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb635244e0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8529 expref: 457 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818710:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431559.818712:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.818716:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb635244e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8529 expref: 457 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.818727:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e3000, rc 0)
00000100:00100000:1.0:1789431559.818915:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+456:14617:x1876351933396992:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 839us (4596us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431559.818923:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295693
00000100:00100000:3.0:1789431559.820842:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.820954:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933397120
00000100:00100000:0.0:1789431559.820966:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933397120
00010000:00010000:2.0:1789431559.821036:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635244cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431559.821039:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8181
00000100:00100000:0.0:1789431559.821071:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+135:2347:x1876351933397120:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431559.821079:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635244cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.821088:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635244cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.821093:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431559.821094:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.821099:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635244cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.821112:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635244cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.821121:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d98238d4/0xd8e438fb635244f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8530 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.821130:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xec46fc5c (ffff90ce03149000)
00010000:00010000:2.0:1789431559.821133:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.821138:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635244cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.821144:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635244cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789431559.821155:0:14469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x50b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431559.821182:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50b:0x0].0x0 since=3017s v=(0 0)
00010000:00010000:0.0:1789431559.821187:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431559.821200:0:14469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d98238d4/0xd8e438fb635244f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8530 expref: 136 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.821218:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d98238d4/0xd8e438fb635244f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8530 expref: 136 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.821231:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce156e0200, rc 0)
00000100:00100000:0.0:1789431559.821304:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+136:2347:x1876351933397120:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 256us (475us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431559.821311:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8181
00000100:00100000:2.0:1789431559.830609:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.830723:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933397248
00000100:00100000:1.0:1789431559.830737:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933397248
00000100:00100000:1.0:1789431559.830834:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295694
00000100:00100000:1.0:1789431559.830847:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+455:14617:x1876351933397248:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.830881:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.830912:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8537 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.831009:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524503 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.831028:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.831043:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431559.831197:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:0.0:1789431559.831203:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431559.831244:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.831275:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635244fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8537 expref: 457 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.831304:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524503 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8537 expref: 456 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.831314:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.831317:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431559.831321:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37f77c00, rc 0)
00000100:00100000:0.0:1789431559.831394:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+456:14617:x1876351933397248:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 550us (800us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431559.831402:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295694
00000100:00100000:2.0:1789431559.836558:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.836654:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933397376
00000100:00100000:3.0:1789431559.836668:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933397376
00000100:00100000:3.0:1789431559.836747:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12399
00000100:00100000:3.0:1789431559.836777:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+456:14617:x1876351933397376:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:2.0:1789431559.845393:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.845603:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933397632
00000100:00100000:3.0:1789431559.845618:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933397632
00000100:00100000:3.0:1789431559.845699:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12400
00000100:00100000:3.0:1789431559.845712:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+457:14616:x1876351933397632:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431559.846219:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+458:14616:x1876351933397632:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 505us (836us total) trans 4295120842 rc 0/0
00000100:00100000:3.0:1789431559.846227:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12400
00000100:00100000:2.0:1789431559.846606:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+457:14617:x1876351933397376:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 9837us (10060us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431559.846615:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12399
00000100:00100000:2.0:1789431559.854764:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.854823:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.854979:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933397888
00000100:00100000:1.0:1789431559.854993:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933397888
00000100:00100000:1.0:1789431559.855108:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933398144
00000100:00100000:1.0:1789431559.855112:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933398144
00000100:00100000:1.0:1789431559.855135:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295695
00000100:00100000:1.0:1789431559.855146:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+458:14617:x1876351933397888:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.855175:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.855205:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352450a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c853e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855423:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524511 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855442:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524511 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855455:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524511 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855472:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524518 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855480:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855486:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855555:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524511 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855562:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524511 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855569:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524511 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855575:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f76400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.855580:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524511 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855588:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524511 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855603:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431559.855606:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.855612:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524511 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855619:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524511 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855634:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855641:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524518 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855648:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855653:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.855656:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855662:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524518 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855669:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x4a14f308 (ffff90ce03149500)
00010000:00010000:1.0:1789431559.855672:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.855674:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524518 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855679:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524518 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855720:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352450a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c853e expref: 459 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855731:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431559.855733:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:1.0:1789431559.855737:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352450a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c853e expref: 459 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.855840:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37f77a00, rc 0)
00000100:00100000:1.0:1789431559.855929:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+458:14617:x1876351933397888:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 784us (1189us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431559.855938:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295695
00000100:00100000:1.0:1789431559.855968:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295696
00000100:00100000:1.0:1789431559.855978:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+457:14616:x1876351933398144:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431559.856015:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431559.856031:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635244d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a92:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8522 expref: 457 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.856041:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a92:0x0].0x0 (ffff90ce03149200)
00010000:00010000:1.0:1789431559.856093:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431559.856108:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352451f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.856118:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352451f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.856125:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352451f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.856137:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524526 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.856143:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524526 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.856152:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524526 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.856267:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb6352452d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a92:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.856276:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb6352452d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a92:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.856582:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb6352452d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a92:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431559.858636:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1206, 64 off85376
00010000:00010000:1.0:1789431559.858745:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524534 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a92:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.858886:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a92:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.858902:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a92:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.858912:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524534 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a92:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.858919:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524534 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a92:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.858926:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524534 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a92:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.859027:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431559.859100:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb6352452d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a92:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.859107:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb6352452d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a92:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.859114:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb6352452d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a92:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.859119:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.859124:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb6352452d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a92:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.859132:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb6352452d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a92:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.859146:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a92:0x0].0x0 (ffff90ce03149100)
00010000:00010000:1.0:1789431559.859149:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431559.859155:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb6352452d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a92:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.859161:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb6352452d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a92:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.859188:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352451f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.859195:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352451f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.859201:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352451f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.859210:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.859213:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352451f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.859219:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352451f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.859228:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.859231:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.859234:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352451f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.859240:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352451f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431559.859254:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007e8ab471 reply state 000000007a22e8f8 transno 4295120843 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524526 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.859266:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431559.859526:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+458:14616:x1876351933398144:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3543us (4695us total) trans 4295120843 rc 0/0
00000100:00100000:1.0:1789431559.859536:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295696
00010000:00010000:0.0:1789431559.867619:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431559.867640:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524534 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a92:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.867655:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431559.867660:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524534 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a92:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.867671:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524534 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a92:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.867695:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a92:0x0].0x0 (ffff90ce03149100)
00010000:00010000:0.0:1789431559.867698:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431559.867705:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524534 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a92:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.867712:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524534 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a92:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.867771:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431559.867774:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431559.867776:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431559.869360:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524526 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.869382:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524526 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.869391:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524526 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.869397:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.869402:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524526 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.869410:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524526 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.869428:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xec46fc5c (ffff90ce03149e00)
00010000:00010000:0.0:1789431559.869431:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.869436:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524526 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.869443:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524526 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431559.871421:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.871468:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.871558:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933398272
00000100:00100000:0.0:1789431559.871572:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933398272
00000100:00100000:0.0:1789431559.871641:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933398400
00000100:00100000:0.0:1789431559.871645:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933398400
00000100:00100000:0.0:1789431559.871680:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295697
00000100:00100000:0.0:1789431559.871693:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+458:14616:x1876351933398272:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.871721:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.871764:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb6352453b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8545 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.871859:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524542 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.871878:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524542 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.871890:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524542 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.871911:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63524549 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.871919:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63524549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.871926:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63524549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872000:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524542 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872008:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524542 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872016:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524542 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872023:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e1800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.872028:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524542 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872037:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524542 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872083:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431559.872087:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.872093:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524542 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872101:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524542 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872119:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63524549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872126:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63524549 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872132:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63524549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872138:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.872141:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63524549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872148:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63524549 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872160:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x6ed7d01b (ffff90ce15f12900)
00010000:00010000:0.0:1789431559.872162:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.872165:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63524549 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872171:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb63524549 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872212:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb6352453b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8545 expref: 459 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872225:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431559.872227:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.872230:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb6352453b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8545 expref: 459 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872241:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce156e1a00, rc 0)
00000100:00100000:0.0:1789431559.872327:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+458:14616:x1876351933398272:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 636us (921us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431559.872336:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295697
00000100:00100000:0.0:1789431559.872364:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295698
00000100:00100000:0.0:1789431559.872373:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+457:14617:x1876351933398400:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.872390:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.872403:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524550 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c854c expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872444:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524557 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872456:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524557 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872463:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524557 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872477:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352455e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872484:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352455e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872490:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352455e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872529:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524557 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872536:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524557 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872542:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524557 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872546:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.872549:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524557 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872555:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524557 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872567:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.872569:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.872572:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524557 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872578:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524557 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872587:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352455e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872593:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352455e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872599:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352455e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872604:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6b800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.872607:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352455e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872612:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352455e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872619:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xf390cc35 (ffff90ce0bc57500)
00010000:00010000:0.0:1789431559.872622:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.872624:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352455e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872630:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb6352455e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872655:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524550 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c854c expref: 458 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872663:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.872666:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.872669:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524550 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c854c expref: 458 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.872678:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6ba00, rc 0)
00000100:00100000:0.0:1789431559.872704:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+457:14617:x1876351933398400:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 332us (1236us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431559.872711:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295698
00000100:00100000:2.0:1789431559.880276:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.880405:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933398528
00000100:00100000:1.0:1789431559.880420:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933398528
00000100:00100000:1.0:1789431559.880497:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295699
00000100:00100000:1.0:1789431559.880510:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+457:14616:x1876351933398528:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.880539:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.880567:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524565 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8553 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.880656:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb6352456c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.880675:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb6352456c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.880689:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb6352456c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431559.880737:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:1.0:1789431559.880741:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431559.880783:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb6352456c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.880816:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524565 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8553 expref: 459 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.880838:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb6352456c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8553 expref: 458 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.880847:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.880850:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431559.880854:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e2400, rc 0)
00000100:00100000:1.0:1789431559.880936:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+458:14616:x1876351933398528:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 428us (675us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431559.880944:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295699
00000100:00100000:0.0:1789431559.886711:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.886900:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933398656
00000100:00100000:2.0:1789431559.886915:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933398656
00000100:00100000:2.0:1789431559.886995:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295700
00000100:00100000:2.0:1789431559.887009:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+458:14617:x1876351933398656:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431559.887038:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431559.887117:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524573 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c855a expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887221:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352457a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887241:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352457a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887256:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352457a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887276:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524581 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887295:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887303:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887381:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352457a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887390:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352457a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887398:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352457a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887405:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.887411:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352457a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887420:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352457a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887435:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.887438:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.887860:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352457a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887871:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352457a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887890:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887896:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524581 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887903:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524581 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887909:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.887912:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524581 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887918:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524581 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887927:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xec46fc5c (ffff90ce359c6c00)
00010000:00010000:2.0:1789431559.887929:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.887933:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524581 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887940:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524581 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887987:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524573 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c855a expref: 459 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.887999:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.888001:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.888005:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524573 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c855a expref: 459 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.888016:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309c00, rc 0)
00000100:00100000:2.0:1789431559.888204:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+458:14617:x1876351933398656:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1197us (1508us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431559.888214:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295700
00000100:00100000:2.0:1789431559.892255:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.893722:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933398784
00000100:00100000:1.0:1789431559.893745:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933398784
00000100:00100000:1.0:1789431559.893864:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12401
00000100:00100000:1.0:1789431559.893879:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+458:14616:x1876351933398784:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431559.897983:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+458:14616:x1876351933398784:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 4091us (5726us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431559.898002:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12401
00000100:00100000:2.0:1789431559.899227:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.899317:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933399040
00000100:00100000:3.0:1789431559.899328:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933399040
00000100:00100000:3.0:1789431559.899400:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295701
00000100:00100000:3.0:1789431559.899414:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+458:14617:x1876351933399040:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431559.899443:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431559.899446:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431559.899484:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524503 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8537 expref: 458 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.899510:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431559.899517:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431559.899535:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524588 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8561 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.899692:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb6352458f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.899711:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb6352458f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.899726:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb6352458f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.899745:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524596 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.899763:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.899771:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:3.0:1789431559.900516:0:12181:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x50b:0x0], index 1: 0
00010000:00010000:3.0:1789431559.900727:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb6352459d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a93:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.900743:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb6352459d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a93:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.900767:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb6352459d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a93:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.900814:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb6352458f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.900822:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb6352458f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.900830:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb6352458f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.900842:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.900847:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb6352458f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.900856:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb6352458f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.900868:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431559.900871:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.900876:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb6352458f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.900883:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb6352458f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431559.900897:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000094ee0772 reply state 000000001348da82 transno 4295120844 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431559.900907:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431559.900948:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524588 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8561 expref: 460 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.900964:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb6352459d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a93:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8561 expref: 459 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.900972:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a93:0x0].0x0 (ffff90cf11d83d00)
00010000:00010000:3.0:1789431559.900974:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431559.900977:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ac43800, rc 0)
00000100:00100000:3.0:1789431559.901113:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+460:14617:x1876351933399040:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1701us (1895us total) trans 4295120844 rc 0/0
00000100:00100000:3.0:1789431559.901123:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295701
00000100:00100000:2.0:1789431559.907873:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.908108:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933399168
00000100:00100000:3.0:1789431559.908123:0:14464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933399168
00000100:00100000:3.0:1789431559.908195:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8182
00000100:00100000:3.0:1789431559.908207:0:14464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+123:2347:x1876351933399168:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431559.908233:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431559.908264:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cfe7545/0xd8e438fb635245ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8568 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431559.908314:0:14464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x50b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431559.908343:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50b:0x0].0x0 since=3017s v=(0 0)
00010000:00010000:3.0:1789431559.908348:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431559.908361:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cfe7545/0xd8e438fb635245ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8568 expref: 124 pid: 14464 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.908385:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002cfe7545/0xd8e438fb635245ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8568 expref: 124 pid: 14464 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.908401:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb2f800, rc 0)
00000100:00100000:3.0:1789431559.908488:0:14464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+124:2347:x1876351933399168:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 283us (630us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431559.908495:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8182
00010000:00010000:0.0:1789431559.908679:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.908689:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524596 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.908697:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524596 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.908704:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac43c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.908710:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524596 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.908719:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524596 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.908741:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xec46fc5c (ffff90cf11d83f00)
00010000:00010000:0.0:1789431559.908745:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.908760:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524596 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.908767:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb63524596 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431559.912965:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431559.913521:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933399424
00000100:00100000:1.0:1789431559.913537:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933399424
00000100:00100000:1.0:1789431559.913622:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295702
00000100:00100000:1.0:1789431559.913635:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+459:14616:x1876351933399424:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.913669:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.913697:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635245b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c856f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.913810:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635245b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.913830:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635245b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.913844:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635245b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.913864:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb635245c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.913872:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb635245c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.913877:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb635245c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.913948:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635245b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.913957:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635245b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.913964:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635245b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.913970:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.913975:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635245b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.913983:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635245b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.913997:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.914001:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.914006:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635245b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.914014:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635245b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.914030:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb635245c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.914036:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb635245c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.914041:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb635245c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.914462:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.914466:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb635245c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.914475:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb635245c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.914483:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x6ed7d01b (ffff90ce03149200)
00010000:00010000:1.0:1789431559.914486:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.914489:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb635245c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.914496:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb635245c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.914541:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635245b2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c856f expref: 460 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.914552:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.914555:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:1.0:1789431559.914558:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635245b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c856f expref: 460 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.914567:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e3c00, rc 0)
00000100:00100000:2.0:1789431559.914893:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+459:14616:x1876351933399424:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1256us (1939us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431559.914902:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295702
00000100:00100000:1.0:1789431559.918349:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.918541:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933399680
00000100:00100000:2.0:1789431559.918556:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933399680
00000100:00100000:2.0:1789431559.918633:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12402
00000100:00100000:2.0:1789431559.918646:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+459:14617:x1876351933399680:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431559.919185:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+460:14617:x1876351933399680:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 540us (849us total) trans 4295120845 rc 0/0
00000100:00100000:2.0:1789431559.919196:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12402
00000100:00100000:3.0:1789431559.930446:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.930517:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.930690:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933400064
00000100:00100000:2.0:1789431559.930705:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933400064
00000100:00100000:2.0:1789431559.930790:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933399808
00000100:00100000:2.0:1789431559.930794:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933399808
00000100:00100000:2.0:1789431559.930836:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295703
00000100:00100000:2.0:1789431559.930849:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+461:14617:x1876351933400064:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431559.930927:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431559.930964:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb6352459d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a93:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8561 expref: 461 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.930988:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a93:0x0].0x0 (ffff90cf11d83d00)
00010000:00010000:2.0:1789431559.931003:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431559.931031:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635245c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.931106:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635245c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.931120:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635245c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.931137:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635245ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.931146:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635245ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.931153:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635245ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.931321:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635245d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a93:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.931331:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635245d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a93:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.931338:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635245d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a93:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431559.931987:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295704
00000040:00080000:2.0:1789431559.932001:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1208, 64 off85568
00000100:00100000:3.0:1789431559.932007:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+460:14616:x1876351933399808:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431559.932029:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431559.932075:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb635245dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8576 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932141:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635245e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932154:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635245e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932166:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635245e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932182:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635245ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932189:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635245ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932197:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635245ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932236:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635245e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932574:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635245f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a93:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932587:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635245f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a93:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932594:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635245e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932599:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635245f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a93:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932607:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635245e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932612:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635245f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a93:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932620:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.932624:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635245f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a93:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932627:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635245e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932638:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635245f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a93:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932643:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635245e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932669:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431559.932674:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431559.932679:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.932684:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635245e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932690:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635245e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932696:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635245d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a93:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932706:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635245ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932712:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635245d5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a93:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932718:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635245ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932725:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635245d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a93:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932728:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635245ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932741:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.932743:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.932757:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635245d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a93:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932757:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635245ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932778:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635245ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932780:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635245d5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a93:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932804:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a93:0x0].0x0 (ffff90ce359c6800)
00010000:00010000:3.0:1789431559.932806:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xec46fc5c (ffff90cf062f5600)
00010000:00010000:2.0:1789431559.932810:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431559.932812:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.932817:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635245ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932818:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635245d5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a93:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932830:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635245ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932833:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635245d5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a93:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932861:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635245c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932868:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635245c7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932874:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635245c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932880:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb635245dc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8576 expref: 462 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932882:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.932889:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635245c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932896:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431559.932899:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635245c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.932901:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.932907:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb635245dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8576 expref: 462 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932916:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431559.932920:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ac43c00, rc 0)
00010000:00010000:2.0:1789431559.932921:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.932927:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635245c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.932935:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635245c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431559.932948:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000048f62ce0 reply state 000000000e3e501c transno 4295120846 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635245ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431559.932958:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431559.933079:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431559.933088:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635245f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a93:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.933095:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431559.933099:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635245f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a93:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.933105:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635245f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a93:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.933116:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a93:0x0].0x0 (ffff90ce359c6800)
00000100:00100000:3.0:1789431559.933118:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+462:14616:x1876351933399808:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1117us (2597us total) trans 0 rc 301/301
00010000:00010000:0.0:1789431559.933121:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431559.933126:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635245f1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a93:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431559.933134:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295704
00010000:00010000:0.0:1789431559.933137:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635245f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a93:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.933158:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431559.933160:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431559.933162:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431559.933377:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+461:14617:x1876351933400064:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2529us (2944us total) trans 4295120846 rc 0/0
00000100:00100000:2.0:1789431559.933385:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295703
00000100:00100000:1.0:1789431559.945162:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431559.945562:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635245ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.945577:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635245ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.945587:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635245ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.945599:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431559.945605:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635245ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.945614:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635245ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.945634:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xec46fc5c (ffff90ce359c6c00)
00010000:00010000:3.0:1789431559.945636:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431559.945642:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635245ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.945658:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635245ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431559.945744:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933400192
00000100:00100000:2.0:1789431559.946360:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933400192
00000100:00100000:2.0:1789431559.946450:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295705
00000100:00100000:2.0:1789431559.946462:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+460:14617:x1876351933400192:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431559.946490:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431559.946514:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635245f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c857d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946600:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635245ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946617:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635245ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946631:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635245ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946649:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524606 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946656:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946663:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946738:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635245ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946746:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635245ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946764:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635245ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946841:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.946845:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635245ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946853:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635245ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946869:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.946873:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.946878:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635245ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946885:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635245ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946900:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946906:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524606 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946912:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524606 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946918:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431559.946921:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524606 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946927:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524606 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946934:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xf390cc35 (ffff90ce359c6900)
00010000:00010000:2.0:1789431559.946937:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.946940:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524606 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946946:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524606 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.946989:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635245f8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c857d expref: 461 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.947001:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431559.947004:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431559.947008:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635245f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c857d expref: 461 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431559.947018:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308e00, rc 0)
00000100:00100000:2.0:1789431559.947153:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+460:14617:x1876351933400192:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 692us (2004us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431559.947161:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295705
00000100:00100000:2.0:1789431559.951555:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431559.951667:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.954573:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933400448
00000100:00100000:0.0:1789431559.954596:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933400448
00000100:00100000:1.0:1789431559.954680:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933400576
00000100:00100000:1.0:1789431559.954686:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933400576
00000100:00100000:1.0:1789431559.954739:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295706
00000100:00100000:1.0:1789431559.954761:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+461:14616:x1876351933400448:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431559.954795:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.954800:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:1.0:1789431559.954837:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb6352456c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8553 expref: 461 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.954860:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.954866:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431559.954883:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352460d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8584 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.955044:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524614 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431559.955073:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295707
00000100:00100000:3.0:1789431559.955089:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+461:14617:x1876351933400576:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431559.955102:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431559.955106:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524614 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.955118:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb6352461b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c858b expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.955122:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524614 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.955151:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524622 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.955158:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524622 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.955165:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524622 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.955180:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524629 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.955193:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.955203:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431559.955250:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:3.0:1789431559.955254:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431559.955278:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.955316:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43c00/0xd8e438fb6352461b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c858b expref: 463 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.955333:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524629 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c858b expref: 462 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.955341:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431559.955344:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431559.955347:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ac42400, rc 0)
00000100:00100000:3.0:1789431559.955434:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+462:14617:x1876351933400576:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 351us (3766us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431559.955441:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295707
00000004:00080000:1.0:1789431559.963077:0:12775:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x50c:0x0], index 0: 0
00010000:00010000:1.0:1789431559.963388:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524630 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a94:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.963412:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524630 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a94:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.963429:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524630 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a94:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.963483:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524614 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.963491:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524614 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.963500:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524614 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.963507:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431559.963513:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524614 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.963522:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524614 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.963539:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431559.963543:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431559.963550:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524614 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.963557:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524614 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431559.963580:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000089b28198 reply state 0000000014468b25 transno 4295120847 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524622 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431559.963590:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431559.963638:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb6352460d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8584 expref: 463 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.963655:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524630 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a94:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8584 expref: 462 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431559.963663:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a94:0x0].0x0 (ffff90ce03149500)
00010000:00010000:1.0:1789431559.963665:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431559.963667:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e3c00, rc 0)
00000100:00100000:1.0:1789431559.963796:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+463:14616:x1876351933400448:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9046us (12257us total) trans 4295120847 rc 0/0
00000100:00100000:1.0:1789431559.963808:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295706
00000100:00100000:2.0:1789431559.966671:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.966720:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933400704
00000100:00100000:3.0:1789431559.966742:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933400704
00000100:00100000:3.0:1789431559.966942:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12403
00000100:00100000:3.0:1789431559.966954:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+463:14617:x1876351933400704:12345-192.168.203.4@tcp:37:dbench.0
00010000:00010000:0.0:1789431559.967185:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524622 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.967199:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524622 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.967211:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524622 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.967218:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.967224:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524622 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.967233:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524622 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.967254:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xec46fc5c (ffff90ce03149200)
00010000:00010000:0.0:1789431559.967258:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.967263:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524622 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.967271:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524622 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431559.972684:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.973670:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933400832
00000100:00100000:3.0:1789431559.973686:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933400832
00000100:00100000:3.0:1789431559.973779:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8183
00000100:00100000:3.0:1789431559.973793:0:14500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+136:2348:x1876351933400832:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431559.973819:0:14500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431559.973850:0:14500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060ea8e37/0xd8e438fb6352463e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8592 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431559.973891:0:14500:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x50c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431559.973921:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50c:0x0].0x0 since=3018s v=(0 0)
00010000:00010000:3.0:1789431559.973926:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431559.973938:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060ea8e37/0xd8e438fb6352463e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8592 expref: 137 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.973961:0:14500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000060ea8e37/0xd8e438fb6352463e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8592 expref: 137 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431559.973977:0:14500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ac43c00, rc 0)
00000100:00100000:3.0:1789431559.974102:0:14500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+137:2348:x1876351933400832:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 311us (1432us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431559.974113:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8183
00000100:00100000:3.0:1789431559.987565:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+462:14617:x1876351933400704:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 20592us (20889us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431559.987585:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12403
00000100:00100000:0.0:1789431559.988690:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431559.989129:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933401088
00000100:00100000:3.0:1789431559.989142:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933401088
00000100:00100000:3.0:1789431559.989213:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12404
00000100:00100000:3.0:1789431559.989226:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+462:14616:x1876351933401088:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431559.989913:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+463:14616:x1876351933401088:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 684us (1224us total) trans 4295120848 rc 0/0
00000100:00100000:3.0:1789431559.989924:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12404
00000100:00100000:3.0:1789431559.993725:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431559.996600:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933401344
00000100:00100000:0.0:1789431559.996621:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933401344
00000100:00100000:0.0:1789431559.996879:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295708
00000100:00100000:0.0:1789431559.996895:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+463:14617:x1876351933401344:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431559.996931:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431559.996963:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524645 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8599 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997135:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352464c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997156:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352464c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997175:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352464c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997195:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524653 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997203:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997224:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997308:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352464c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997316:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352464c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997324:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352464c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997332:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.997338:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352464c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997347:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352464c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997362:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.997366:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.997371:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352464c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997378:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352464c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997395:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997401:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524653 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997407:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524653 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997412:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6b800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431559.997415:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524653 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997421:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524653 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997429:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xf390cc35 (ffff90ce0bc57500)
00010000:00010000:0.0:1789431559.997432:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431559.997435:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524653 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997441:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524653 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997482:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524645 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8599 expref: 464 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997494:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431559.997497:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:0.0:1789431559.997501:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb63524645 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8599 expref: 464 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431559.997512:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6a800, rc 0)
00000100:00100000:0.0:1789431559.997658:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+463:14617:x1876351933401344:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 767us (3951us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431559.997666:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295708
00000100:00100000:3.0:1789431560.024638:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.024815:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933401472
00000100:00100000:1.0:1789431560.024830:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933401472
00000100:00100000:1.0:1789431560.024942:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295709
00000100:00100000:1.0:1789431560.024957:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+463:14617:x1876351933401472:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.024986:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.025029:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb6352465a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c85a0 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025176:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524661 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025200:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524661 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025216:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524661 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025236:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524668 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025245:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025267:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025337:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524661 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025345:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524661 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025353:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524661 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025361:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.025366:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524661 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025375:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524661 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025395:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.025398:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.025405:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524661 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025411:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524661 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025428:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025433:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524668 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025439:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025444:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.025447:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025453:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524668 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025460:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x806a17dc (ffff90ce03149800)
00010000:00010000:1.0:1789431560.025462:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.025465:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524668 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025470:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524668 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025507:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb6352465a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85a0 expref: 464 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025519:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.025521:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.025524:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb6352465a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85a0 expref: 464 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.025533:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e2800, rc 0)
00000100:00100000:1.0:1789431560.025617:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+463:14617:x1876351933401472:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 665us (995us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431560.025626:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295709
00000100:00080000:2.0:1789431560.025841:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:1.0:1789431560.031854:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.032164:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933401728
00000100:00100000:0.0:1789431560.032179:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933401728
00000100:00100000:0.0:1789431560.032258:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295710
00000100:00100000:0.0:1789431560.032272:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+463:14616:x1876351933401728:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431560.032367:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431560.032406:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524630 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a94:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8584 expref: 463 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.032432:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a94:0x0].0x0 (ffff90ce03149500)
00010000:00010000:0.0:1789431560.032447:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431560.032476:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352466f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.032493:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352466f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.032503:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352466f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.032518:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524676 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.032525:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524676 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.032531:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524676 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.033019:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352467d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a94:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.033029:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352467d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.033037:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352467d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:0.0:1789431560.034729:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1207, 64 off85440
00010000:00010000:0.0:1789431560.036675:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524684 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.036707:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524684 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a94:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.036727:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524684 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a94:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.036738:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524684 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a94:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.036745:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524684 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a94:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.036773:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524684 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a94:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.037075:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431560.037113:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352467d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a94:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.037121:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352467d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a94:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.037129:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352467d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a94:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.037136:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.037141:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352467d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a94:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.037148:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352467d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a94:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.037164:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a94:0x0].0x0 (ffff90cf11d83d00)
00010000:00010000:0.0:1789431560.037167:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431560.037174:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352467d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a94:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.037181:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352467d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a94:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.037211:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352466f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.037218:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352466f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.037224:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352466f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.037230:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.037233:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352466f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.037239:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352466f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.037248:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.037250:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.037254:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352466f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.037259:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352466f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431560.037270:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001b1c23e2 reply state 00000000641d149a transno 4295120849 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524676 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.037672:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431560.038031:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+464:14616:x1876351933401728:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 5756us (6187us total) trans 4295120849 rc 0/0
00000100:00100000:0.0:1789431560.038043:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295710
00000100:00100000:0.0:1789431560.044528:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.044840:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933401984
00000100:00100000:2.0:1789431560.044856:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933401984
00000100:00100000:2.0:1789431560.044926:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295711
00000100:00100000:2.0:1789431560.044940:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+464:14616:x1876351933401984:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.044973:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.045001:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352468b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c85ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.045089:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431560.045099:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524684 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a94:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.045109:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6ba00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.045115:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524684 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a94:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045119:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524692 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.045125:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524684 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a94:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045142:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524692 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.045146:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a94:0x0].0x0 (ffff90cf11d83d00)
00010000:00010000:1.0:1789431560.045153:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431560.045158:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524692 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.045159:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524684 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a94:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045186:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524699 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045194:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524699 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045201:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524699 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045275:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524692 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045296:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524692 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045303:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524692 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045319:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.045322:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524684 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a94:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045324:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524692 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045340:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524692 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.045355:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431560.045356:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.045359:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431560.045361:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.045363:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431560.045367:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524692 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045376:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524692 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045387:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524699 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045394:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524699 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045400:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524699 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045405:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.045408:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524699 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045414:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524699 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045421:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x6ed7d01b (ffff90ce359c6900)
00010000:00010000:2.0:1789431560.045424:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.045427:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524699 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045433:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524699 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045471:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352468b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85ae expref: 465 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045483:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431560.045485:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.045489:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3800/0xd8e438fb6352468b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85ae expref: 465 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.045500:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3800, rc 0)
00000100:00100000:2.0:1789431560.045586:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+464:14616:x1876351933401984:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 649us (1074us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431560.045594:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295711
00010000:00010000:3.0:1789431560.047162:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524676 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.047183:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524676 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.047192:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524676 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.047198:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6b800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.047204:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524676 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.047211:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524676 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.047231:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xec46fc5c (ffff90ce0bc57500)
00010000:00010000:3.0:1789431560.047234:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.047238:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524676 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.047245:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524676 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.049618:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.050705:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933401856
00000100:00100000:3.0:1789431560.050724:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933401856
00000100:00100000:2.0:1789431560.051984:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295712
00000100:00100000:2.0:1789431560.052006:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+463:14617:x1876351933401856:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.052034:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.052098:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635246a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c85a7 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052193:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635246a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052211:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635246a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052225:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635246a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052245:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052252:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052259:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052331:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635246a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052340:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635246a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052348:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635246a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052355:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.052360:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635246a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052368:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635246a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052381:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.052384:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.052390:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635246a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052397:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635246a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052415:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052422:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052428:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052433:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.052436:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052441:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052449:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x411ba88 (ffff90ce359c6c00)
00010000:00010000:2.0:1789431560.052453:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.052455:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052461:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052502:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635246a0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85a7 expref: 464 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052512:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.052514:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.052518:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635246a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85a7 expref: 464 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.052528:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308e00, rc 0)
00000100:00100000:2.0:1789431560.052628:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+463:14617:x1876351933401856:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 630us (3023us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431560.052636:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295712
00000100:00100000:1.0:1789431560.057090:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.057193:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933402112
00000100:00100000:2.0:1789431560.057208:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933402112
00000100:00100000:2.0:1789431560.057293:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295713
00000100:00100000:2.0:1789431560.057307:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+463:14616:x1876351933402112:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.057335:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.057363:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635246b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c85b5 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.057449:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635246bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.057469:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635246bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.057484:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635246bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431560.057533:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:2.0:1789431560.057538:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431560.057562:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635246bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.057590:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635246b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85b5 expref: 465 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.057613:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635246bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85b5 expref: 464 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.057622:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431560.057626:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:2.0:1789431560.057630:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309c00, rc 0)
00000100:00100000:2.0:1789431560.057714:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+464:14616:x1876351933402112:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 410us (640us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.057721:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295713
00000100:00100000:3.0:1789431560.062784:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.063017:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933402240
00000100:00100000:1.0:1789431560.063032:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933402240
00000100:00100000:1.0:1789431560.063146:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12405
00000100:00100000:1.0:1789431560.063160:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+464:14616:x1876351933402240:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431560.067513:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+464:14616:x1876351933402240:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 4337us (4741us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431560.067530:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12405
00000100:00100000:0.0:1789431560.074894:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.075114:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933402496
00000100:00100000:1.0:1789431560.075129:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933402496
00000100:00100000:1.0:1789431560.075215:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295714
00000100:00100000:1.0:1789431560.075228:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+464:14616:x1876351933402496:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.075259:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.075458:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635246c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c85bc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.075555:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb635246ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.075573:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb635246ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.075591:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb635246ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.075612:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635246d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.075619:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635246d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.075625:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635246d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.075694:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb635246ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.075703:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb635246ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.075710:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb635246ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.075717:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.075722:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb635246ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.075730:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb635246ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.075744:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.075746:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.075763:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb635246ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.075769:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb635246ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.075784:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635246d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.075790:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635246d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.076832:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635246d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.076841:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.076845:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635246d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.076854:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635246d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.076869:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x6ed7d01b (ffff90ce03149800)
00010000:00010000:1.0:1789431560.076873:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.076877:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635246d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.076884:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635246d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.076953:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635246c3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85bc expref: 465 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.076969:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.076972:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:1.0:1789431560.076976:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635246c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85bc expref: 465 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.076987:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e3a00, rc 0)
00000100:00100000:1.0:1789431560.077142:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+464:14616:x1876351933402496:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1860us (2205us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431560.077151:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295714
00000100:00100000:1.0:1789431560.078133:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.078397:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933402752
00000100:00100000:2.0:1789431560.078410:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933402752
00000100:00100000:2.0:1789431560.078479:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295715
00000100:00100000:2.0:1789431560.078492:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+464:14617:x1876351933402752:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.078515:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.078518:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:2.0:1789431560.078548:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524629 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c858b expref: 464 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.078567:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.078573:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431560.078590:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635246d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c85c3 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.078738:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635246df lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.078777:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635246df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.078789:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635246df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.078815:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.078824:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.078830:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:2.0:1789431560.079737:0:12775:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x50c:0x0], index 1: 0
00010000:00010000:2.0:1789431560.082601:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635246ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a95:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.082633:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635246ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a95:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.082649:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635246ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a95:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.082701:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635246df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.082709:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635246df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.082721:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635246df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.082728:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.082733:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635246df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.082742:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635246df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.083039:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.083044:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.083229:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635246df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.083239:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635246df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431560.083263:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c4e9cc54 reply state 00000000ed0be080 transno 4295120850 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.083274:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:2.0:1789431560.083538:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635246d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85c3 expref: 466 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.083563:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635246ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a95:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85c3 expref: 465 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.083572:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a95:0x0].0x0 (ffff90ce359c6900)
00010000:00010000:2.0:1789431560.083575:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431560.083578:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:2.0:1789431560.083731:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+466:14617:x1876351933402752:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 5238us (5601us total) trans 4295120850 rc 0/0
00000100:00100000:2.0:1789431560.083740:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295715
00000100:00100000:1.0:1789431560.091009:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.093252:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933402880
00000100:00100000:3.0:1789431560.093272:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933402880
00000100:00100000:3.0:1789431560.093519:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295716
00000100:00100000:3.0:1789431560.093532:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+466:14616:x1876351933402880:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431560.093562:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431560.093592:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635246fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c85ca expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.093680:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524702 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.093701:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524702 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.093715:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524702 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.093736:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524709 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.093743:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.093761:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.094330:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.094344:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.094351:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.094358:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.094363:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.094371:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.094388:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x411ba88 (ffff90ce359c6c00)
00010000:00010000:0.0:1789431560.094391:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.094397:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.094404:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635246e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.094601:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524702 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.094610:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524702 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.094615:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524702 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.094624:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.094627:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524702 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.094633:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524702 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.094642:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431560.094645:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.094648:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524702 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.094655:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524702 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.094667:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.094674:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524709 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.094680:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524709 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.094685:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e74200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.094688:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524709 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.094694:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524709 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.094705:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x897a18fd (ffff90ce0bc57500)
00010000:00010000:3.0:1789431560.094708:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.094711:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524709 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.094717:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524709 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.094772:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635246fb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85ca expref: 466 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.094783:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431560.094785:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.094789:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635246fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85ca expref: 466 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.095005:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ac43800, rc 0)
00000100:00100000:2.0:1789431560.100775:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+465:14616:x1876351933402880:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7210us (9746us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431560.100793:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295716
00000100:00100000:0.0:1789431560.100811:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.100901:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933403008
00000100:00100000:3.0:1789431560.100914:0:14491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933403008
00000100:00080000:0.0:1789431560.100956:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1789431560.101001:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8184
00000100:00100000:3.0:1789431560.101013:0:14491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+124:2347:x1876351933403008:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431560.101036:0:14491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431560.101082:0:14491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003662928/0xd8e438fb63524710 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c85d1 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431560.101123:0:14491:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x50c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431560.101151:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50c:0x0].0x0 since=3018s v=(0 0)
00010000:00010000:3.0:1789431560.101157:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431560.101168:0:14491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003662928/0xd8e438fb63524710 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85d1 expref: 125 pid: 14491 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.101192:0:14491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000003662928/0xd8e438fb63524710 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85d1 expref: 125 pid: 14491 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.101207:0:14491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce387a5200, rc 0)
00000100:00100000:3.0:1789431560.101273:0:14491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+125:2347:x1876351933403008:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 263us (462us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431560.101286:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8184
00000100:00100000:0.0:1789431560.114216:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.114329:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933403264
00000100:00100000:3.0:1789431560.114343:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933403264
00000100:00100000:3.0:1789431560.114424:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12406
00000100:00100000:3.0:1789431560.114437:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+465:14617:x1876351933403264:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431560.114955:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+466:14617:x1876351933403264:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 518us (753us total) trans 4295120851 rc 0/0
00000100:00100000:3.0:1789431560.114965:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12406
00000100:00100000:1.0:1789431560.119564:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.119699:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933403392
00000100:00100000:2.0:1789431560.119713:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933403392
00000100:00100000:2.0:1789431560.119945:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295717
00000100:00100000:2.0:1789431560.119958:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+466:14616:x1876351933403392:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.119991:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.120019:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524717 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c85d8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120317:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352471e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120338:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352471e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120353:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352471e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120373:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524725 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120382:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120388:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120460:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352471e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120470:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352471e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120478:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352471e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120484:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.120489:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352471e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120498:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352471e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120512:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431560.120515:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.120521:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352471e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120528:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb6352471e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120545:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120552:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524725 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120558:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524725 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120562:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.120564:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524725 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120570:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524725 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120576:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xec46fc5c (ffff90ce0bc57500)
00010000:00010000:3.0:1789431560.120579:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.120582:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524725 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120588:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524725 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120628:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524717 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85d8 expref: 467 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120640:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431560.120643:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.120647:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524717 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85d8 expref: 467 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.120664:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308e00, rc 0)
00000100:00100000:3.0:1789431560.120885:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+466:14616:x1876351933403392:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 927us (1332us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431560.120894:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295717
00000100:00100000:2.0:1789431560.125388:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.125536:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933403648
00000100:00100000:3.0:1789431560.125550:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933403648
00000100:00100000:3.0:1789431560.125619:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295718
00000100:00100000:3.0:1789431560.125631:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+466:14617:x1876351933403648:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431560.125701:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431560.125737:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635246ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a95:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85c3 expref: 466 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.125780:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a95:0x0].0x0 (ffff90ce359c6900)
00010000:00010000:3.0:1789431560.125802:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431560.125837:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352472c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.125858:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352472c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.125871:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352472c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.125891:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb63524733 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.125898:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb63524733 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.125905:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb63524733 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.126091:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352473a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a95:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.126101:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352473a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a95:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.126109:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352473a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a95:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431560.126786:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1209, 64 off85632
00010000:00010000:3.0:1789431560.126876:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524741 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a95:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.126890:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524741 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a95:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.126900:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524741 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a95:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.126908:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524741 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a95:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.126915:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524741 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a95:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.126921:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524741 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a95:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.126944:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431560.126972:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352473a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a95:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.126979:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352473a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a95:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.126987:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352473a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a95:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.126993:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01521a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.126999:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352473a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a95:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.127008:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352473a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a95:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.127019:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a95:0x0].0x0 (ffff90cf18b78c00)
00010000:00010000:3.0:1789431560.127022:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431560.127027:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352473a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a95:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.127032:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352473a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a95:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.127110:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352472c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.127117:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352472c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.127122:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352472c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.127132:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e74200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.127135:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352472c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.127141:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352472c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.127150:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431560.127152:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.127156:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352472c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.127163:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb6352472c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.128202:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431560.128217:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524741 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a95:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.128228:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f894a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431560.128232:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524741 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a95:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.128240:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524741 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a95:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.128254:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a95:0x0].0x0 (ffff90cf18b78c00)
00010000:00010000:0.0:1789431560.128257:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431560.128261:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524741 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a95:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.128267:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524741 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a95:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.128471:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.128474:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.128476:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00010000:3.0:1789431560.128775:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003d853d0d reply state 00000000e2416fa8 transno 4295120852 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb63524733 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.128801:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431560.129132:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+467:14617:x1876351933403648:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3496us (3752us total) trans 4295120852 rc 0/0
00000100:00100000:3.0:1789431560.129142:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295718
00000100:00100000:1.0:1789431560.131301:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.131393:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933403904
00000100:00100000:2.0:1789431560.131408:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933403904
00000100:00100000:2.0:1789431560.131481:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295719
00000100:00100000:2.0:1789431560.131493:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+467:14616:x1876351933403904:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.131523:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.131527:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:2.0:1789431560.131569:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635246bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85b5 expref: 467 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.131592:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431560.131599:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431560.131617:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524748 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c85df expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.131790:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352474f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.131872:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352474f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.131884:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352474f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.131905:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524756 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.131913:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.131919:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:2.0:1789431560.133113:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x50d:0x0], index 0: 0
00010000:00010000:2.0:1789431560.134573:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352475d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a96:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.134601:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352475d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a96:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.134616:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352475d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a96:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.134673:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352474f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.134682:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352474f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.134690:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352474f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.134697:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.134703:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352474f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.134711:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352474f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.134727:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431560.134731:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.134737:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352474f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.134744:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352474f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431560.134773:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000271160aa reply state 0000000019a0d0d9 transno 4295120853 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.134784:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431560.136778:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431560.136795:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb63524733 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.136818:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb63524733 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.136831:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb63524733 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.136838:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce27814e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.136843:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb63524733 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.136863:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb63524733 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.136882:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x411ba88 (ffff90ce2725d000)
00010000:00010000:0.0:1789431560.136885:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.136891:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb63524733 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.136897:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb63524733 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.136944:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524748 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85df expref: 468 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.136971:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352475d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a96:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85df expref: 467 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.136978:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a96:0x0].0x0 (ffff90ce359c6f00)
00010000:00010000:2.0:1789431560.136981:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431560.136984:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308e00, rc 0)
00000100:00100000:2.0:1789431560.137079:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+468:14616:x1876351933403904:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 5586us (5791us total) trans 4295120853 rc 0/0
00000100:00100000:2.0:1789431560.137091:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295719
00000100:00100000:2.0:1789431560.137126:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933404032
00000100:00100000:2.0:1789431560.137137:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933404032
00000100:00100000:2.0:1789431560.137185:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295720
00000100:00100000:2.0:1789431560.137195:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+468:14617:x1876351933404032:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.137219:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.137237:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb6352476b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c85e6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137309:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524772 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137323:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524772 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137334:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524772 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137350:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524779 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137358:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137365:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137430:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524772 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137438:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524772 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137444:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524772 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137449:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.137452:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524772 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137458:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524772 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137467:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.137470:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.137475:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524772 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137481:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524772 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137493:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137505:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524779 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137510:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137515:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.137517:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137523:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524779 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137529:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x806a17dc (ffff90ce359c6a00)
00010000:00010000:2.0:1789431560.137532:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.137535:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524779 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137541:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524779 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137570:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb6352476b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85e6 expref: 469 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137580:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.137583:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.137586:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb6352476b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85e6 expref: 469 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.137601:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ac43800, rc 0)
00000100:00100000:2.0:1789431560.137647:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+468:14617:x1876351933404032:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 454us (897us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431560.137655:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295720
00010000:00010000:0.0:1789431560.141547:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.141569:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524756 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.141639:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524756 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.141707:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.141714:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524756 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.141729:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524756 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.141762:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xec46fc5c (ffff90ce359c6800)
00010000:00010000:0.0:1789431560.141767:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.141772:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524756 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.141780:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524756 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.144270:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.144480:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.144744:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933404288
00000100:00100000:1.0:1789431560.144768:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933404288
00000100:00100000:1.0:1789431560.144850:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295721
00000100:00100000:1.0:1789431560.144867:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+467:14617:x1876351933404288:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.144900:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.144928:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524780 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c85f4 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.145013:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524787 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.145033:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524787 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.145163:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933404160
00000100:00100000:2.0:1789431560.145169:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933404160
00000100:00100000:2.0:1789431560.145216:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8185
00000100:00100000:2.0:1789431560.145225:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+137:2347:x1876351933404160:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.145235:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.145253:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002386c4fe/0xd8e438fb6352478e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c85ed expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789431560.145291:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x50d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:2.0:1789431560.145310:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50d:0x0].0x0 since=3018s v=(0 0)
00010000:00010000:2.0:1789431560.145315:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50d:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.145325:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002386c4fe/0xd8e438fb6352478e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85ed expref: 138 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.145342:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002386c4fe/0xd8e438fb6352478e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85ed expref: 138 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.145357:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3800, rc 0)
00000100:00100000:2.0:1789431560.145442:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+138:2347:x1876351933404160:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 218us (1186us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.145454:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8185
00010000:00010000:1.0:1789431560.145558:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524787 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431560.145684:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:1.0:1789431560.145689:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431560.145714:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524787 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.146281:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524780 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85f4 expref: 469 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.146314:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524787 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85f4 expref: 468 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.146324:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.146327:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431560.146332:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e2400, rc 0)
00000100:00100000:1.0:1789431560.146394:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+468:14617:x1876351933404288:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1530us (1913us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431560.146402:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295721
00000100:00100000:0.0:1789431560.151299:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.151419:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933404544
00000100:00100000:3.0:1789431560.151435:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933404544
00000100:00100000:3.0:1789431560.151527:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12407
00000100:00100000:3.0:1789431560.151544:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+468:14616:x1876351933404544:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431560.152088:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+469:14616:x1876351933404544:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 507us (778us total) trans 4295120854 rc 0/0
00000100:00100000:3.0:1789431560.152099:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12407
00000100:00100000:3.0:1789431560.156255:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.157688:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933404672
00000100:00100000:2.0:1789431560.157708:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933404672
00000100:00100000:3.0:1789431560.159547:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12408
00000100:00100000:3.0:1789431560.159565:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+469:14617:x1876351933404672:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431560.165501:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.167159:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+469:14617:x1876351933404672:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 7484us (10805us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431560.167175:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12408
00000100:00100000:2.0:1789431560.168726:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933404928
00000100:00100000:2.0:1789431560.168758:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933404928
00000100:00100000:2.0:1789431560.169016:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295722
00000100:00100000:2.0:1789431560.169032:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+469:14616:x1876351933404928:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431560.169140:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431560.169177:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352475d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a96:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85df expref: 469 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.169201:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a96:0x0].0x0 (ffff90ce359c6f00)
00010000:00010000:2.0:1789431560.169216:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431560.169244:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524795 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.169260:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524795 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.169271:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524795 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.169288:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb6352479c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.169296:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb6352479c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.169303:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb6352479c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.169451:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635247a3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a96:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.169460:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635247a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a96:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.169467:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635247a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a96:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431560.170527:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1208, 64 off85504
00000004:00080000:2.0:1789431560.170540:0:6797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3018201490286ns, next at 3019201486730ns, rc = 0
00010000:00010000:2.0:1789431560.170624:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635247aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a96:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.170639:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635247aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a96:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.170651:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635247aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a96:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.170661:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635247aa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a96:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.170667:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635247aa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a96:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.170672:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635247aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a96:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.170697:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431560.170730:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431560.170738:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635247aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a96:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.170745:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431560.170766:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635247aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a96:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.170776:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635247aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a96:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.170789:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a96:0x0].0x0 (ffff90ce359c6400)
00010000:00010000:2.0:1789431560.170792:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431560.170797:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635247aa lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a96:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.170804:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb635247aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a96:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.170817:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431560.170819:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431560.170821:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431560.170839:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635247a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a96:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.170846:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635247a3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a96:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.170852:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635247a3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a96:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.170857:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac43800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.170862:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635247a3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a96:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.170869:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635247a3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a96:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.171255:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a96:0x0].0x0 (ffff90ce359c6400)
00010000:00010000:2.0:1789431560.171257:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431560.171262:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635247a3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a96:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.171268:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb635247a3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a96:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.171297:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524795 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.171304:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524795 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.171309:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524795 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.171315:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.171318:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524795 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.171325:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524795 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.171332:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431560.171335:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.171338:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524795 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.171348:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3200/0xd8e438fb63524795 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431560.171358:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009963862c reply state 000000001c158ae4 transno 4295120855 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb6352479c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.171368:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431560.171477:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+470:14616:x1876351933404928:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2444us (5986us total) trans 4295120855 rc 0/0
00000100:00100000:2.0:1789431560.171606:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295722
00000100:00100000:0.0:1789431560.176871:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.176973:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933405184
00000100:00100000:1.0:1789431560.176989:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933405184
00000100:00100000:1.0:1789431560.177111:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295723
00000100:00100000:1.0:1789431560.177124:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+470:14617:x1876351933405184:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.177156:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.177187:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635247b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c85fb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177297:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635247b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177319:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635247b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177334:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635247b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177355:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635247bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177363:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635247bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177371:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635247bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177445:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635247b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177455:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635247b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177464:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635247b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177471:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.177477:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635247b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177491:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635247b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177506:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.177510:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.177516:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635247b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177522:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635247b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177537:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635247bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177543:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635247bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177549:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635247bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177554:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.177557:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635247bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177563:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635247bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177570:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x806a17dc (ffff90ce03149800)
00010000:00010000:1.0:1789431560.177573:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.177576:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635247bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177583:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635247bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177621:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635247b1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85fb expref: 471 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177632:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.177635:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:1.0:1789431560.177638:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb635247b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85fb expref: 471 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.177649:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e2800, rc 0)
00000100:00100000:1.0:1789431560.177722:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+470:14617:x1876351933405184:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 600us (865us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431560.177731:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295723
00000100:00100000:1.0:1789431560.178220:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431560.178274:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb6352479c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.178304:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb6352479c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.178311:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb6352479c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.178318:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.178322:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb6352479c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.178329:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb6352479c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.178341:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xec46fc5c (ffff90ce359c6a00)
00010000:00010000:3.0:1789431560.178345:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.178348:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb6352479c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.178359:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb6352479c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.178421:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933405312
00000100:00100000:2.0:1789431560.178430:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933405312
00000100:00100000:2.0:1789431560.178494:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295724
00000100:00100000:2.0:1789431560.178504:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+469:14616:x1876351933405312:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.178525:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.178540:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635247c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8602 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178609:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635247cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178623:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635247cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178633:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635247cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178649:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635247d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178657:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635247d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178663:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635247d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178712:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635247cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178720:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635247cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178726:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635247cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178732:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f896600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.178735:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635247cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178742:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635247cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178759:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431560.178762:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.178765:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635247cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178771:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f896600/0xd8e438fb635247cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178782:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635247d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178790:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635247d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178795:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635247d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178800:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f897400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.178803:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635247d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178809:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635247d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178815:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x897a18fd (ffff90ce359c6b00)
00010000:00010000:2.0:1789431560.178817:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.178820:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635247d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178826:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635247d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178855:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635247c6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8602 expref: 470 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178865:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431560.178867:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.178870:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb635247c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8602 expref: 470 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.178898:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ac42200, rc 0)
00000100:00100000:2.0:1789431560.178962:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+469:14616:x1876351933405312:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 460us (743us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431560.178970:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295724
00000100:00100000:1.0:1789431560.182421:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.182520:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933405440
00000100:00100000:0.0:1789431560.182535:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933405440
00000100:00100000:0.0:1789431560.182620:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295725
00000100:00100000:0.0:1789431560.182632:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+469:14617:x1876351933405440:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431560.182661:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431560.182692:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635247db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8609 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.182796:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb635247e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.182818:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb635247e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.182833:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb635247e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.182851:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635247e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.182859:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635247e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.182866:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635247e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.182940:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb635247e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.182949:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb635247e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.182957:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb635247e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.182964:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.182969:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb635247e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.182977:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb635247e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.182992:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431560.182995:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.183002:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb635247e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.183009:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb635247e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.183024:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635247e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.183030:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635247e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.183035:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635247e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.183040:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6b800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.183042:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635247e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.183097:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635247e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.183107:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xa1f039dc (ffff90cf11d83f00)
00010000:00010000:0.0:1789431560.183110:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.183114:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635247e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.183120:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb635247e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.183165:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635247db lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8609 expref: 470 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.183181:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431560.183182:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.183185:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb635247db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8609 expref: 470 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.183194:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6a800, rc 0)
00000100:00100000:0.0:1789431560.183284:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+469:14617:x1876351933405440:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 654us (877us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431560.183292:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295725
00000100:00100000:0.0:1789431560.185707:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.185863:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933405568
00000100:00100000:1.0:1789431560.185879:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933405568
00000100:00100000:1.0:1789431560.185968:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295726
00000100:00100000:1.0:1789431560.185981:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+469:14616:x1876351933405568:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.186011:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.186043:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb635247f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8610 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.186155:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635247f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.186174:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635247f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.186188:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635247f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431560.186233:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:1.0:1789431560.186237:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431560.186258:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635247f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.186286:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb635247f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8610 expref: 471 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.186309:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635247f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8610 expref: 470 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.186318:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.186321:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431560.186326:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e3c00, rc 0)
00000100:00100000:1.0:1789431560.186405:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+470:14616:x1876351933405568:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 426us (714us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431560.186413:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295726
00000100:00100000:2.0:1789431560.196490:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.196929:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933405696
00000100:00100000:3.0:1789431560.196944:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933405696
00000100:00100000:2.0:1789431560.197226:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12409
00000100:00100000:2.0:1789431560.197239:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+470:14616:x1876351933405696:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431560.205815:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.205861:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933405824
00000100:00100000:3.0:1789431560.205875:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933405824
00000100:00100000:3.0:1789431560.205949:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295727
00000100:00100000:3.0:1789431560.205961:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+472:14617:x1876351933405824:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431560.205986:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431560.206013:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635247fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8617 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206127:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524805 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206145:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524805 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206159:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524805 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206177:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352480c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206184:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352480c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206191:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352480c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206265:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524805 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206273:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524805 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206285:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524805 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206292:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e74200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.206298:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524805 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206307:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524805 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206321:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431560.206323:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.206330:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524805 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206337:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb63524805 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206351:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352480c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206357:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352480c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206364:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352480c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206371:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01521a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.206374:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352480c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206380:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352480c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206386:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x411ba88 (ffff90cf18b78500)
00010000:00010000:3.0:1789431560.206388:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.206390:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352480c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206396:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb6352480c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206433:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635247fe lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8617 expref: 473 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206443:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431560.206445:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.206449:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635247fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8617 expref: 473 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.206457:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0f894a00, rc 0)
00000100:00100000:3.0:1789431560.206525:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+472:14617:x1876351933405824:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 567us (726us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431560.206533:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295727
00000100:00100000:2.0:1789431560.209595:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+470:14616:x1876351933405696:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 12334us (13093us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.209612:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12409
00000100:00100000:3.0:1789431560.214454:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.219437:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933406080
00000100:00100000:2.0:1789431560.219462:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933406080
00000100:00100000:0.0:1789431560.220975:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295728
00000100:00100000:0.0:1789431560.220994:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+470:14616:x1876351933406080:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431560.221023:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431560.221070:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524813 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c861e expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221173:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352481a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221193:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352481a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221207:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352481a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221227:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524821 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221236:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221242:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221330:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352481a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221340:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352481a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221348:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352481a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221353:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.221358:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352481a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221366:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352481a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221380:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.221383:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.221388:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352481a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221395:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6aa00/0xd8e438fb6352481a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221411:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221419:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524821 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221425:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524821 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221430:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6b800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.221433:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524821 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221439:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524821 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221446:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x897a18fd (ffff90cf11d83f00)
00010000:00010000:0.0:1789431560.221449:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.221452:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524821 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221459:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b800/0xd8e438fb63524821 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x897a18fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221500:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524813 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c861e expref: 471 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221511:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.221514:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:0.0:1789431560.221517:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a600/0xd8e438fb63524813 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c861e expref: 471 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.221533:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6a600, rc 0)
00000100:00100000:0.0:1789431560.221770:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+470:14616:x1876351933406080:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 778us (7328us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431560.221779:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295728
00000100:00100000:3.0:1789431560.226041:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.226427:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.226888:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933406336
00000100:00100000:1.0:1789431560.226903:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933406336
00000100:00100000:1.0:1789431560.227108:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933406464
00000100:00100000:1.0:1789431560.227113:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933406464
00000100:00100000:1.0:1789431560.227150:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295729
00000100:00100000:1.0:1789431560.227161:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+471:14617:x1876351933406336:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.227193:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.227197:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:1.0:1789431560.227232:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524787 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85f4 expref: 471 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.227258:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.227264:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431560.227390:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295730
00000100:00100000:0.0:1789431560.227402:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+470:14616:x1876351933406464:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431560.227411:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431560.227424:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352482f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c862c expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227512:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524836 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227530:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524836 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227543:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524836 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227563:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb6352483d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227570:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb6352483d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227577:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb6352483d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227659:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524836 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227667:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524836 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227674:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524836 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227681:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.227686:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524836 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227695:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524836 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227704:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.227708:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.227713:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524836 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227719:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6ba00/0xd8e438fb63524836 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227731:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb6352483d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227737:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb6352483d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227743:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb6352483d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227759:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce27814e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.227761:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb6352483d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227768:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb6352483d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227775:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x4a14f308 (ffff90cf11d83d00)
00010000:00010000:0.0:1789431560.227778:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.227780:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb6352483d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227786:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce27814e00/0xd8e438fb6352483d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227822:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352482f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c862c expref: 471 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227832:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.227834:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.227838:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6a800/0xd8e438fb6352482f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c862c expref: 471 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.227849:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ce6a800, rc 0)
00000100:00100000:0.0:1789431560.227943:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+470:14616:x1876351933406464:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 532us (1503us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431560.227951:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295730
00010000:00010000:1.0:1789431560.230426:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524828 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8625 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.230649:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524844 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.230668:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524844 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.230683:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524844 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.230703:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb6352484b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.230711:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb6352484b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.230718:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb6352484b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:1.0:1789431560.232142:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x50d:0x0], index 1: 0
00010000:00010000:1.0:1789431560.234565:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524852 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a97:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.234714:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a97:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.234730:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a97:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.234794:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524844 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.234803:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524844 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.234812:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524844 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.234819:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.234824:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524844 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.234834:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524844 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.234848:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.234851:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.234856:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524844 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.234863:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524844 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431560.234881:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000566ea179 reply state 00000000960d5a61 transno 4295120856 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb6352484b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.234892:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431560.234939:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524828 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8625 expref: 472 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.234956:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524852 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a97:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8625 expref: 471 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.234965:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a97:0x0].0x0 (ffff90ce03149500)
00010000:00010000:1.0:1789431560.234967:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431560.234969:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e2600, rc 0)
00000100:00100000:1.0:1789431560.235897:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+472:14617:x1876351933406336:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8730us (9865us total) trans 4295120856 rc 0/0
00000100:00100000:1.0:1789431560.235910:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295729
00000100:00100000:0.0:1789431560.242250:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.244822:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933406592
00000100:00100000:3.0:1789431560.244843:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933406592
00000100:00100000:3.0:1789431560.244927:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295731
00000100:00100000:3.0:1789431560.244939:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+472:14616:x1876351933406592:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431560.244971:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431560.244999:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524860 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8633 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245107:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524867 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245126:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524867 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245139:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524867 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245156:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352486e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245163:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352486e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245170:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352486e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245241:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524867 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245248:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524867 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245256:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524867 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245262:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.245267:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524867 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245275:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524867 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245289:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431560.245292:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.245298:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524867 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245304:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524867 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245317:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352486e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245323:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352486e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245328:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352486e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245332:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.245335:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352486e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245345:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352486e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245351:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xec46fc5c (ffff90cf18b78500)
00010000:00010000:3.0:1789431560.245354:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.245356:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352486e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245362:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352486e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245399:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524860 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8633 expref: 473 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245410:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431560.245412:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.245416:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524860 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8633 expref: 473 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.245425:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308e00, rc 0)
00000100:00100000:3.0:1789431560.245509:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+472:14616:x1876351933406592:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 572us (3274us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431560.245517:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295731
00000100:00100000:0.0:1789431560.245688:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.245831:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933406720
00000100:00100000:3.0:1789431560.245838:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933406720
00000100:00100000:3.0:1789431560.245883:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8186
00000100:00100000:3.0:1789431560.245892:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+125:2347:x1876351933406720:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431560.245908:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431560.245925:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb63524875 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c863a expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431560.245956:0:8217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x50d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431560.245977:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50d:0x0].0x0 since=3018s v=(0 0)
00010000:00010000:3.0:1789431560.245982:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50d:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431560.245991:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb63524875 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c863a expref: 126 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.246007:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb63524875 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c863a expref: 126 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.246018:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309200, rc 0)
00000100:00100000:3.0:1789431560.246077:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+126:2347:x1876351933406720:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 185us (389us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431560.246084:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8186
00010000:00010000:2.0:1789431560.248761:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb6352484b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.248785:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb6352484b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.248794:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb6352484b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.248801:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.248806:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb6352484b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.248815:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb6352484b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.248841:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x411ba88 (ffff90ce03149800)
00010000:00010000:2.0:1789431560.248845:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.248852:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb6352484b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.248858:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb6352484b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.251690:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.251870:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933406976
00000100:00100000:3.0:1789431560.251885:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933406976
00000100:00100000:3.0:1789431560.251961:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12410
00000100:00100000:3.0:1789431560.251974:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+471:14617:x1876351933406976:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431560.255966:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+472:14617:x1876351933406976:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 3979us (4278us total) trans 4295120857 rc 0/0
00000100:00100000:0.0:1789431560.255982:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12410
00000100:00100000:0.0:1789431560.261723:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.262092:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933407232
00000100:00100000:3.0:1789431560.262107:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933407232
00000100:00100000:3.0:1789431560.262193:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295732
00000100:00100000:3.0:1789431560.262207:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+472:14616:x1876351933407232:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431560.262240:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431560.262245:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431560.262291:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb635247f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8610 expref: 472 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.262316:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431560.262323:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431560.262343:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352487c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8641 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.262495:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524883 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.262513:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524883 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.262526:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524883 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.262541:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352488a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.262549:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352488a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.262555:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352488a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:3.0:1789431560.263352:0:12181:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x50e:0x0], index 0: 0
00010000:00010000:3.0:1789431560.263569:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524891 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a98:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.263584:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a98:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.263595:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a98:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.263642:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524883 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.263649:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524883 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.263657:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524883 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.263664:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.263669:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524883 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.263678:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524883 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.263691:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431560.263694:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.263700:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524883 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.263707:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524883 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431560.263728:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e16e1574 reply state 00000000251deef0 transno 4295120858 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352488a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.263739:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431560.263789:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352487c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8641 expref: 474 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.263807:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524891 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a98:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8641 expref: 473 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.263815:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a98:0x0].0x0 (ffff90cf18b78200)
00010000:00010000:3.0:1789431560.263817:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431560.263820:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309c00, rc 0)
00000100:00100000:3.0:1789431560.263921:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+474:14616:x1876351933407232:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1716us (2213us total) trans 4295120858 rc 0/0
00000100:00100000:3.0:1789431560.263930:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295732
00000100:00100000:1.0:1789431560.269619:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.269706:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.269755:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933407488
00000100:00100000:3.0:1789431560.269773:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933407488
00000100:00100000:3.0:1789431560.269860:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295733
00000100:00100000:3.0:1789431560.269874:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+474:14617:x1876351933407488:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431560.269959:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431560.269971:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352488a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.269984:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352488a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.269991:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524852 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a97:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8625 expref: 474 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.269992:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352488a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.270000:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.270005:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352488a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.270010:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a97:0x0].0x0 (ffff90ce03149500)
00010000:00010000:0.0:1789431560.270013:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352488a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.270022:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431560.270023:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xec46fc5c (ffff90cf18b78500)
00010000:00010000:0.0:1789431560.270026:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.270030:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352488a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.270035:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352488a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.270072:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352489f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.270093:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352489f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.270105:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352489f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.270123:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.270131:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.270137:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.270181:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933407616
00000100:00100000:2.0:1789431560.270187:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933407616
00000100:00100000:2.0:1789431560.270231:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8187
00000100:00100000:2.0:1789431560.270239:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+138:2348:x1876351933407616:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.270252:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.270267:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054447f51/0xd8e438fb635248ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8648 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.270277:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635248b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a97:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789431560.270294:0:14486:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x50e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431560.270299:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635248b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a97:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.270305:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635248b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a97:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.270315:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50e:0x0].0x0 since=3018s v=(0 0)
00010000:00010000:2.0:1789431560.270320:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.270329:0:14486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054447f51/0xd8e438fb635248ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8648 expref: 139 pid: 14486 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.270345:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054447f51/0xd8e438fb635248ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8648 expref: 139 pid: 14486 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.270356:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0f896600, rc 0)
00000100:00100000:2.0:1789431560.270429:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+139:2348:x1876351933407616:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 190us (722us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.270437:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8187
00000040:00080000:2.0:1789431560.271240:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1210, 64 off85696
00010000:00010000:2.0:1789431560.271326:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635248bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a97:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271341:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635248bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a97:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271352:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635248bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a97:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271361:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635248bb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a97:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271367:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635248bb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a97:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271373:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635248bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a97:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271394:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431560.271419:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635248b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a97:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271426:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635248b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a97:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271432:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635248b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a97:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271439:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01521a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.271445:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635248b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a97:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271453:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635248b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a97:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271464:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a97:0x0].0x0 (ffff90cf18b78700)
00010000:00010000:2.0:1789431560.271468:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431560.271472:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635248b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a97:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271479:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb635248b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a97:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271502:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352489f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271508:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352489f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271515:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352489f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271521:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.271524:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352489f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271529:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352489f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271538:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.271540:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.271544:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352489f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.271550:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352489f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431560.271561:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e3ed2c48 reply state 00000000fb52053f transno 4295120859 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.271569:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431560.272298:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431560.272310:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635248bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a97:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.272321:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f897200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431560.272324:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635248bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a97:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.272333:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635248bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a97:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.272345:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a97:0x0].0x0 (ffff90cf18b78700)
00010000:00010000:0.0:1789431560.272348:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431560.272351:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635248bb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a97:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.272357:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635248bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a97:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.272379:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.272381:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.272383:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431560.272542:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+474:14617:x1876351933407488:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2664us (2931us total) trans 4295120859 rc 0/0
00000100:00100000:2.0:1789431560.272554:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295733
00000100:00100000:1.0:1789431560.279276:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.279475:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431560.279493:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.279508:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.279517:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.279524:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f894a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.279530:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.279539:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.279561:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x411ba88 (ffff90cf18b78100)
00010000:00010000:0.0:1789431560.279565:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.279571:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.279577:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.279832:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933408000
00000100:00100000:3.0:1789431560.279910:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933408000
00000100:00100000:3.0:1789431560.279988:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295734
00000100:00100000:3.0:1789431560.280001:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+473:14617:x1876351933408000:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431560.280033:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431560.280087:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635248c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c864f expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.280177:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635248c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.280194:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933407872
00010000:00010000:3.0:1789431560.280194:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635248c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.280200:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933407872
00010000:00010000:3.0:1789431560.280206:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635248c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.280223:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635248d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.280230:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635248d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.280237:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635248d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.280436:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635248c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.280443:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635248c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.280449:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635248c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.280455:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.280458:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635248c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.280468:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635248c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.280478:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431560.280481:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.280485:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635248c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.280491:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635248c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.280500:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12411
00010000:00010000:3.0:1789431560.280503:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635248d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.280509:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635248d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.280512:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+475:14616:x1876351933407872:12345-192.168.203.4@tcp:35:dbench.0
00010000:00010000:3.0:1789431560.280515:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635248d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.280520:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.280523:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635248d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.280528:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635248d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.280535:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xa1f039dc (ffff90cf18b78400)
00010000:00010000:3.0:1789431560.280537:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.280540:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635248d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.280545:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635248d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.280942:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+476:14616:x1876351933407872:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 425us (1674us total) trans 4295120860 rc 0/0
00000100:00100000:2.0:1789431560.280951:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12411
00010000:00010000:3.0:1789431560.282241:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635248c2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c864f expref: 475 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.282274:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431560.282277:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.282344:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb635248c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c864f expref: 475 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.282364:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308e00, rc 0)
00000100:00100000:3.0:1789431560.282491:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+474:14617:x1876351933408000:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2491us (3014us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431560.282500:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295734
00000100:00100000:1.0:1789431560.289423:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.289507:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.289712:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933408256
00000100:00100000:0.0:1789431560.289725:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933408256
00000100:00100000:3.0:1789431560.289800:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933408384
00000100:00100000:3.0:1789431560.289807:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933408384
00000100:00100000:3.0:1789431560.289870:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295735
00000100:00100000:3.0:1789431560.289883:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+475:14617:x1876351933408384:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431560.289916:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431560.289954:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635248d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8656 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.290067:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb635248de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.290087:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb635248de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.290100:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb635248de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.290123:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295736
00000100:00100000:0.0:1789431560.290134:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+476:14616:x1876351933408256:12345-192.168.203.4@tcp:36:dbench.0
00000004:00200000:3.0:1789431560.290149:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:3.0:1789431560.290155:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431560.290180:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb635248de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.290184:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431560.290213:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524891 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a98:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8641 expref: 477 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.290218:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635248d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8656 expref: 477 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.290243:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a98:0x0].0x0 (ffff90cf18b78200)
00010000:00010000:3.0:1789431560.290248:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb635248de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8656 expref: 475 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.290257:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431560.290259:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431560.290261:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431560.290266:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37e74200, rc 0)
00010000:00010000:0.0:1789431560.290279:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635248e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.290291:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635248e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.290298:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635248e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.290319:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635248ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.290326:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635248ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.290332:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635248ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.290469:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a98:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.290477:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a98:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.290484:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a98:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.290858:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+475:14617:x1876351933408384:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 975us (1347us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431560.290868:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295735
00000040:00080000:0.0:1789431560.291456:0:12775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1209, 64 off85568
00010000:00010000:0.0:1789431560.291555:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635248fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a98:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.291570:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635248fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a98:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.291582:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635248fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a98:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.291592:0:12775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635248fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a98:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.291599:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635248fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a98:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.291607:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635248fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a98:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.291637:0:12775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431560.291662:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a98:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.291669:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a98:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.291676:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a98:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.291682:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f894a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.291687:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a98:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.291688:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431560.291701:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a98:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.291701:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635248fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a98:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.291720:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431560.291721:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a98:0x0].0x0 (ffff90cf11d83f00)
00010000:00010000:0.0:1789431560.291727:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431560.291842:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635248fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a98:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.291856:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635248fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a98:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.291867:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a98:0x0].0x0 (ffff90cf11d83f00)
00010000:00010000:1.0:1789431560.291869:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431560.291874:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635248fa lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a98:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.291880:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635248fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a98:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.291895:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.291897:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.291899:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.291994:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a98:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.292006:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb635248f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a98:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.292218:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635248e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.292232:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635248e5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.292238:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635248e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.292242:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e1a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.292246:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635248e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.292252:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635248e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.292262:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.292265:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.292268:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635248e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.292274:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb635248e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431560.292286:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e20837c6 reply state 000000004673e8be transno 4295120861 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635248ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.292298:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431560.292402:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+476:14616:x1876351933408256:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2266us (2989us total) trans 4295120861 rc 0/0
00000100:00100000:0.0:1789431560.292410:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295736
00010000:00010000:0.0:1789431560.298012:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635248ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.298041:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635248ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.298153:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635248ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.298162:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e1800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.298169:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635248ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.298178:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635248ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.298201:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xec46fc5c (ffff90cf11d83d00)
00010000:00010000:0.0:1789431560.298205:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.298212:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635248ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.298220:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb635248ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.302250:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.302298:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.302388:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933408640
00000100:00100000:3.0:1789431560.302402:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933408640
00000100:00100000:3.0:1789431560.302481:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295737
00000100:00100000:3.0:1789431560.302494:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+475:14616:x1876351933408640:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431560.302528:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431560.302558:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524901 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c865d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302662:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524908 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302681:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524908 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302696:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524908 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302714:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352490f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302721:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352490f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302728:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352490f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302812:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524908 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302821:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524908 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302828:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524908 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302834:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.302839:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524908 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302852:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524908 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302867:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431560.302870:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.302875:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524908 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302881:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524908 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302895:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352490f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302902:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352490f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302909:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352490f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302914:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.302918:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352490f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302923:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352490f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302931:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x4a14f308 (ffff90cf18b78400)
00010000:00010000:3.0:1789431560.302933:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.302936:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352490f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302943:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352490f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302983:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524901 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c865d expref: 476 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.302994:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431560.302997:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.303001:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524901 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c865d expref: 476 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.303011:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309c00, rc 0)
00000100:00100000:0.0:1789431560.303332:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933408512
00000100:00100000:0.0:1789431560.303341:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933408512
00000100:00100000:0.0:1789431560.303398:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12412
00000100:00100000:0.0:1789431560.303409:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+476:14617:x1876351933408512:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431560.304633:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+477:14616:x1876351933408640:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2072us (2264us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431560.304648:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295737
00000100:00100000:2.0:1789431560.308863:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.309383:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933408768
00000100:00100000:1.0:1789431560.309400:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933408768
00000100:00100000:1.0:1789431560.309481:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295738
00000100:00100000:1.0:1789431560.309494:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+476:14616:x1876351933408768:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.309522:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.309552:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524916 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8664 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.309657:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352491d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.309676:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352491d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.309696:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352491d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431560.309744:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:1.0:1789431560.309760:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431560.309943:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352491d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.309975:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524916 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8664 expref: 478 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.309996:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352491d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8664 expref: 477 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.310006:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.310009:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431560.310013:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37f77a00, rc 0)
00000100:00100000:1.0:1789431560.310126:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+477:14616:x1876351933408768:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 635us (1278us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431560.310135:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295738
00000100:00100000:0.0:1789431560.310772:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+476:14617:x1876351933408512:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 7357us (8534us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.310782:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12412
00000100:00100000:2.0:1789431560.317250:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.317418:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933408896
00000100:00100000:0.0:1789431560.317432:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933408896
00000100:00100000:0.0:1789431560.317509:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12413
00000100:00100000:0.0:1789431560.317521:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+476:14616:x1876351933408896:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431560.324805:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+476:14616:x1876351933408896:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 7270us (7553us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.324823:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12413
00000100:00100000:2.0:1789431560.329159:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.330169:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933409152
00000100:00100000:3.0:1789431560.330186:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933409152
00000100:00100000:3.0:1789431560.330273:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295739
00000100:00100000:3.0:1789431560.330286:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+476:14617:x1876351933409152:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431560.330318:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431560.330348:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524924 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c866b expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330444:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352492b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330464:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352492b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330478:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352492b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330494:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524932 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330501:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330509:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330574:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352492b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330594:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352492b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330601:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352492b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330607:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.330612:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352492b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330620:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352492b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330633:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431560.330636:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.330642:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352492b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330648:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352492b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330661:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330666:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524932 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330671:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330676:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.330678:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330683:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524932 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330688:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xa1f039dc (ffff90cf18b78400)
00010000:00010000:3.0:1789431560.330690:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.330692:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524932 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330697:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524932 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330730:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524924 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c866b expref: 477 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330744:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431560.330757:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:3.0:1789431560.330761:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524924 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c866b expref: 477 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.330771:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309c00, rc 0)
00000100:00100000:3.0:1789431560.330851:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+476:14617:x1876351933409152:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 568us (1707us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431560.330859:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295739
00000100:00100000:1.0:1789431560.334121:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.334232:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933409408
00000100:00100000:3.0:1789431560.334245:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933409408
00000100:00100000:3.0:1789431560.334352:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295740
00000100:00100000:3.0:1789431560.334365:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+476:14616:x1876351933409408:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431560.334391:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431560.334417:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524939 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8672 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334515:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524940 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334533:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524940 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334548:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524940 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334564:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63524947 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334573:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63524947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334657:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63524947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334726:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524940 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334735:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524940 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334742:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524940 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334759:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.334765:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524940 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334774:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524940 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334788:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431560.334792:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.334798:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524940 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334806:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63524940 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334821:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63524947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334829:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63524947 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334835:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63524947 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334840:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.334843:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63524947 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334848:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63524947 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334854:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x4a14f308 (ffff90cf18b78800)
00010000:00010000:3.0:1789431560.334857:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.334860:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63524947 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.334866:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63524947 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x4a14f308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.337787:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524939 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8672 expref: 477 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.337815:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431560.337818:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:3.0:1789431560.337824:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524939 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8672 expref: 477 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.337851:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:2.0:1789431560.338463:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+476:14616:x1876351933409408:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4095us (4352us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431560.338475:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295740
00000100:00100000:0.0:1789431560.342221:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.342816:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933409536
00000100:00100000:1.0:1789431560.342832:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933409536
00000100:00100000:1.0:1789431560.342912:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295741
00000100:00100000:1.0:1789431560.342925:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+476:14617:x1876351933409536:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.342952:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.342979:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352494e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8679 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.344149:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.344231:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933409664
00000100:00100000:3.0:1789431560.344241:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933409664
00000100:00100000:3.0:1789431560.344301:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295742
00000100:00100000:3.0:1789431560.344313:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+478:14616:x1876351933409664:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431560.344333:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431560.344356:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524955 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8680 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344425:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352495c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344443:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352495c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344457:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352495c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344473:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524963 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344480:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344486:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344555:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352495c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344564:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352495c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344571:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352495c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344591:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.344597:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352495c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344606:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352495c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344620:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431560.344623:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.344629:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352495c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344636:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352495c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344652:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344658:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524963 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344664:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344668:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.344672:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344677:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524963 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344685:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xf390cc35 (ffff90cf18b78400)
00010000:00010000:3.0:1789431560.344688:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.344690:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524963 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344697:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524963 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344736:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524955 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8680 expref: 479 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344758:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431560.344761:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.344765:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524955 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8680 expref: 479 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.344776:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309c00, rc 0)
00000100:00100000:3.0:1789431560.345152:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+478:14616:x1876351933409664:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 838us (1011us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431560.345162:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295742
00010000:00010000:1.0:1789431560.345269:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352496a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345293:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352496a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345304:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352496a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345322:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524971 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345330:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345337:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345383:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352496a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345391:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352496a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345398:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352496a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345403:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f76400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.345406:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352496a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345418:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352496a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345428:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.345430:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.345434:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352496a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345440:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352496a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345452:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345459:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524971 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345465:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345470:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00030e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.345473:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345479:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524971 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345487:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x18178cb5 (ffff90ce03149200)
00010000:00010000:1.0:1789431560.345489:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.345492:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524971 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345498:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524971 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345531:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352494e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8679 expref: 477 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345539:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.345541:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.345544:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352494e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8679 expref: 477 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.345552:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37f77c00, rc 0)
00000100:00100000:1.0:1789431560.345603:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+476:14617:x1876351933409536:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2681us (3396us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431560.345609:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295741
00000100:00100000:0.0:1789431560.361356:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.361561:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933409792
00000100:00100000:1.0:1789431560.361575:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933409792
00000100:00100000:1.0:1789431560.361645:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295743
00000100:00100000:1.0:1789431560.361657:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+476:14616:x1876351933409792:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.361687:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.361715:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524978 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8687 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.361814:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352497f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.361832:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352497f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.361847:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352497f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.361866:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524986 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.361874:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.361881:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.361969:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352497f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.361977:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352497f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.361985:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352497f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.361991:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f77c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.361997:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352497f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.362005:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352497f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.362019:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.362022:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.362028:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352497f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.362035:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352497f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.362100:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.362108:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524986 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.362113:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524986 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.362119:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f76400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.362122:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524986 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.362128:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524986 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.362135:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xec46fc5c (ffff90ce03149200)
00010000:00010000:1.0:1789431560.362138:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.362140:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524986 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.362145:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524986 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.362185:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524978 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8687 expref: 477 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.362201:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.362203:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.362206:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524978 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8687 expref: 477 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.362217:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf00030e00, rc 0)
00000100:00100000:1.0:1789431560.362690:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+476:14616:x1876351933409792:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1030us (1345us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431560.362700:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295743
00000100:00100000:0.0:1789431560.364605:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.364698:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933410048
00000100:00100000:3.0:1789431560.364711:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933410048
00000100:00100000:3.0:1789431560.364792:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295744
00000100:00100000:3.0:1789431560.364804:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+476:14617:x1876351933410048:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431560.364832:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431560.364835:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431560.364869:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74200/0xd8e438fb635248de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8656 expref: 476 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.364891:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431560.364897:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431560.364914:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352498d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c868e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.366394:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524994 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.366422:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524994 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.366436:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524994 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.366454:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352499b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.366461:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352499b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.366467:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352499b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:3.0:1789431560.367199:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x50e:0x0], index 1: 0
00010000:00010000:3.0:1789431560.367425:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635249a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a99:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.367440:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635249a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.367450:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635249a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.367496:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524994 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.367504:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524994 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.367511:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524994 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.367517:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.367523:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524994 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.367532:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524994 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.367548:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431560.367551:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.367557:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524994 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.367564:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524994 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431560.367582:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008054d97b reply state 000000008c007491 transno 4295120862 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352499b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.367594:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431560.367639:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352498d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c868e expref: 478 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.367655:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635249a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c868e expref: 477 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.367664:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a99:0x0].0x0 (ffff90cf18b78800)
00010000:00010000:3.0:1789431560.367666:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431560.367668:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:3.0:1789431560.367790:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+478:14617:x1876351933410048:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2986us (3195us total) trans 4295120862 rc 0/0
00000100:00100000:3.0:1789431560.367800:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295744
00000100:00100000:0.0:1789431560.370582:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.370638:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933410304
00000100:00100000:3.0:1789431560.370652:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933410304
00000100:00100000:1.0:1789431560.371008:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295745
00000100:00100000:1.0:1789431560.371024:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+478:14616:x1876351933410304:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.371234:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.371238:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:1.0:1789431560.371274:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352491d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8664 expref: 478 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.371296:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.371303:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431560.371319:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635249b0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8695 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.371465:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.371482:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.371494:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.371511:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635249be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.371519:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635249be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.371525:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635249be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431560.372997:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x50f:0x0], index 0: 0
00010000:00010000:0.0:1789431560.373224:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635249c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a9a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.373239:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635249c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a9a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.373249:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635249c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a9a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.373309:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.373317:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249b7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.373324:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.373336:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f77c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.373340:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.373349:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.373361:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.373365:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.373371:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249b7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.373379:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431560.373401:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000038ee59e0 reply state 000000008458a6c3 transno 4295120863 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635249be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.373411:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431560.373459:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635249b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8695 expref: 480 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.373477:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635249c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a9a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8695 expref: 479 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.373484:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9a:0x0].0x0 (ffff90cf11d83d00)
00010000:00010000:0.0:1789431560.373486:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431560.373488:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce249e1200, rc 0)
00010000:00010000:2.0:1789431560.373574:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352499b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.373584:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+480:14616:x1876351933410304:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2565us (3016us total) trans 4295120863 rc 0/0
00010000:00010000:2.0:1789431560.373584:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352499b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.373596:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295745
00010000:00010000:2.0:1789431560.373720:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352499b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.373726:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.373730:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352499b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.373737:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352499b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.373757:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x18178cb5 (ffff90cf18b78400)
00010000:00010000:2.0:1789431560.373760:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.373764:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352499b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.373770:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352499b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.376647:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635249be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.376670:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635249be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.376680:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635249be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.376687:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00030e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.376693:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635249be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.376702:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635249be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.376722:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xec46fc5c (ffff90ce03149200)
00010000:00010000:0.0:1789431560.376726:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.376732:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635249be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.376739:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb635249be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.381431:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.381529:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.381684:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933410432
00000100:00100000:2.0:1789431560.381685:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933410560
00000100:00100000:1.0:1789431560.381698:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933410432
00000100:00100000:2.0:1789431560.381698:0:14490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933410560
00000100:00100000:2.0:1789431560.381803:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8188
00000100:00100000:2.0:1789431560.381816:0:14490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+139:2347:x1876351933410560:12345-192.168.203.4@tcp:101:dbench.0
00000100:00100000:1.0:1789431560.381836:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8189
00010000:00010000:2.0:1789431560.381841:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00000100:00100000:1.0:1789431560.381843:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+126:2348:x1876351933410432:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.381851:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.381882:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a0f0e7e/0xd8e438fb635249d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c869c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789431560.381920:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x50e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:1.0:1789431560.381947:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50e:0x0].0x0 since=3018s v=(0 0)
00010000:00010000:1.0:1789431560.381952:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.381963:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a0f0e7e/0xd8e438fb635249d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c869c expref: 127 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.381984:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008a0f0e7e/0xd8e438fb635249d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c869c expref: 127 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.382005:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37f77a00, rc 0)
00000100:00100000:1.0:1789431560.382104:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+127:2348:x1876351933410432:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 261us (689us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431560.382112:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8189
00010000:00010000:2.0:1789431560.382160:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f75eeb0/0xd8e438fb635249da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c86a3 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789431560.382188:0:14490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x50f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:2.0:1789431560.382200:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50f:0x0].0x0 since=3018s v=(0 0)
00010000:00010000:2.0:1789431560.382204:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50f:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.382210:0:14490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f75eeb0/0xd8e438fb635249da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86a3 expref: 140 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.382224:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006f75eeb0/0xd8e438fb635249da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86a3 expref: 140 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.382233:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0f897c00, rc 0)
00000100:00100000:2.0:1789431560.382415:0:14490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+140:2347:x1876351933410560:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 602us (885us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.382422:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8188
00000100:00100000:3.0:1789431560.386500:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.387142:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933410816
00000100:00100000:2.0:1789431560.387158:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933410816
00000100:00100000:2.0:1789431560.387235:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12414
00000100:00100000:3.0:1789431560.387553:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.387598:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933411072
00000100:00100000:0.0:1789431560.387604:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933411072
00000100:00100000:0.0:1789431560.387645:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12415
00000100:00100000:0.0:1789431560.387656:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+479:14617:x1876351933411072:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431560.387927:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+479:14616:x1876351933410816:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431560.388483:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+481:14617:x1876351933411072:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 827us (929us total) trans 4295120865 rc 0/0
00000100:00100000:2.0:1789431560.388483:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+481:14616:x1876351933410816:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 1236us (1996us total) trans 4295120864 rc 0/0
00000100:00100000:0.0:1789431560.388493:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12415
00000100:00100000:2.0:1789431560.388496:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12414
00000100:00100000:3.0:1789431560.394458:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.394880:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.395416:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933411328
00000100:00100000:2.0:1789431560.395433:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933411328
00000100:00100000:1.0:1789431560.395474:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933411584
00000100:00100000:1.0:1789431560.395480:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933411584
00000100:00100000:2.0:1789431560.395520:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295746
00000100:00100000:2.0:1789431560.395533:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+481:14616:x1876351933411328:12345-192.168.203.4@tcp:36:dbench.0
00000100:00100000:1.0:1789431560.395601:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295747
00000100:00100000:1.0:1789431560.395610:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+481:14617:x1876351933411584:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431560.395663:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431560.395667:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431560.395701:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635249a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a99:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c868e expref: 481 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.395701:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635249c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a9a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8695 expref: 481 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.395727:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a99:0x0].0x0 (ffff90cf18b78800)
00010000:00010000:2.0:1789431560.395727:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9a:0x0].0x0 (ffff90cf11d83d00)
00010000:00010000:2.0:1789431560.395740:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431560.395741:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431560.395783:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635249e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.395801:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635249e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.395813:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635249e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.395831:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.395838:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.395846:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.395994:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635249ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a99:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.396002:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635249ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a99:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.396009:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635249ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a99:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.396677:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635249f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.396692:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635249f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.396702:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635249f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.396717:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635249fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.396723:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635249fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.396729:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635249fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431560.396977:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1211, 64 off85760
00010000:00010000:2.0:1789431560.396999:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524a04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a9a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.397007:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524a04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a9a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.397015:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524a04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a9a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397074:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524a0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a99:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397084:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524a0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a99:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397092:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524a0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a99:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397100:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524a0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a99:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397106:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524a0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a99:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397113:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524a0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a99:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397200:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431560.397228:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635249ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a99:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397235:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635249ef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a99:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397242:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635249ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a99:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397248:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.397254:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635249ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a99:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397261:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635249ef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a99:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397274:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a99:0x0].0x0 (ffff90ce03149400)
00010000:00010000:1.0:1789431560.397287:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431560.397294:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635249ef lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a99:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397300:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635249ef lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a99:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397321:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635249e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397328:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635249e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397333:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635249e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397343:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f76400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.397346:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635249e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397352:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635249e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397360:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.397363:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.397366:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635249e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.397373:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb635249e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431560.397383:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005be02925 reply state 000000009071601e transno 4295120866 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.397391:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431560.397502:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+481:14617:x1876351933411584:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1888us (2618us total) trans 4295120866 rc 0/0
00000100:00100000:1.0:1789431560.397513:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295747
00000040:00080000:2.0:1789431560.397669:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1210, 64 off85632
00010000:00010000:2.0:1789431560.397729:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524a12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a9a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.397740:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524a12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.397756:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524a12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.397764:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524a12 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.397771:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524a12 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.397969:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524a12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.399698:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.399718:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.399727:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.399738:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f77c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.399743:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.399760:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.399788:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x18178cb5 (ffff90ce03149000)
00010000:00010000:1.0:1789431560.399792:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.399797:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.399805:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635249e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.400027:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:3.0:1789431560.400039:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:2.0:1789431560.400083:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524a04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a9a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.400088:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524a0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a99:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.400092:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524a04 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a9a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.400095:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cae00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431560.400098:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524a04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a9a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.400099:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524a0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a99:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.400104:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f897000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.400107:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524a04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a9a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.400107:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524a0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a99:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.400114:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524a04 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a9a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.400119:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a99:0x0].0x0 (ffff90ce03149400)
00010000:00010000:3.0:1789431560.400121:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431560.400122:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9a:0x0].0x0 (ffff90ce359c6a00)
00010000:00010000:2.0:1789431560.400124:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431560.400124:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524a0b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a99:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.400128:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524a04 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a9a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.400131:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524a0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a99:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.400134:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524a04 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a9a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.400147:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431560.400150:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524a12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a9a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.400155:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635249f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.400155:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01521a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431560.400158:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524a12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a9a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.400161:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635249f6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.400164:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524a12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a9a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.400168:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635249f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.400171:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9a:0x0].0x0 (ffff90ce359c6a00)
00010000:00010000:2.0:1789431560.400173:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f897400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.400173:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431560.400175:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635249f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.400176:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524a12 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a9a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.400182:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635249f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.400182:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01521a00/0xd8e438fb63524a12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a9a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.400189:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431560.400191:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.400194:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635249f6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.400195:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431560.400197:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431560.400199:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431560.400204:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb635249f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431560.400214:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000056702c79 reply state 000000000a07ffbd transno 4295120867 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635249fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.400224:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431560.400349:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+481:14616:x1876351933411328:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 4813us (5900us total) trans 4295120867 rc 0/0
00000100:00100000:2.0:1789431560.400360:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295746
00010000:00010000:0.0:1789431560.401553:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.402173:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635249fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.402190:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635249fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.402198:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635249fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.402204:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f897200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.402208:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635249fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.402216:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635249fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.402234:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xec46fc5c (ffff90ce359c6d00)
00010000:00010000:0.0:1789431560.402237:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.402243:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635249fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.402249:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb635249fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0xec46fc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.405375:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.405424:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.406157:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933411712
00000100:00100000:0.0:1789431560.406179:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933411712
00000100:00100000:0.0:1789431560.406250:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933411840
00000100:00100000:0.0:1789431560.406253:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933411840
00000100:00100000:0.0:1789431560.406300:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295748
00000100:00100000:0.0:1789431560.406312:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+481:14617:x1876351933411712:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431560.406348:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431560.406377:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524a19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c86aa expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406463:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524a20 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406480:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524a20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406495:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524a20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.406500:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295749
00000100:00100000:2.0:1789431560.406512:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+482:14616:x1876351933411840:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431560.406513:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406520:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.406521:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431560.406527:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.406531:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524a2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c86b1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.406562:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.406572:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406600:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524a20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406608:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524a20 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406615:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524a20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406621:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00030e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.406626:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524a20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406635:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524a20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406648:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431560.406652:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.406659:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524a20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.406659:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406666:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524a20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.406676:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406682:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.406684:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406688:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.406691:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406695:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406700:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e1800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.406703:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406712:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406719:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xa1f039dc (ffff90cf11d83f00)
00010000:00010000:0.0:1789431560.406721:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.406724:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.406725:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406732:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.406732:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.406739:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.406744:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.406779:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524a19 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86aa expref: 483 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406790:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431560.406793:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.406797:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524a19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86aa expref: 483 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.406807:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce249e1200, rc 0)
00000100:00100000:0.0:1789431560.406900:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+482:14617:x1876351933411712:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 590us (1539us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431560.406908:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295748
00010000:00010000:2.0:1789431560.408019:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.408042:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.408201:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431560.408205:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.408211:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.408219:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.408238:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.408319:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.408330:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.408336:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.408340:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.408347:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.408356:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xf390cc35 (ffff90ce359c6800)
00010000:00010000:2.0:1789431560.408358:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.408361:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.408367:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.408425:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524a2e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86b1 expref: 481 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.408436:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431560.408438:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.408443:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524a2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86b1 expref: 481 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.408453:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e2600, rc 0)
00000100:00100000:2.0:1789431560.408575:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+480:14616:x1876351933411840:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2065us (3147us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431560.408595:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295749
00000100:00100000:3.0:1789431560.415095:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.415209:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933411968
00000100:00100000:2.0:1789431560.415222:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933411968
00000100:00100000:2.0:1789431560.415301:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295750
00000100:00100000:2.0:1789431560.415314:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+480:14616:x1876351933411968:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.415343:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.415369:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524a43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c86b8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.415455:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524a4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.415474:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524a4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.415488:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524a4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431560.415535:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:2.0:1789431560.415540:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431560.415562:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524a4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.415706:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524a43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86b8 expref: 482 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.415729:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524a4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86b8 expref: 481 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.415745:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431560.415756:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:2.0:1789431560.415761:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e2400, rc 0)
00000100:00100000:2.0:1789431560.415845:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+481:14616:x1876351933411968:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 534us (808us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.415852:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295750
00000100:00100000:3.0:1789431560.416502:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.416912:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933412096
00000100:00100000:1.0:1789431560.416923:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933412096
00000100:00100000:1.0:1789431560.417159:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295751
00000100:00100000:1.0:1789431560.417171:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+481:14617:x1876351933412096:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.417197:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.417219:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524a51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c86bf expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.417486:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524a58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.417504:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.417522:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431560.417563:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:1.0:1789431560.417567:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431560.417587:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.417615:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524a51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86bf expref: 483 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.417634:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524a58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86bf expref: 482 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.417642:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.417645:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431560.417649:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb800, rc 0)
00000100:00100000:1.0:1789431560.417727:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+482:14617:x1876351933412096:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 557us (1228us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431560.417734:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295751
00000100:00100000:3.0:1789431560.422737:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.423910:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933412224
00000100:00100000:1.0:1789431560.423928:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933412224
00000100:00100000:1.0:1789431560.424016:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12416
00000100:00100000:1.0:1789431560.424028:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+482:14616:x1876351933412224:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431560.428496:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.428941:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933412352
00000100:00100000:0.0:1789431560.428956:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933412352
00000100:00100000:0.0:1789431560.429107:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12417
00000100:00100000:0.0:1789431560.429119:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+484:14617:x1876351933412352:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431560.433302:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+484:14616:x1876351933412224:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 9260us (10565us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431560.433318:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12416
00000100:00100000:3.0:1789431560.435283:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+482:14617:x1876351933412352:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 6145us (6779us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431560.435298:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12417
00000100:00100000:0.0:1789431560.440644:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.440857:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933412608
00000100:00100000:1.0:1789431560.440871:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933412608
00000100:00100000:1.0:1789431560.441023:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295752
00000100:00100000:1.0:1789431560.441038:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+482:14616:x1876351933412608:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.441085:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.441117:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524a5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c86c6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441215:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524a66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441234:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524a66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441248:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524a66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441265:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524a6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441271:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524a6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441287:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524a6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441360:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524a66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441367:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524a66 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441379:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524a66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441386:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.441391:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524a66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441400:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524a66 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441412:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.441415:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.441422:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524a66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441427:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524a66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441441:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524a6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441447:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524a6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441452:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524a6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441457:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.441459:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524a6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441469:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524a6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441474:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xf390cc35 (ffff90ce03149000)
00010000:00010000:1.0:1789431560.441476:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.441479:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524a6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441484:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524a6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xf390cc35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441520:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524a5f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86c6 expref: 483 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441530:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.441532:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:1.0:1789431560.441535:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524a5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86c6 expref: 483 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.441544:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035ca200, rc 0)
00000100:00100000:1.0:1789431560.441637:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+482:14616:x1876351933412608:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 603us (1071us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431560.441644:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295752
00000100:00100000:1.0:1789431560.448635:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.448684:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.448947:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933412864
00000100:00100000:2.0:1789431560.448963:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933412864
00000100:00100000:2.0:1789431560.449034:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933412992
00000100:00100000:2.0:1789431560.449037:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933412992
00000100:00100000:2.0:1789431560.449112:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295753
00000100:00100000:2.0:1789431560.449125:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+483:14617:x1876351933412864:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.449153:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.449180:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524a74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c86cd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449289:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a7b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449308:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449322:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449340:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449352:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449359:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449432:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449440:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a7b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449447:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449454:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.449459:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449468:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a7b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449482:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.449485:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.449491:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449497:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524a7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449512:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449519:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449524:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449530:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.449533:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449539:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449545:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xa1f039dc (ffff90ce359c6800)
00010000:00010000:2.0:1789431560.449549:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.449552:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449557:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524a82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.449791:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295754
00000100:00100000:0.0:1789431560.449805:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+484:14616:x1876351933412992:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431560.449817:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431560.449831:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb63524a89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c86d4 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449898:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524a74 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86cd expref: 485 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449910:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.449913:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:2.0:1789431560.449917:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524a74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86cd expref: 485 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.449934:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e2800, rc 0)
00000100:00100000:2.0:1789431560.450019:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+484:14617:x1876351933412864:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 897us (1398us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431560.450028:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295753
00000100:00100000:3.0:1789431560.454213:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.454716:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933413120
00000100:00100000:2.0:1789431560.454732:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933413120
00000100:00100000:2.0:1789431560.454835:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295755
00000100:00100000:2.0:1789431560.454847:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+484:14617:x1876351933413120:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.454880:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.454909:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524a90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c86db expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455206:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a97 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455226:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455240:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455260:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524a9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455268:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455275:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455366:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455375:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a97 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455386:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455392:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e1800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.455397:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455405:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a97 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455418:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.455422:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.455427:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455433:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524a97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455448:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455454:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524a9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455461:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524a9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455466:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.455469:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524a9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455480:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524a9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455487:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x806a17dc (ffff90cf11d83f00)
00010000:00010000:0.0:1789431560.455489:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.455492:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524a9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455497:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524a9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455542:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb63524a89 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86d4 expref: 485 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455554:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.455556:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.455560:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb63524a89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86d4 expref: 485 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.455569:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce156e1a00, rc 0)
00000100:00100000:0.0:1789431560.455684:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+484:14616:x1876351933412992:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 5883us (6998us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431560.455692:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295754
00010000:00010000:2.0:1789431560.458404:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524aa5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458432:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458447:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458465:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524aac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458472:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524aac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458478:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524aac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458554:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458562:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524aa5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458569:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524aa5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458574:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.458660:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524aa5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458670:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524aa5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458685:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.458688:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.458694:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524aa5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458701:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524aa5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458715:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524aac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458721:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524aac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458726:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524aac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458731:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.458734:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524aac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458739:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524aac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458756:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xe94006ef (ffff90ce359c6800)
00010000:00010000:2.0:1789431560.458758:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.458827:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524aac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458836:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524aac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458890:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524a90 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86db expref: 483 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458902:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.458904:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.458908:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524a90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86db expref: 483 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.458918:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e3a00, rc 0)
00000100:00100000:2.0:1789431560.459122:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+482:14617:x1876351933413120:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4275us (4922us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431560.459134:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295755
00000100:00100000:3.0:1789431560.466728:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.466921:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933413248
00000100:00100000:2.0:1789431560.466936:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933413248
00000100:00100000:2.0:1789431560.467018:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295756
00000100:00100000:2.0:1789431560.467030:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+482:14617:x1876351933413248:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.467106:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.467138:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524ab3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c86e2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467230:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524aba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467248:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524aba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467262:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524aba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467298:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524ac1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467305:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467312:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467389:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524aba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467397:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524aba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467403:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524aba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467410:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.467416:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524aba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467424:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524aba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467438:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.467442:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.467447:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524aba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467453:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524aba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467468:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467475:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524ac1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467480:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467486:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.467489:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467495:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524ac1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467505:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x18178cb5 (ffff90ce359c6900)
00010000:00010000:2.0:1789431560.467508:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.467510:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524ac1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467516:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524ac1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467553:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524ab3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86e2 expref: 483 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467563:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.467565:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.467568:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524ab3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86e2 expref: 483 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.467591:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e3000, rc 0)
00000100:00100000:2.0:1789431560.467662:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+482:14617:x1876351933413248:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 634us (955us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431560.467669:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295756
00000100:00100000:1.0:1789431560.475024:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.475206:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933413504
00000100:00100000:3.0:1789431560.475221:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933413504
00000100:00100000:1.0:1789431560.475553:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295757
00000100:00100000:1.0:1789431560.475565:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+482:14617:x1876351933413504:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.475607:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.475611:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:1.0:1789431560.475647:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524a58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86bf expref: 482 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.475672:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.475678:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431560.475695:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524ac8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c86e9 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.475990:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524acf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.476007:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524acf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.476020:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524acf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.476037:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524ad6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.476045:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.476213:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:1.0:1789431560.477217:0:12181:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x50f:0x0], index 1: 0
00010000:00010000:1.0:1789431560.478527:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524add lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a9b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.478555:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a9b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.478569:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a9b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.478873:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524acf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.478883:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524acf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.478890:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524acf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.478898:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.478904:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524acf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.478914:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524acf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.478929:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.478932:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.478939:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524acf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.478945:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524acf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431560.478963:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f03cc97c reply state 00000000ae445fbc transno 4295120868 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.478975:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431560.479027:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524ac8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86e9 expref: 484 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.479044:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524add lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a9b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86e9 expref: 483 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.479142:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9b:0x0].0x0 (ffff90ce03149b00)
00010000:00010000:1.0:1789431560.479144:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431560.479147:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cae00, rc 0)
00000100:00100000:1.0:1789431560.479445:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+484:14617:x1876351933413504:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3880us (4435us total) trans 4295120868 rc 0/0
00000100:00100000:1.0:1789431560.479456:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295757
00000100:00100000:2.0:1789431560.480949:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.482168:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933413632
00000100:00100000:0.0:1789431560.482184:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933413632
00000100:00100000:0.0:1789431560.482433:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295758
00000100:00100000:0.0:1789431560.482447:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+484:14616:x1876351933413632:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431560.482478:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431560.482510:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524aeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c86f0 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482609:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524af2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482628:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524af2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482641:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524af2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482659:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb63524af9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482666:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb63524af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482673:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb63524af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482744:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524af2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482769:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524af2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482776:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524af2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482783:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.482788:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524af2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482796:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524af2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482810:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.482814:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.482821:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524af2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482829:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524af2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482844:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb63524af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482850:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb63524af9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482856:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb63524af9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482861:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e1a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.482864:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb63524af9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482870:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb63524af9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482876:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x411ba88 (ffff90cf11d83f00)
00010000:00010000:0.0:1789431560.482879:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.482882:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb63524af9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482887:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1a00/0xd8e438fb63524af9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482925:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524aeb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86f0 expref: 485 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482938:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.482940:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.482943:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524aeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86f0 expref: 485 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.482954:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf00030e00, rc 0)
00000100:00100000:0.0:1789431560.483239:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+484:14616:x1876351933413632:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 794us (2304us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431560.483247:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295758
00010000:00010000:2.0:1789431560.487556:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.487577:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524ad6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.487587:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524ad6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.487597:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.487604:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524ad6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.487612:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524ad6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.487633:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x18178cb5 (ffff90ce03149000)
00010000:00010000:2.0:1789431560.487637:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.487643:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524ad6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.487650:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524ad6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.487786:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.488264:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933413760
00000100:00100000:2.0:1789431560.488278:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933413760
00000100:00100000:2.0:1789431560.488430:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8190
00000100:00100000:2.0:1789431560.488443:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+127:2347:x1876351933413760:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.488467:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.488492:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a09022e/0xd8e438fb63524b00 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c86f7 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789431560.488530:0:14468:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x50f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:2.0:1789431560.488558:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50f:0x0].0x0 since=3018s v=(0 0)
00010000:00010000:2.0:1789431560.488563:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50f:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.488574:0:14468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a09022e/0xd8e438fb63524b00 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86f7 expref: 128 pid: 14468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.488600:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a09022e/0xd8e438fb63524b00 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86f7 expref: 128 pid: 14468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.488616:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3200, rc 0)
00000100:00100000:2.0:1789431560.488694:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+128:2347:x1876351933413760:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 253us (914us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.488702:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8190
00000100:00100000:1.0:1789431560.493671:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.493818:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933414016
00000100:00100000:2.0:1789431560.493832:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933414016
00000100:00100000:2.0:1789431560.493918:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295759
00000100:00100000:2.0:1789431560.493930:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+483:14616:x1876351933414016:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.494143:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.494148:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:2.0:1789431560.494187:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524a4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86b8 expref: 483 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.494210:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431560.494216:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431560.494236:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524b07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c86fe expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.494398:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524b0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.494416:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524b0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.494428:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524b0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.494446:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524b15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.494453:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.494459:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.494838:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.495041:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933414272
00000100:00100000:0.0:1789431560.495072:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933414272
00000100:00100000:0.0:1789431560.495132:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12418
00000100:00100000:0.0:1789431560.495143:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+484:14617:x1876351933414272:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431560.496206:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+485:14617:x1876351933414272:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 1054us (1360us total) trans 4295120869 rc 0/0
00000100:00100000:0.0:1789431560.496218:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12418
00010000:00010000:0.0:1789431560.497353:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:2.0:1789431560.497360:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x510:0x0], index 0: 0
00010000:00010000:2.0:1789431560.500495:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524b1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a9c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.500528:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524b1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a9c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.500545:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524b1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a9c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.500595:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524b0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.500604:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524b0e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.500612:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524b0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.500623:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.500628:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524b0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.500637:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524b0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.500653:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431560.500656:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.500661:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524b0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.500669:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524b0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431560.500687:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a3aec81d reply state 00000000882dac5b transno 4295120870 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.500698:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:2.0:1789431560.500758:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524b07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86fe expref: 486 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.500776:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524b1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a9c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86fe expref: 485 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.500784:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9c:0x0].0x0 (ffff90ce359c6d00)
00010000:00010000:2.0:1789431560.500786:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431560.500788:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e3a00, rc 0)
00000100:00100000:2.0:1789431560.500908:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+486:14616:x1876351933414016:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6979us (7250us total) trans 4295120870 rc 0/0
00000100:00100000:2.0:1789431560.500918:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295759
00000100:00100000:3.0:1789431560.506444:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431560.506618:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.506635:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524b15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.506644:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524b15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.506651:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.506657:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524b15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.506670:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524b15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.506693:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x411ba88 (ffff90ce359c6c00)
00010000:00010000:1.0:1789431560.506696:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.506703:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524b15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.506710:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb63524b15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.506942:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933414528
00000100:00100000:2.0:1789431560.506956:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933414528
00000100:00100000:2.0:1789431560.507030:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295760
00000100:00100000:2.0:1789431560.507043:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+485:14617:x1876351933414528:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431560.507158:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431560.507182:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524add lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a9b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86e9 expref: 485 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.507197:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9b:0x0].0x0 (ffff90ce03149b00)
00010000:00010000:2.0:1789431560.507206:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431560.507236:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524b2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.507253:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524b2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.507263:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524b2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.507281:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524b31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.507288:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524b31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.507294:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524b31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.507446:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524b38 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a9b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.507454:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524b38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a9b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.507460:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524b38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a9b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431560.508447:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1212, 64 off85824
00010000:00010000:2.0:1789431560.508546:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524b3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a9b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.508563:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524b3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a9b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.508574:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524b3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a9b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.508959:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524b3f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a9b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.508967:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524b3f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a9b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.508974:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524b3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a9b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.509104:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431560.509141:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524b38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a9b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.509148:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524b38 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a9b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.509156:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524b38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a9b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.509162:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.509167:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524b38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a9b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.509176:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524b38 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a9b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.509190:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9b:0x0].0x0 (ffff90cf04a08a00)
00010000:00010000:1.0:1789431560.509193:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431560.509198:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524b38 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a9b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.509205:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524b38 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a9b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.509230:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524b2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.509236:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524b2a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.509242:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524b2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.509247:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.509250:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524b2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.509256:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524b2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.509263:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.509266:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.509269:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524b2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.509274:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3c00/0xd8e438fb63524b2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431560.509300:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005076c17f reply state 0000000060b9dc55 transno 4295120871 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524b31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.509315:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431560.509439:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+486:14617:x1876351933414528:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2393us (3004us total) trans 4295120871 rc 0/0
00000100:00100000:1.0:1789431560.509449:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295760
00010000:00010000:2.0:1789431560.510835:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431560.510849:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524b3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a9b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.510865:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac43800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431560.510869:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524b3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a9b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.510879:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524b3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a9b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.510898:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9b:0x0].0x0 (ffff90cf04a08a00)
00010000:00010000:2.0:1789431560.510901:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431560.510906:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524b3f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a9b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.510912:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524b3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a9b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.510939:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431560.510941:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431560.510943:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431560.517029:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.517110:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933414656
00000100:00100000:0.0:1789431560.517124:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933414656
00000100:00100000:0.0:1789431560.517203:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8191
00000100:00100000:0.0:1789431560.517216:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+140:2348:x1876351933414656:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431560.517242:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431560.517276:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63524b46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8705 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789431560.517314:0:14469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x510:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431560.517343:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x510:0x0].0x0 since=3018s v=(0 0)
00010000:00010000:0.0:1789431560.517348:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x510:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.517361:0:14469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63524b46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8705 expref: 141 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.517383:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63524b46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8705 expref: 141 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.517401:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce156e1a00, rc 0)
00000100:00100000:0.0:1789431560.517482:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+141:2348:x1876351933414656:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 269us (468us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.517490:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8191
00010000:00010000:2.0:1789431560.520268:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524b31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.520292:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524b31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.520302:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524b31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.520309:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.520314:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524b31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.520329:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524b31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.520351:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x18178cb5 (ffff90ce359c6a00)
00010000:00010000:2.0:1789431560.520355:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.520361:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524b31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.520369:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524b31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.522596:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.522808:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933414912
00000100:00100000:2.0:1789431560.522823:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933414912
00000100:00100000:2.0:1789431560.522906:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12419
00000100:00100000:2.0:1789431560.522919:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+485:14616:x1876351933414912:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431560.523442:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+486:14616:x1876351933414912:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 523us (867us total) trans 4295120872 rc 0/0
00000100:00100000:2.0:1789431560.523450:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12419
00000100:00100000:0.0:1789431560.535431:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.535551:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.535730:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933415040
00000100:00100000:2.0:1789431560.535754:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933415040
00000100:00100000:1.0:1789431560.535831:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933415296
00000100:00100000:1.0:1789431560.535836:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933415296
00000100:00100000:1.0:1789431560.535902:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295761
00000100:00100000:1.0:1789431560.535916:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+487:14617:x1876351933415040:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.535961:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.535992:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524b4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c870c expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536134:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524b54 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536153:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524b54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536169:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524b54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536188:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524b5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536196:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536207:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536282:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524b54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536300:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524b54 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536308:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524b54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536314:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.536320:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524b54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536329:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524b54 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536343:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.536347:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.536354:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524b54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536360:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524b54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536376:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536382:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524b5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536388:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524b5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536393:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.536396:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524b5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536402:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524b5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536409:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xe94006ef (ffff90ce03149b00)
00010000:00010000:1.0:1789431560.536411:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.536415:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524b5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536421:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524b5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536460:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524b4d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c870c expref: 488 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536472:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.536474:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.536478:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524b4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c870c expref: 488 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536489:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cae00, rc 0)
00000100:00100000:1.0:1789431560.536565:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+487:14617:x1876351933415040:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 652us (1150us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431560.536573:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295761
00000100:00100000:1.0:1789431560.536603:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295762
00000100:00100000:1.0:1789431560.536611:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+486:14616:x1876351933415296:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431560.536649:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431560.536665:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb63524b1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a9c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86fe expref: 486 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536678:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9c:0x0].0x0 (ffff90ce359c6d00)
00010000:00010000:1.0:1789431560.536686:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431560.536701:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536711:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536720:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536733:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524b69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536741:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524b69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536761:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524b69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536877:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524b70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a9c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536891:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524b70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a9c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.536898:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524b70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a9c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431560.537635:0:12775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1211, 64 off85696
00010000:00010000:1.0:1789431560.537715:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524b77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a9c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.537728:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524b77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.537738:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524b77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.537770:0:12775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524b77 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.537778:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524b77 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.537783:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524b77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.537812:0:12775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431560.537844:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431560.537850:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524b77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.537858:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f77c00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.537862:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524b77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.537869:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524b77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.537882:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9c:0x0].0x0 (ffff90ce03149400)
00010000:00010000:1.0:1789431560.537885:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431560.537889:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524b77 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.537896:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524b77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.537909:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.537911:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.537913:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.537932:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524b70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a9c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.537940:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524b70 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a9c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.537947:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524b70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a9c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.537953:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.537958:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524b70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a9c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.537965:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524b70 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a9c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.537978:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9c:0x0].0x0 (ffff90ce03149400)
00010000:00010000:1.0:1789431560.537980:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431560.537983:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524b70 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a9c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.537989:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524b70 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a9c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.538013:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.538020:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b62 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.538026:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.538032:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.538034:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.538041:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.538086:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.538089:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.538093:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b62 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.538100:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431560.538117:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000093746358 reply state 00000000407219f2 transno 4295120873 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524b69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.538127:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431560.538220:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+487:14616:x1876351933415296:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1604us (2662us total) trans 4295120873 rc 0/0
00000100:00100000:1.0:1789431560.538229:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295762
00010000:00010000:0.0:1789431560.547540:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524b69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.547565:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524b69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.547589:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524b69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.547597:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.547604:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524b69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.547613:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524b69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.547635:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x411ba88 (ffff90ce03149000)
00010000:00010000:0.0:1789431560.547646:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.547653:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524b69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.547661:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524b69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.549834:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.549942:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933415424
00000100:00100000:1.0:1789431560.549955:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933415424
00000100:00100000:1.0:1789431560.550035:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295763
00000100:00100000:1.0:1789431560.550076:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+486:14616:x1876351933415424:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.550106:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.550133:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524b7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8713 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550233:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524b85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550250:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524b85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550264:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524b85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550288:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550296:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550303:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550375:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524b85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550383:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524b85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550391:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524b85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550397:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f76400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.550402:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524b85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550412:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524b85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550425:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.550429:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.550435:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524b85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550442:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524b85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550456:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550462:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550469:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550474:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.550477:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550482:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550490:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x806a17dc (ffff90ce03149400)
00010000:00010000:1.0:1789431560.550493:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.550495:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550501:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524b8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550542:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524b7e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8713 expref: 487 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550553:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.550555:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.550559:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524b7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8713 expref: 487 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.550569:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37f77c00, rc 0)
00000100:00100000:1.0:1789431560.550637:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+486:14616:x1876351933415424:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 592us (818us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431560.550645:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295763
00000100:00100000:1.0:1789431560.553425:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.553718:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933415552
00000100:00100000:0.0:1789431560.553733:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933415552
00000100:00100000:0.0:1789431560.553980:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295764
00000100:00100000:0.0:1789431560.553993:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+486:14617:x1876351933415552:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431560.554031:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431560.554095:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524b93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c871a expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.554193:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524b9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.554213:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.554227:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431560.554275:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:0.0:1789431560.554290:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431560.554317:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.554347:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524b93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c871a expref: 488 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.554371:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524b9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c871a expref: 487 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.554382:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431560.554385:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431560.554389:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf00030e00, rc 0)
00000100:00100000:0.0:1789431560.554465:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+487:14617:x1876351933415552:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 475us (1055us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.554473:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295764
00000100:00100000:0.0:1789431560.556098:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.556234:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933415680
00000100:00100000:3.0:1789431560.556246:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933415680
00000100:00100000:3.0:1789431560.556352:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295765
00000100:00100000:3.0:1789431560.556365:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+487:14616:x1876351933415680:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431560.556389:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431560.556415:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524ba1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8721 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.556493:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524ba8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.556509:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.556527:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431560.556570:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:3.0:1789431560.556574:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431560.556595:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.556622:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63524ba1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8721 expref: 489 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.556644:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8721 expref: 488 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.556653:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431560.556656:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431560.556660:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:3.0:1789431560.556742:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+488:14616:x1876351933415680:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 380us (656us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431560.556768:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295765
00000100:00100000:1.0:1789431560.561615:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.561706:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933415808
00000100:00100000:3.0:1789431560.561720:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933415808
00000100:00100000:3.0:1789431560.561960:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12420
00000100:00100000:3.0:1789431560.561974:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+488:14617:x1876351933415808:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:2.0:1789431560.567616:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+488:14617:x1876351933415808:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 5629us (6000us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.567633:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12420
00000100:00100000:1.0:1789431560.571570:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.571680:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933415936
00000100:00100000:2.0:1789431560.571695:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933415936
00000100:00100000:2.0:1789431560.571788:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12421
00000100:00100000:2.0:1789431560.571807:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+488:14616:x1876351933415936:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:2.0:1789431560.583663:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+488:14616:x1876351933415936:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 11841us (12091us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.583681:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12421
00000100:00100000:1.0:1789431560.587563:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.587990:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933416192
00000100:00100000:2.0:1789431560.588005:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933416192
00000100:00100000:2.0:1789431560.588137:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295766
00000100:00100000:2.0:1789431560.588150:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+488:14617:x1876351933416192:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.588181:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.588213:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524baf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8728 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.588903:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524bb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.588926:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.588940:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.588959:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524bbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.588966:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524bbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.588972:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524bbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.589045:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.589082:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524bb6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.589090:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.589096:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.589102:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.589110:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524bb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.589124:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.589127:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.589133:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524bb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.589139:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524bb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.589153:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524bbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.589159:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524bbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.589166:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524bbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.589171:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.589174:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524bbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.589180:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524bbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.589187:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xe94006ef (ffff90cf04a08a00)
00010000:00010000:2.0:1789431560.589189:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.589192:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524bbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.589197:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524bbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.589245:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524baf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8728 expref: 489 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.589256:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.589258:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:2.0:1789431560.589261:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524baf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8728 expref: 489 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.589272:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ac43800, rc 0)
00000100:00100000:2.0:1789431560.590096:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+488:14617:x1876351933416192:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1893us (2493us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431560.590109:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295766
00000100:00100000:1.0:1789431560.595497:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.599167:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933416448
00000100:00100000:0.0:1789431560.599191:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933416448
00000100:00100000:0.0:1789431560.599302:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295767
00000100:00100000:0.0:1789431560.599316:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+488:14616:x1876351933416448:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431560.599350:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431560.599384:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524bc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c872f expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.599495:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524bcb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.599515:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524bcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.599531:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524bcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.599550:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb63524bd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.599558:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb63524bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.599564:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb63524bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.599641:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524bcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.599650:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524bcb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.599657:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524bcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.599663:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e1800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.599669:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524bcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.599677:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524bcb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.599691:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.599694:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.599700:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524bcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.599707:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524bcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.599724:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb63524bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.599731:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb63524bd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.599737:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb63524bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.599742:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f897400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.600154:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb63524bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.600164:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb63524bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.600174:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x806a17dc (ffff90ce2725d000)
00010000:00010000:0.0:1789431560.600177:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.600181:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb63524bd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.600186:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897400/0xd8e438fb63524bd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x806a17dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.600236:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524bc4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c872f expref: 489 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.600246:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.600248:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:0.0:1789431560.600251:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524bc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c872f expref: 489 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.600260:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce249e1200, rc 0)
00000100:00100000:0.0:1789431560.600397:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+488:14616:x1876351933416448:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1082us (4914us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431560.600406:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295767
00000100:00100000:2.0:1789431560.601815:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.605619:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933416576
00000100:00100000:1.0:1789431560.605642:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933416576
00000100:00100000:1.0:1789431560.605755:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295768
00000100:00100000:1.0:1789431560.605780:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+488:14617:x1876351933416576:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.606568:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.606602:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524bd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8736 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606686:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524be0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606707:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524be0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606723:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524be0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606741:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524be7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606759:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524be7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606770:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524be7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606849:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524be0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606858:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524be0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606865:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524be0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606872:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.606877:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524be0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606887:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524be0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606901:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.606905:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.606912:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524be0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606919:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524be0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606934:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524be7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606941:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524be7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606947:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524be7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606953:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.606955:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524be7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606962:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524be7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606970:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xdaec91b0 (ffff90ce03149400)
00010000:00010000:1.0:1789431560.606973:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.606975:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524be7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.606982:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524be7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.607022:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524bd9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8736 expref: 489 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.607033:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.607036:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.607039:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524bd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8736 expref: 489 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.607692:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cae00, rc 0)
00000100:00100000:1.0:1789431560.607938:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+488:14617:x1876351933416576:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2157us (6138us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431560.607949:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295768
00000100:00100000:2.0:1789431560.608942:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.613398:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933416704
00000100:00100000:1.0:1789431560.613421:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933416704
00000100:00100000:1.0:1789431560.613522:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295769
00000100:00100000:1.0:1789431560.613535:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+488:14616:x1876351933416704:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.613567:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.613595:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524bee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c873d expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613688:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524bf5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613708:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613722:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613741:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524bfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613768:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524bfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613775:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524bfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613850:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613863:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524bf5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613870:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613875:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.613881:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613888:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524bf5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613901:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.613905:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.613911:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524bf5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613918:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524bf5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613934:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524bfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613941:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524bfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613947:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524bfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613952:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.613955:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524bfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613961:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524bfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613968:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xa1f039dc (ffff90ce03149b00)
00010000:00010000:1.0:1789431560.613971:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.613974:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524bfc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.613980:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524bfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.614021:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524bee lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c873d expref: 489 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.614031:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.614033:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.614036:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524bee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c873d expref: 489 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.614045:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb600, rc 0)
00000100:00100000:1.0:1789431560.614148:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+488:14616:x1876351933416704:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 615us (5211us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431560.614155:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295769
00000100:00100000:2.0:1789431560.617500:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.617587:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933416832
00000100:00100000:0.0:1789431560.617599:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933416832
00000100:00100000:1.0:1789431560.618179:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295770
00000100:00100000:1.0:1789431560.618199:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+488:14617:x1876351933416832:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.618226:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.618257:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524c03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8744 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.618614:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524c0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.618635:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524c0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.618784:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524c0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.618818:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63524c11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.618826:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63524c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.618832:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63524c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.619021:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524c0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.619030:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524c0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.619038:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524c0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.619045:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f76400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.619228:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524c0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.619240:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524c0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.619256:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.619259:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.619265:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524c0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.619273:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63524c0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.619459:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63524c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.619468:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63524c11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.619474:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63524c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.619481:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb18600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.619484:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63524c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.619491:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63524c11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.619500:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x18178cb5 (ffff90ce03149200)
00010000:00010000:1.0:1789431560.619502:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.619505:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63524c11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.619513:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63524c11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.619561:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524c03 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8744 expref: 489 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.619573:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.619576:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.619591:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63524c03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8744 expref: 489 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.619602:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37f77c00, rc 0)
00000100:00100000:1.0:1789431560.619693:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+488:14617:x1876351933416832:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1501us (2207us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431560.619703:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295770
00000100:00100000:3.0:1789431560.621657:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.621793:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933416960
00000100:00100000:2.0:1789431560.621806:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933416960
00000100:00100000:2.0:1789431560.621880:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295771
00000100:00100000:2.0:1789431560.621892:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+488:14616:x1876351933416960:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.621919:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.621947:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524c18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c874b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622030:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524c1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622324:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524c1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622342:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524c1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622365:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524c26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622373:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622379:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622454:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524c1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622463:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524c1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622474:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524c1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622481:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac43800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.622485:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524c1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622494:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524c1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622507:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431560.622511:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.622517:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524c1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622525:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524c1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622540:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622547:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524c26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622553:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524c26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622559:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.622562:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524c26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622574:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524c26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622581:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x411ba88 (ffff90cf04a08a00)
00010000:00010000:2.0:1789431560.622584:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.622586:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524c26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622592:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42200/0xd8e438fb63524c26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622632:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524c18 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c874b expref: 489 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622643:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431560.622645:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.622649:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524c18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c874b expref: 489 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.622659:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3000, rc 0)
00000100:00100000:2.0:1789431560.622894:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+488:14616:x1876351933416960:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1001us (1249us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431560.622904:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295771
00000100:00100000:0.0:1789431560.627513:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.627639:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933417216
00000100:00100000:1.0:1789431560.627653:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933417216
00000100:00100000:1.0:1789431560.627733:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295772
00000100:00100000:1.0:1789431560.627753:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+488:14616:x1876351933417216:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.627790:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.627794:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:1.0:1789431560.627830:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524ba8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8721 expref: 488 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.627854:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.627861:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431560.627879:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63524c2d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8752 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.628027:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63524c34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.628043:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63524c34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.628093:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63524c34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.628113:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63524c3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.628121:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63524c3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.628127:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63524c3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:1.0:1789431560.628785:0:12181:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x510:0x0], index 1: 0
00010000:00010000:1.0:1789431560.628992:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524c42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a9d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.629005:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.629013:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.629081:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63524c34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.629090:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63524c34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.629097:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63524c34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.629103:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.629108:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63524c34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.629117:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63524c34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.629129:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.629132:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.629141:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63524c34 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.629149:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63524c34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431560.629162:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b41fbc8a reply state 00000000b20feb59 transno 4295120874 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63524c3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.629172:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431560.629212:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63524c2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8752 expref: 490 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.629228:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524c42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8752 expref: 489 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.629241:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9d:0x0].0x0 (ffff90ce03149400)
00010000:00010000:1.0:1789431560.629243:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431560.629246:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb600, rc 0)
00000100:00100000:1.0:1789431560.629346:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+490:14616:x1876351933417216:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1601us (1846us total) trans 4295120874 rc 0/0
00000100:00100000:1.0:1789431560.629354:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295772
00000100:00100000:2.0:1789431560.630996:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.631235:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933417472
00000100:00100000:0.0:1789431560.631248:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933417472
00000100:00100000:0.0:1789431560.631376:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295773
00000100:00100000:0.0:1789431560.631389:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+490:14617:x1876351933417472:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431560.631416:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431560.631419:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431560.631449:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524b9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c871a expref: 490 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.631476:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431560.631482:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431560.631497:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb63524c50 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8759 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.631643:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524c57 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.631660:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524c57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.631673:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524c57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.631691:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.631698:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.631704:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431560.632408:0:6797:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x511:0x0], index 0: 0
00010000:00010000:0.0:1789431560.632632:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524c65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a9e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.632648:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a9e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.632665:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a9e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.632706:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524c57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.632713:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524c57 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.632720:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524c57 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.632726:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f897000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.632732:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524c57 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.632741:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524c57 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.632763:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431560.632766:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.632771:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524c57 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.632778:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897000/0xd8e438fb63524c57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431560.632793:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000036d5c355 reply state 000000006f528771 transno 4295120875 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.632803:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431560.632845:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f897200/0xd8e438fb63524c50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8759 expref: 492 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.632861:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524c65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a9e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8759 expref: 491 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.632867:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9e:0x0].0x0 (ffff90ce15f12900)
00010000:00010000:0.0:1789431560.632869:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431560.632872:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce156e1800, rc 0)
00000100:00100000:0.0:1789431560.632967:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+492:14617:x1876351933417472:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1580us (1983us total) trans 4295120875 rc 0/0
00000100:00100000:0.0:1789431560.632976:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295773
00010000:00010000:2.0:1789431560.637176:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63524c3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.637199:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63524c3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.637209:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63524c3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.637216:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.637221:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63524c3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.637230:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63524c3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.637253:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x411ba88 (ffff90ce03149b00)
00010000:00010000:2.0:1789431560.637256:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.637263:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63524c3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.637270:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63524c3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.637396:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.637542:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933417600
00000100:00100000:3.0:1789431560.637556:0:14499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933417600
00000100:00100000:3.0:1789431560.637632:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8192
00000100:00100000:3.0:1789431560.637643:0:14499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+128:2350:x1876351933417600:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431560.637667:0:14499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431560.637693:0:14499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb63524c73 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8760 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431560.637741:0:14499:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x510:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431560.637780:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x510:0x0].0x0 since=3018s v=(0 0)
00010000:00010000:3.0:1789431560.637785:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x510:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431560.637795:0:14499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb63524c73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8760 expref: 129 pid: 14499 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.637815:0:14499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb63524c73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8760 expref: 129 pid: 14499 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.637828:0:14499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309c00, rc 0)
00000100:00100000:3.0:1789431560.637907:0:14499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+129:2350:x1876351933417600:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 266us (517us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431560.637915:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8192
00010000:00010000:0.0:1789431560.639621:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.639642:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.639651:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.639657:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.639663:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.639671:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.639690:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x18178cb5 (ffff90ce2725d000)
00010000:00010000:0.0:1789431560.639695:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.639700:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.639707:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.642994:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.643841:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933417856
00000100:00100000:3.0:1789431560.643858:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933417856
00000100:00100000:3.0:1789431560.643938:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12422
00000100:00100000:3.0:1789431560.643950:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+490:14616:x1876351933417856:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431560.644666:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+491:14616:x1876351933417856:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 713us (1683us total) trans 4295120876 rc 0/0
00000100:00100000:3.0:1789431560.644675:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12422
00000100:00100000:2.0:1789431560.647707:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.648947:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933417984
00000100:00100000:3.0:1789431560.649128:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933417984
00000100:00100000:2.0:1789431560.649629:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8193
00000100:00100000:2.0:1789431560.649645:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+141:2347:x1876351933417984:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.649671:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.649702:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008edd2dd6/0xd8e438fb63524c7a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8767 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789431560.649833:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x511:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:2.0:1789431560.649864:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x511:0x0].0x0 since=3018s v=(0 0)
00010000:00010000:2.0:1789431560.649870:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x511:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.649883:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008edd2dd6/0xd8e438fb63524c7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8767 expref: 142 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.649904:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008edd2dd6/0xd8e438fb63524c7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8767 expref: 142 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.649921:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ac42200, rc 0)
00000100:00100000:2.0:1789431560.654294:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+142:2347:x1876351933417984:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4625us (6574us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.654311:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8193
00000100:00100000:1.0:1789431560.656941:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.657099:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933418240
00000100:00100000:0.0:1789431560.657114:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933418240
00000100:00100000:0.0:1789431560.657193:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295774
00000100:00100000:0.0:1789431560.657206:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+491:14616:x1876351933418240:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431560.657298:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431560.657336:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524c42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a9d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8752 expref: 491 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.657361:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9d:0x0].0x0 (ffff90ce03149400)
00010000:00010000:0.0:1789431560.657376:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431560.657410:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.657428:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.657441:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.657458:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524c88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.657466:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524c88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.657474:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524c88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.657627:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524c8f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a9d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.657636:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524c8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.657644:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524c8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:0.0:1789431560.658400:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1213, 64 off85888
00000004:00080000:0.0:1789431560.658411:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3018689361130ns, next at 3019689358587ns, rc = 0
00010000:00010000:0.0:1789431560.658485:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524c96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a9d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658497:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524c96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a9d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658508:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524c96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a9d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658517:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524c96 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a9d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658524:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524c96 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a9d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658531:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524c96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a9d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658564:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431560.658590:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524c8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a9d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658598:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524c8f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a9d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658604:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524c8f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a9d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658612:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f894a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.658617:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524c8f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a9d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658625:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524c8f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a9d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658636:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9d:0x0].0x0 (ffff90ce211f4600)
00010000:00010000:0.0:1789431560.658640:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431560.658644:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524c8f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a9d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658650:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524c8f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a9d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658673:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658679:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c81 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658691:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658697:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.658700:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658706:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658714:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.658717:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.658720:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c81 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.658726:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524c81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431560.658736:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005224a295 reply state 000000008ee9611d transno 4295120877 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524c88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.658754:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431560.658876:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+492:14616:x1876351933418240:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1668us (1945us total) trans 4295120877 rc 0/0
00000100:00100000:0.0:1789431560.658886:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295774
00010000:00010000:3.0:1789431560.659711:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431560.659733:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524c96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a9d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.659752:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf18a56200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431560.659756:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524c96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a9d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.659764:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524c96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a9d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.659778:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9d:0x0].0x0 (ffff90ce211f4600)
00010000:00010000:3.0:1789431560.659780:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431560.659784:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524c96 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a9d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.659790:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524c96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a9d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.659810:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431560.659812:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431560.659813:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431560.662131:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.662364:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933418496
00000100:00100000:0.0:1789431560.662378:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933418496
00000100:00100000:0.0:1789431560.662513:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12423
00000100:00100000:0.0:1789431560.662526:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+492:14617:x1876351933418496:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431560.663026:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+493:14617:x1876351933418496:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 502us (912us total) trans 4295120878 rc 0/0
00000100:00100000:0.0:1789431560.663035:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12423
00010000:00010000:3.0:1789431560.664631:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524c88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.664652:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524c88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.664661:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524c88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.664669:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00030e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.664675:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524c88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.664684:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524c88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.664705:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x411ba88 (ffff90ce2725d000)
00010000:00010000:3.0:1789431560.664709:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.664715:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524c88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.664723:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63524c88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x411ba88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.669410:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.669462:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.669560:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933418624
00000100:00100000:1.0:1789431560.669573:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933418624
00000100:00100000:1.0:1789431560.669647:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933418880
00000100:00100000:1.0:1789431560.669651:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933418880
00000100:00100000:1.0:1789431560.669685:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295775
00000100:00100000:1.0:1789431560.669698:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+493:14616:x1876351933418624:12345-192.168.203.4@tcp:101:dbench.0
00000100:00100000:3.0:1789431560.669940:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295776
00000100:00100000:3.0:1789431560.669951:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+493:14617:x1876351933418880:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431560.670009:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431560.670043:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e1800/0xd8e438fb63524c65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a9e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8759 expref: 493 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.670093:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9e:0x0].0x0 (ffff90ce15f12900)
00010000:00010000:3.0:1789431560.670107:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431560.670137:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431560.670139:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524c9d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670151:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524ca4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c876e expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.670160:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524c9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.670171:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524c9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.670191:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524cab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670199:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524cb2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.670199:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524cab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.670207:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524cab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670210:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524cb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670217:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524cb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670230:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524cb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670237:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670242:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.670363:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524cc0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a9e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.670371:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524cc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a9e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.670377:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524cc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a9e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670439:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524cb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670447:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524cb2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670454:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524cb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670460:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.670465:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524cb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670473:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524cb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670482:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.670485:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.670489:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524cb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670495:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524cb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670504:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670509:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524cb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670515:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670520:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.670523:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670529:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524cb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670535:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xa1f039dc (ffff90ce03149200)
00010000:00010000:1.0:1789431560.670537:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.670540:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524cb9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670545:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524cb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670575:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524ca4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c876e expref: 493 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670769:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.670773:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.670777:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524ca4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c876e expref: 493 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.670793:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035ca800, rc 0)
00000100:00100000:1.0:1789431560.670963:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+492:14616:x1876351933418624:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1267us (1566us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431560.670972:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295775
00000040:00080000:3.0:1789431560.671552:0:12775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1212, 64 off85760
00010000:00010000:3.0:1789431560.671815:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524cc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a9e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.671831:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524cc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a9e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.671914:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524cc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a9e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.671928:0:12775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524cc7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a9e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.671935:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524cc7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a9e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.671942:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524cc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a9e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.671970:0:12775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431560.671998:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524cc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a9e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.672005:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524cc0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a9e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.672011:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524cc0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a9e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.672018:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.672022:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524cc0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a9e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.672030:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524cc0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a9e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.672042:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9e:0x0].0x0 (ffff90cf18b78200)
00010000:00010000:3.0:1789431560.672045:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431560.672136:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524cc0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a9e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.672148:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524cc0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a9e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.672171:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524c9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.672177:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524c9d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.672184:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524c9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.672189:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.672192:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524c9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.672199:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524c9d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.672207:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431560.672210:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.672213:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524c9d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.672220:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524c9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431560.672230:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000060fb2a5d reply state 00000000df197d4e transno 4295120879 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524cab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.672239:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431560.672539:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431560.672548:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524cc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a9e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.672556:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431560.672559:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524cc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a9e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.672566:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524cc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a9e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.672576:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9e:0x0].0x0 (ffff90cf18b78200)
00010000:00010000:0.0:1789431560.672578:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431560.672582:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524cc7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a9e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.672587:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524cc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a9e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.672606:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.672608:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.672610:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431560.673589:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+493:14617:x1876351933418880:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3331us (3816us total) trans 4295120879 rc 0/0
00000100:00100000:3.0:1789431560.673601:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295776
00000100:00100000:3.0:1789431560.676205:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431560.677542:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524cab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.677562:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524cab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.677571:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524cab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.677579:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.677585:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524cab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.677594:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524cab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.677613:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x18178cb5 (ffff90cf18b78400)
00010000:00010000:3.0:1789431560.677617:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.677623:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524cab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.677629:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524cab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.678015:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933419008
00000100:00100000:0.0:1789431560.678030:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933419008
00000100:00100000:0.0:1789431560.678297:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295777
00000100:00100000:0.0:1789431560.678312:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+492:14616:x1876351933419008:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431560.678344:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431560.678369:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524cce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8775 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.678454:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524cd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.678472:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.678485:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431560.678534:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:0.0:1789431560.678538:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431560.678559:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.678589:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524cce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8775 expref: 494 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.678607:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8775 expref: 493 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.678615:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.678618:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431560.678621:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf18a56400, rc 0)
00000100:00100000:0.0:1789431560.678708:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+493:14616:x1876351933419008:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 399us (2517us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.678719:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295777
00000100:00100000:3.0:1789431560.682279:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.682485:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933419136
00000100:00100000:2.0:1789431560.682498:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933419136
00000100:00100000:2.0:1789431560.682604:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295778
00000100:00100000:2.0:1789431560.682615:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+493:14617:x1876351933419136:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.682647:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.682674:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524cdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c877c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.682783:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524ce3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.682801:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.682815:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.682832:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524cea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.682840:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.682847:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.682922:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.682930:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524ce3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.682937:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524ce3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.682943:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac43800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.682948:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524ce3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.682956:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524ce3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.682969:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.682972:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.682978:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524ce3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.682984:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524ce3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.682998:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.683004:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524cea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.683010:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524cea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.683015:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.683018:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524cea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.683023:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524cea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.683030:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xdaec91b0 (ffff90cf04d11600)
00010000:00010000:2.0:1789431560.683032:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.683036:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524cea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.683041:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524cea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.683111:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524cdc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c877c expref: 494 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.683121:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.683123:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.683127:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524cdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c877c expref: 494 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.683141:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ac42400, rc 0)
00000100:00100000:2.0:1789431560.683225:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+493:14617:x1876351933419136:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 612us (1191us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431560.683233:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295778
00000100:00100000:1.0:1789431560.686162:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.686528:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933419264
00000100:00100000:2.0:1789431560.686543:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933419264
00000100:00100000:2.0:1789431560.686656:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12424
00000100:00100000:2.0:1789431560.686670:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+493:14616:x1876351933419264:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431560.701600:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.701855:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933419392
00000100:00100000:1.0:1789431560.701869:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933419392
00000100:00100000:1.0:1789431560.701935:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295779
00000100:00100000:1.0:1789431560.701947:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+495:14617:x1876351933419392:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.701973:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.702001:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524cf1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8783 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.702105:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524cf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.702125:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.702141:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431560.702189:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:1.0:1789431560.702193:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431560.702215:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.702251:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524cf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8783 expref: 496 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.702266:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8783 expref: 495 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.702274:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.702277:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431560.702282:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cba00, rc 0)
00000100:00100000:1.0:1789431560.702347:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+495:14617:x1876351933419392:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 403us (775us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431560.702355:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295779
00000100:00100000:1.0:1789431560.705036:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+494:14616:x1876351933419264:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 18352us (18870us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431560.705077:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12424
00000100:00100000:1.0:1789431560.714577:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.714668:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.714719:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933419520
00000100:00100000:1.0:1789431560.714732:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933419520
00000100:00100000:1.0:1789431560.714812:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12425
00000100:00100000:1.0:1789431560.714825:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+494:14617:x1876351933419520:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431560.715102:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933419776
00000100:00100000:0.0:1789431560.715109:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933419776
00000100:00100000:0.0:1789431560.715146:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295780
00000100:00100000:0.0:1789431560.715154:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+495:14616:x1876351933419776:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431560.715168:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431560.715196:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524cff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c878a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715301:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524d06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715319:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524d06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715333:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524d06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715352:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524d0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715365:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524d0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715372:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524d0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715593:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524d06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715611:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524d06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715619:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524d06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715626:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.715632:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524d06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715640:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524d06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715655:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.715659:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.715665:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524d06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715672:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524d06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715688:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524d0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715695:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524d0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715701:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524d0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715706:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f894a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.715710:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524d0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715716:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524d0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715723:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xa1f039dc (ffff90ce211f4600)
00010000:00010000:0.0:1789431560.715914:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.715920:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524d0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715926:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524d0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715978:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524cff lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c878a expref: 497 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.715990:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.715993:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:0.0:1789431560.715997:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524cff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c878a expref: 497 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.716008:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf18a56200, rc 0)
00000100:00100000:0.0:1789431560.716092:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+496:14616:x1876351933419776:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 938us (1423us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431560.716101:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295780
00000100:00100000:3.0:1789431560.722491:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+494:14617:x1876351933419520:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 7653us (7916us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431560.722513:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12425
00000100:00100000:1.0:1789431560.725257:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.729120:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933419904
00000100:00100000:3.0:1789431560.729141:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933419904
00000100:00100000:2.0:1789431560.729474:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295781
00000100:00100000:2.0:1789431560.729488:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+494:14616:x1876351933419904:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.729515:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.729543:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524d14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8791 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.729627:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524d1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.729646:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524d1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.729660:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524d1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.729676:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524d22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.729683:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.729690:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.732517:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.732938:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933420160
00000100:00100000:1.0:1789431560.732952:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933420160
00000100:00100000:1.0:1789431560.733026:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295782
00000100:00100000:1.0:1789431560.733039:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+496:14617:x1876351933420160:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.733087:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.733122:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524d29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8798 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.733228:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d30 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.733247:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.733262:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.733278:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.733286:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.733293:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.735235:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.735259:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.735267:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.735275:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.735282:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.735292:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.735313:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.735316:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.735322:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.735329:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.735443:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.735450:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.735456:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.735461:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.735464:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.735470:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.735479:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xdaec91b0 (ffff90ce03149200)
00010000:00010000:1.0:1789431560.735482:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.735486:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.735492:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.735557:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524d29 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8798 expref: 497 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.735569:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.735571:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:1.0:1789431560.735575:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524d29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8798 expref: 497 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.735585:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cae00, rc 0)
00000100:00100000:1.0:1789431560.736934:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+496:14617:x1876351933420160:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3884us (4424us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431560.736950:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295782
00010000:00010000:2.0:1789431560.740599:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524d1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.740619:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524d1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.740628:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524d1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.740633:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.740638:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524d1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.740647:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524d1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.740666:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431560.740669:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.740675:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524d1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.740682:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524d1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.740698:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.740704:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524d22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.740711:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524d22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.740716:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac43800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.740718:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524d22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.740738:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524d22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.740755:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x18178cb5 (ffff90cf04d11600)
00010000:00010000:2.0:1789431560.740757:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.742404:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524d22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.742423:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43800/0xd8e438fb63524d22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.742501:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524d14 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8791 expref: 495 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.742515:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431560.742518:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.742522:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524d14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8791 expref: 495 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.742532:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bae3000, rc 0)
00000100:00100000:2.0:1789431560.742622:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+494:14616:x1876351933419904:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 13136us (17375us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431560.742633:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295781
00000100:00100000:0.0:1789431560.745353:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.745477:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933420288
00000100:00100000:3.0:1789431560.745493:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933420288
00000100:00100000:3.0:1789431560.745571:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295783
00000100:00100000:3.0:1789431560.745584:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+494:14617:x1876351933420288:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431560.745682:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431560.745712:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524d3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c879f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.745807:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524d45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.745825:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524d45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.745839:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524d45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.745856:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524d4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.745863:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524d4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.745871:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524d4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.746653:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524d45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.746668:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524d45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.746676:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524d45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.746683:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.746688:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524d45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.746697:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524d45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.746713:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.746717:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.746722:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524d45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.746740:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524d45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.746880:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524d4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.746888:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524d4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.746899:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524d4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.746905:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.746908:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524d4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.746914:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524d4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.746923:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x8deccae1 (ffff90cf18b78400)
00010000:00010000:2.0:1789431560.746926:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.746929:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524d4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.746934:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524d4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.746981:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524d3e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c879f expref: 495 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.746991:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.746993:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.746997:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524d3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c879f expref: 495 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.747007:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:2.0:1789431560.747136:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+494:14617:x1876351933420288:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1554us (1798us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431560.747146:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295783
00000100:00100000:1.0:1789431560.771927:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.771991:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.775097:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933420544
00000100:00100000:0.0:1789431560.775119:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933420544
00000100:00100000:0.0:1789431560.775198:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933420800
00000100:00100000:0.0:1789431560.775202:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933420800
00000100:00100000:0.0:1789431560.775239:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295784
00000100:00100000:0.0:1789431560.775251:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+495:14617:x1876351933420544:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431560.775292:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431560.775297:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431560.775333:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524cf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8783 expref: 495 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.775359:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431560.775367:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431560.775386:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63524d53 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c87a6 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.775737:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63524d5a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.775765:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63524d5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.775778:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63524d5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.775796:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63524d61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.775804:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63524d61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.775811:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63524d61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.776164:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295785
00000100:00100000:1.0:1789431560.776182:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+495:14616:x1876351933420800:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.776196:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.776199:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:1.0:1789431560.776219:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524cd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8775 expref: 495 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.776235:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.776241:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431560.776253:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524d68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c87ad expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.776465:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d6f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.776477:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.776488:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.776504:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.776512:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.776520:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431560.776656:0:12775:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x511:0x0], index 1: 0
00010000:00010000:0.0:1789431560.777027:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63524d7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a9f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.777038:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63524d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a9f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.777072:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63524d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a9f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.777118:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63524d5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.777126:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63524d5a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.777134:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63524d5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.777141:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d000 already unused, calling callback (ffffffffc211f4f0)
00000004:00080000:1.0:1789431560.777143:0:12181:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x512:0x0], index 0: 0
00010000:00010000:0.0:1789431560.777146:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63524d5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.777157:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63524d5a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.777168:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431560.777171:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.777177:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63524d5a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.777187:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63524d5a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431560.777199:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d07a1544 reply state 0000000063861e40 transno 4295120880 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63524d61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.777207:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431560.777244:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63524d53 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87a6 expref: 497 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.777262:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63524d7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a9f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87a6 expref: 496 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.777269:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9f:0x0].0x0 (ffff90ce211f4100)
00010000:00010000:0.0:1789431560.777271:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431560.777273:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62d200, rc 0)
00010000:00010000:1.0:1789431560.777355:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524d8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.777367:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+498:14617:x1876351933420544:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2116us (5453us total) trans 4295120880 rc 0/0
00010000:00010000:1.0:1789431560.777367:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524d8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.777384:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295784
00010000:00010000:1.0:1789431560.777385:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524d8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.777418:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.777425:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d6f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.777432:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.777438:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.777441:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.777447:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d6f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.777456:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.777459:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.777463:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d6f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.777469:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524d6f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431560.777481:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002c258e7e reply state 00000000f304990b transno 4295120881 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.777489:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431560.777510:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cae00/0xd8e438fb63524d68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87ad expref: 498 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.777529:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524d8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87ad expref: 497 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.777536:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa0:0x0].0x0 (ffff90ce03149500)
00010000:00010000:1.0:1789431560.777539:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431560.777542:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035ca800, rc 0)
00000100:00100000:1.0:1789431560.777581:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+498:14616:x1876351933420800:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1406us (5590us total) trans 4295120881 rc 0/0
00000100:00100000:1.0:1789431560.777588:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295785
00000100:00100000:1.0:1789431560.777676:0:6794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6794:1876351894195840:0@lo:5:osp-pre-0-0.0
00000100:00100000:1.0:1789431560.777739:0:6794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.777820:0:6794:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f39c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431560.781378:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894195840
00000100:00100000:0.0:1789431560.781401:0:14491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894195840
00000100:00100000:0.0:1789431560.781478:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8194
00000100:00100000:0.0:1789431560.781490:0:14491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:6794:x1876351894195840:12345-0@lo:5:osp-pre-0-0.0
00002000:00080000:0.0:1789431560.781563:0:14491:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1314
00010000:00010000:3.0:1789431560.782558:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63524d61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.782577:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63524d61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.782585:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63524d61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.782592:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.782597:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63524d61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.782605:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63524d61 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.782637:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x8deccae1 (ffff90ce211f4600)
00010000:00010000:3.0:1789431560.782641:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.782646:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63524d61 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.782652:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63524d61 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.784260:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.784280:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.784289:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.784296:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.784301:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.784310:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.784328:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x18178cb5 (ffff90ce03149200)
00010000:00010000:2.0:1789431560.784331:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.784336:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.784343:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524d76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.785128:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.785206:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933420928
00000100:00100000:2.0:1789431560.785218:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933420928
00000100:00100000:2.0:1789431560.785291:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8195
00000100:00100000:2.0:1789431560.785304:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+142:2348:x1876351933420928:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431560.785330:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431560.785354:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020cafc2e/0xd8e438fb63524d99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c87b4 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789431560.785390:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x512:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:2.0:1789431560.785415:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x512:0x0].0x0 since=3018s v=(0 0)
00010000:00010000:2.0:1789431560.785421:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x512:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.785433:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020cafc2e/0xd8e438fb63524d99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87b4 expref: 143 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.785454:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000020cafc2e/0xd8e438fb63524d99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87b4 expref: 143 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.785468:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ac43800, rc 0)
00000100:00100000:2.0:1789431560.785550:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+143:2348:x1876351933420928:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 249us (429us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.785558:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8195
00000100:00100000:1.0:1789431560.789938:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.789996:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933421056
00000100:00100000:1.0:1789431560.790009:0:14472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933421056
00000100:00100000:1.0:1789431560.790101:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8196
00000100:00100000:1.0:1789431560.790114:0:14472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+129:2347:x1876351933421056:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.790139:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.790167:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c10f63cd/0xd8e438fb63524da0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c87bb expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789431560.790209:0:14472:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x511:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:1.0:1789431560.790246:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x511:0x0].0x0 since=3018s v=(0 0)
00010000:00010000:1.0:1789431560.790251:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x511:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.790263:0:14472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c10f63cd/0xd8e438fb63524da0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87bb expref: 130 pid: 14472 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.790285:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c10f63cd/0xd8e438fb63524da0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87bb expref: 130 pid: 14472 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.790300:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cae00, rc 0)
00000100:00100000:1.0:1789431560.790364:0:14472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+130:2347:x1876351933421056:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 253us (440us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431560.790370:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8196
00000100:00100000:1.0:1789431560.798374:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.799155:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933421312
00000100:00100000:3.0:1789431560.799169:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933421312
00000100:00100000:3.0:1789431560.799239:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12426
00000100:00100000:3.0:1789431560.799250:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+496:14616:x1876351933421312:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431560.800003:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+497:14616:x1876351933421312:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 749us (1767us total) trans 4295120882 rc 0/0
00000100:00100000:3.0:1789431560.800013:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12426
00000100:00100000:3.0:1789431560.802496:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.802536:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933421568
00000100:00100000:1.0:1789431560.802550:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933421568
00000100:00100000:1.0:1789431560.803038:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12427
00000100:00100000:1.0:1789431560.803072:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+497:14617:x1876351933421568:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431560.805826:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+498:14617:x1876351933421568:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 2761us (3328us total) trans 4295120883 rc 0/0
00000100:00100000:1.0:1789431560.805843:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12427
00000100:00100000:2.0:1789431560.813987:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.814987:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.815034:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933421824
00000100:00100000:3.0:1789431560.815072:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933421824
00000100:00100000:3.0:1789431560.817445:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933422080
00000100:00100000:3.0:1789431560.817461:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933422080
00000100:00100000:3.0:1789431560.817531:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295786
00000100:00100000:3.0:1789431560.817543:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+499:14616:x1876351933421824:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431560.817953:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431560.817992:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524d8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87ad expref: 499 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.818015:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa0:0x0].0x0 (ffff90ce03149500)
00010000:00010000:3.0:1789431560.818031:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431560.818096:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295787
00010000:00010000:3.0:1789431560.818097:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524da7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.818113:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+498:14617:x1876351933422080:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431560.818118:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524da7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.818132:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524da7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.818147:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431560.818150:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524dae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.818159:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524dae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.818167:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63524d7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a9f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87a6 expref: 498 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.818170:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524dae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.818192:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9f:0x0].0x0 (ffff90ce211f4100)
00010000:00010000:1.0:1789431560.818202:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431560.818217:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524db5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.818228:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524db5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.818238:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524db5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.818253:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524dbc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.818261:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524dbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.818269:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524dbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.818504:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524dc3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a9f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.818515:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524dc3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a9f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.818523:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524dc3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a9f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.818698:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524dca lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aa0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.818707:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524dca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.818715:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524dca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431560.819997:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1214, 64 off85952
00000040:00080000:3.0:1789431560.821123:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1213, 64 off85824
00010000:00010000:3.0:1789431560.821216:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524dd1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aa0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.821238:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.821253:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.821263:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524dd1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.821269:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524dd1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.821287:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524dd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.821320:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431560.821357:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524dca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.821368:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524dca lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aa0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.821375:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524dca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.821603:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524dd8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a9f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.821716:0:14491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:6794:x1876351894195840:12345-0@lo:5:osp-pre-0-0.0 Request processed in 40222us (43969us total) trans 4294969583 rc 0/0
00000100:00100000:1.0:1789431560.821731:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8194
00010000:00010000:2.0:1789431560.821734:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524dd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a9f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.821754:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524dd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a9f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.821818:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524dd8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a9f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.821824:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524dd8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a9f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.821830:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524dd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a9f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.821846:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:2.0:1789431560.821861:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524dc3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.821867:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524dc3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.821874:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524dc3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.821881:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.821887:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524dc3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.821896:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524dc3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.821912:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9f:0x0].0x0 (ffff90cf13195b00)
00010000:00010000:2.0:1789431560.821915:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431560.821921:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524dc3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.821928:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42400/0xd8e438fb63524dc3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.821939:0:6794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6794:1876351894195840:0@lo:5:osp-pre-0-0.0
00010000:00010000:2.0:1789431560.821954:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524db5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:1.0:1789431560.821958:0:6794:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x512:0x0]-[0x240000400:0x541:0x0]
00010000:00010000:2.0:1789431560.821968:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524db5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.821974:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524db5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.821980:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.821983:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524db5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.821987:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:2.0:1789431560.821990:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524db5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.821995:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524dd1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.822000:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431560.822006:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.822008:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431560.822011:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524db5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.822019:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524db5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.822026:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524dd1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431560.822036:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b9daed5a reply state 000000003d5621d0 transno 4295120884 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524dbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.822038:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524dd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.822071:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa0:0x0].0x0 (ffff90cf18b78700)
00000100:00100000:2.0:1789431560.822072:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431560.822077:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431560.822083:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524dd1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10aa0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.822089:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63524dd1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aa0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.822102:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431560.822106:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524dd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a9f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.822111:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bae3000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.822114:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524dd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a9f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.822120:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524dd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a9f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.822127:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a9f:0x0].0x0 (ffff90cf13195b00)
00010000:00010000:1.0:1789431560.822130:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431560.822133:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524dd8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a9f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.822139:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3000/0xd8e438fb63524dd8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a9f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.822156:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.822158:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.822161:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431560.822323:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+500:14617:x1876351933422080:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 4079us (7204us total) trans 4295120884 rc 0/0
00000100:00100000:2.0:1789431560.822378:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295787
00010000:00010000:3.0:1789431560.823262:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.823270:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524dca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.823292:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524dca lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aa0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.823307:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa0:0x0].0x0 (ffff90cf18b78700)
00010000:00010000:3.0:1789431560.823310:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431560.823315:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524dca lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aa0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.823322:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63524dca lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aa0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.824553:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524da7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.824570:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524da7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.824578:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524da7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.824585:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431560.824590:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524da7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.824598:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524da7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.824796:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431560.824800:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431560.824805:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524da7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.824812:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524da7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431560.824826:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f1326579 reply state 000000007102db04 transno 4295120885 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524dae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.824836:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431560.824966:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+500:14616:x1876351933421824:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 7419us (10983us total) trans 4295120885 rc 0/0
00000100:00100000:3.0:1789431560.824976:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295786
00010000:00010000:3.0:1789431560.825016:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431560.826566:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524dbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.826586:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524dbc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.826594:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524dbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.826600:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.826606:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524dbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.826770:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524dbc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.826790:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x8deccae1 (ffff90ce03149b00)
00010000:00010000:2.0:1789431560.826794:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.826799:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524dbc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.826807:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63524dbc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.828130:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431560.828323:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524dae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.828345:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524dae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.828355:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524dae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.828362:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431560.828367:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524dae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.828375:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524dae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.828564:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x18178cb5 (ffff90cf18b78100)
00010000:00010000:2.0:1789431560.828568:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431560.828573:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524dae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.828580:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63524dae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.831034:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933422208
00000100:00100000:0.0:1789431560.831090:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933422208
00000100:00100000:0.0:1789431560.831165:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295788
00000100:00100000:0.0:1789431560.831179:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+498:14617:x1876351933422208:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431560.831208:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431560.831238:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524ddf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c87c2 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.833804:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524de6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.833838:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.833854:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.833876:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524ded lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.833884:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.833891:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.833963:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.833972:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524de6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.833979:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524de6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.833990:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf18a56200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.833995:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524de6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.834004:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524de6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.834016:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431560.834019:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.834026:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524de6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.834032:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63524de6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.834046:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.834068:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524ded lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.834074:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.834080:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f894a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.834082:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.834088:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524ded lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.834100:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x148c06c6 (ffff90ce07190900)
00010000:00010000:0.0:1789431560.834102:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.834105:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524ded lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.834111:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524ded lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.834158:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524ddf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87c2 expref: 499 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.834171:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431560.834174:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.834178:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524ddf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87c2 expref: 499 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.834188:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf18a56400, rc 0)
00000100:00100000:0.0:1789431560.834302:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+498:14617:x1876351933422208:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3124us (6184us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431560.834312:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295788
00000100:00100000:1.0:1789431560.835713:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.836104:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933422336
00000100:00100000:3.0:1789431560.836120:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933422336
00000100:00100000:3.0:1789431560.836197:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295789
00000100:00100000:3.0:1789431560.836211:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+498:14616:x1876351933422336:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431560.836245:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431560.836589:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524df4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c87c9 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838706:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524dfb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838737:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524dfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838764:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524dfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838791:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524e02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838798:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524e02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838805:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524e02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838876:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524dfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838884:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524dfb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838892:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524dfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838899:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f894a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.838904:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524dfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838912:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524dfb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838926:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.838929:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.838935:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524dfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838942:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63524dfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838958:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524e02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838965:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524e02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838972:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524e02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838977:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf18a56400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431560.838980:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524e02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838986:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524e02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.838993:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xa1f039dc (ffff90ce07190900)
00010000:00010000:0.0:1789431560.838996:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.838999:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524e02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.839004:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb63524e02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.839071:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524df4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87c9 expref: 499 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.839085:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431560.839088:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431560.839093:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63524df4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87c9 expref: 499 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.839106:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:0.0:1789431560.839209:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+498:14616:x1876351933422336:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3000us (3506us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431560.839220:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295789
00000001:00080000:2.0:1789431560.846837:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295120878 is committed
00000004:00080000:2.0:1789431560.846863:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 365 committed
00000004:00080000:2.0:1789431560.846955:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 363 committed
00000004:00080000:2.0:1789431560.847076:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 365 committed
00000004:00080000:2.0:1789431560.847230:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 366 committed
00000004:00080000:2.0:1789431560.847251:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 364 committed
00000100:00100000:1.0:1789431560.847261:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000004:00080000:2.0:1789431560.847297:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 363 committed
00000100:00100000:1.0:1789431560.847308:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000004:00080000:2.0:1789431560.847324:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 364 committed
00000004:00080000:2.0:1789431560.847339:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 362 committed
00000100:00100000:1.0:1789431560.847358:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933422464
00000100:00100000:1.0:1789431560.847370:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933422464
00000004:00080000:2.0:1789431560.847407:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 362 committed
00000001:00080000:2.0:1789431560.847422:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295120879 is committed
00000100:00100000:1.0:1789431560.847431:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933422592
00000100:00100000:1.0:1789431560.847435:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933422592
00000100:00100000:1.0:1789431560.847465:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295790
00000100:00100000:1.0:1789431560.847477:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14617:x1876351933422464:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.847505:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00000004:00080000:2.0:1789431560.847508:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 361 committed
00010000:00010000:1.0:1789431560.847535:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524e09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c87d0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.847622:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524e10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.847640:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.847654:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431560.847698:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00000004:00200000:1.0:1789431560.847704:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431560.847728:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.847772:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63524e09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87d0 expref: 259 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.847777:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894195968:0@lo:6:osp-syn-0-0.0
00010000:00010000:1.0:1789431560.847798:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524e10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87d0 expref: 258 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.847809:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.847812:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431560.847817:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035ca800, rc 0)
00000100:00100000:2.0:1789431560.847846:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431560.847914:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894196480:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431560.847937:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431560.847963:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1789431560.847970:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894196352:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431560.847991:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431560.848007:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894196864:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431560.848027:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431560.848077:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894196224:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431560.848100:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431560.848117:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894196736:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431560.848136:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431560.848163:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:2.0:1789431560.848170:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894196096:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431560.848191:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.848197:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+258:14617:x1876351933422464:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 719us (942us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431560.848207:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295790
00000100:00100000:2.0:1789431560.848214:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894196608:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431560.848237:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295791
00000100:00100000:2.0:1789431560.848243:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.848251:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+257:14616:x1876351933422592:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.848262:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.848273:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524e17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c87d7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.848277:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894195968
00000100:00100000:2.0:1789431560.848285:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894195968
00010000:00010000:1.0:1789431560.848321:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524e1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.848323:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894196480
00000100:00100000:2.0:1789431560.848326:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894196480
00000100:00100000:2.0:1789431560.848344:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894196352
00000100:00100000:2.0:1789431560.848347:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894196352
00000100:00100000:2.0:1789431560.848362:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894196864
00000100:00100000:2.0:1789431560.848365:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894196864
00000100:00100000:2.0:1789431560.848379:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894196224
00000100:00100000:2.0:1789431560.848381:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894196224
00010000:00010000:1.0:1789431560.848396:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524e1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.848398:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894196736
00000100:00100000:2.0:1789431560.848403:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894196736
00010000:00010000:1.0:1789431560.848410:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524e1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.848422:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894196096
00000100:00100000:2.0:1789431560.848426:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894196096
00000004:00200000:1.0:1789431560.848439:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000100:00100000:2.0:1789431560.848443:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894196608
00000004:00200000:1.0:1789431560.848445:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000100:00100000:2.0:1789431560.848447:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894196608
00000004:00010000:1.0:1789431560.848460:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524e1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.848471:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8197
00000100:00100000:2.0:1789431560.848480:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3314:x1876351894195968:12345-0@lo:6:osp-syn-0-0.0
00010000:00010000:1.0:1789431560.848485:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524e17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87d7 expref: 259 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.848501:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524e1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87d7 expref: 258 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00080000:2.0:1789431560.848503:0:14471:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1261 count 1
00010000:00010000:1.0:1789431560.848512:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.848515:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431560.848518:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035ca200, rc 0)
00010000:00010000:2.0:1789431560.848528:0:14471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096242664/0xd8e438fb63524e25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.848547:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+258:14616:x1876351933422592:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 300us (1239us total) trans 0 rc 0/0
00010000:00010000:2.0:1789431560.848550:0:14471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006412014/0xd8e438fb63521d41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79a6 expref: 142 pid: 14491 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.848559:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295791
00010000:00010000:2.0:1789431560.848569:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ed:0x0].0x0 since=6s v=(0 0)
00010000:00010000:2.0:1789431560.848575:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ed:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.848581:0:14471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096242664/0xd8e438fb63524e25 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.848617:0:14471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006412014/0xd8e438fb63521d41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79a6 expref: 142 pid: 14491 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.848638:0:14471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006412014/0xd8e438fb63521d41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79a6 expref: 142 pid: 14491 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.848651:0:14471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a047800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14471:1876351894196992:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431560.848700:0:14471:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf030e9780 going to sleep for 11 seconds
00000100:00100000:2.0:1789431560.848722:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8198
00000100:00100000:2.0:1789431560.848731:0:14490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3314:x1876351894196480:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431560.848759:0:14490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1265 count 1
00010000:00010000:2.0:1789431560.848772:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524e2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.848785:0:14490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4ab51f7/0xd8e438fb63522624 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c3f expref: 142 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.848794:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f1:0x0].0x0 since=4s v=(0 0)
00010000:00010000:2.0:1789431560.848797:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f1:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.848800:0:14490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524e2c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.848822:0:14490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4ab51f7/0xd8e438fb63522624 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c3f expref: 142 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.848831:0:14490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4ab51f7/0xd8e438fb63522624 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c3f expref: 142 pid: 14500 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.848846:0:14490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a047100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:14490:1876351894197120:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431560.848882:0:14490:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead840 going to sleep for 11 seconds
00000100:00100000:2.0:1789431560.848902:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8199
00000100:00100000:2.0:1789431560.848910:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3314:x1876351894196352:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431560.848923:0:6699:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1264 count 1
00010000:00010000:2.0:1789431560.848935:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6f93f9d/0xd8e438fb63524e33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.848948:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a626b0b0/0xd8e438fb635223d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b89 expref: 142 pid: 14468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.848955:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f0:0x0].0x0 since=5s v=(0 0)
00010000:00010000:2.0:1789431560.848958:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f0:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.848961:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f93f9d/0xd8e438fb63524e33 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.848981:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a626b0b0/0xd8e438fb635223d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b89 expref: 142 pid: 14468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.848991:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a626b0b0/0xd8e438fb635223d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b89 expref: 142 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.849000:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a045880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1876351894197248:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431560.849027:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05eadd80 going to sleep for 11 seconds
00000100:00100000:2.0:1789431560.849075:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8200
00000100:00100000:2.0:1789431560.849083:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+13:3314:x1876351894196864:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431560.849095:0:14497:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1268 count 1
00010000:00010000:2.0:1789431560.849108:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3600127/0xd8e438fb63524e3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849119:0:14497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2c7be19/0xd8e438fb63522934 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d1f expref: 142 pid: 14468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849127:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f4:0x0].0x0 since=4s v=(0 0)
00010000:00010000:2.0:1789431560.849130:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f4:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.849134:0:14497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3600127/0xd8e438fb63524e3a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849152:0:14497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2c7be19/0xd8e438fb63522934 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d1f expref: 142 pid: 14468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849161:0:14497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2c7be19/0xd8e438fb63522934 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d1f expref: 142 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.849170:0:14497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a045f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14497:1876351894197376:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431560.849209:0:14497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf06c1b480 going to sleep for 11 seconds
00000100:00100000:2.0:1789431560.849226:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8201
00000100:00100000:2.0:1789431560.849233:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3312:x1876351894196224:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431560.849247:0:14468:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1263 count 1
00010000:00010000:2.0:1789431560.849257:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d8846b2/0xd8e438fb63524e41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849268:0:14468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d83003b2/0xd8e438fb635222b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b43 expref: 142 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849275:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ef:0x0].0x0 since=5s v=(0 0)
00010000:00010000:2.0:1789431560.849278:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ef:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.849282:0:14468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d8846b2/0xd8e438fb63524e41 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849298:0:14468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d83003b2/0xd8e438fb635222b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b43 expref: 142 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849308:0:14468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d83003b2/0xd8e438fb635222b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b43 expref: 142 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.849317:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a044a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14468:1876351894197504:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431560.849337:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b6a2600 going to sleep for 11 seconds
00000100:00100000:2.0:1789431560.849356:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8202
00000100:00100000:2.0:1789431560.849362:0:14464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3312:x1876351894196736:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431560.849374:0:14464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1267 count 1
00010000:00010000:2.0:1789431560.849385:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524e48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849401:0:14464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f4a0465/0xd8e438fb6352287e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ce7 expref: 142 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849407:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f3:0x0].0x0 since=4s v=(0 0)
00010000:00010000:2.0:1789431560.849410:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.849413:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524e48 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849429:0:14464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f4a0465/0xd8e438fb6352287e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ce7 expref: 142 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849438:0:14464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f4a0465/0xd8e438fb6352287e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ce7 expref: 142 pid: 6699 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.849447:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a045180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14464:1876351894197632:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431560.849466:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b6a2540 going to sleep for 11 seconds
00000100:00100000:2.0:1789431560.849482:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8203
00000100:00100000:2.0:1789431560.849489:0:14499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+13:3312:x1876351894196096:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431560.849502:0:14499:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1262 count 1
00010000:00010000:2.0:1789431560.849513:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524e4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849525:0:14499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb63521f7f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a55 expref: 142 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849537:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ee:0x0].0x0 since=5s v=(0 0)
00010000:00010000:2.0:1789431560.849540:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ee:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.849543:0:14499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524e4f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849560:0:14499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb63521f7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a55 expref: 142 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849569:0:14499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb63521f7f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a55 expref: 142 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.849578:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a045c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:14499:1876351894197760:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431560.849597:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b6a2b40 going to sleep for 11 seconds
00000100:00100000:2.0:1789431560.849613:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8204
00000100:00100000:2.0:1789431560.849620:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3312:x1876351894196608:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431560.849632:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1266 count 1
00010000:00010000:2.0:1789431560.849644:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6fc6983/0xd8e438fb63524e56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849655:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f25d5c2/0xd8e438fb6352270b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c77 expref: 142 pid: 14502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849662:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f2:0x0].0x0 since=4s v=(0 0)
00010000:00010000:2.0:1789431560.849665:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f2:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.849669:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6fc6983/0xd8e438fb63524e56 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849687:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f25d5c2/0xd8e438fb6352270b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c77 expref: 142 pid: 14502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.849695:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f25d5c2/0xd8e438fb6352270b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c77 expref: 142 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.849704:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a045500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1876351894197888:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431560.849723:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf08746900 going to sleep for 11 seconds
00000100:00100000:1.0:1789431560.852341:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1789431560.852373:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894198016:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.852460:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.852519:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894198144:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.852549:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.852584:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894198016
00000100:00100000:1.0:1789431560.852593:0:14472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894198016
00000100:00100000:1.0:1789431560.852657:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894198144
00000100:00100000:1.0:1789431560.852661:0:14472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894198144
00000100:00100000:1.0:1789431560.857373:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8205
00000100:00100000:1.0:1789431560.857406:0:14472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3313:x1876351894198016:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431560.857451:0:14472:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1264 count 1
00010000:00010000:1.0:1789431560.857488:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063a05555/0xd8e438fb63524e5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.857522:0:14472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035363576/0xd8e438fb635224f7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7bdd expref: 129 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.857533:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f0:0x0].0x0 since=4s v=(0 0)
00010000:00010000:1.0:1789431560.857537:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f0:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.857543:0:14472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063a05555/0xd8e438fb63524e5d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.857583:0:14472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035363576/0xd8e438fb635224f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7bdd expref: 129 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.857600:0:14472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035363576/0xd8e438fb635224f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7bdd expref: 129 pid: 14469 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.857616:0:14472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b2c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14472:1876351894199040:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431560.857728:0:14472:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f39c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431560.859029:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8206
00000100:00100000:0.0:1789431560.859065:0:14482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3311:x1876351894198144:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431560.859104:0:14482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1265 count 1
00010000:00010000:0.0:1789431560.859134:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8c51b6c/0xd8e438fb63524e64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.859157:0:14482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb6352262b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c38 expref: 129 pid: 14499 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.859166:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f1:0x0].0x0 since=4s v=(0 0)
00010000:00010000:0.0:1789431560.859170:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f1:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.859175:0:14482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8c51b6c/0xd8e438fb63524e64 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.859209:0:14482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb6352262b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c38 expref: 129 pid: 14499 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.859221:0:14482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb6352262b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c38 expref: 129 pid: 14499 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.859240:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14482:1876351894199168:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.859318:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1180 going to sleep for 11 seconds
00000100:00080000:0.0:1789431560.859371:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1789431560.859600:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894198656:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.859654:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.859702:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:1.0:1789431560.859709:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894198272:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.859731:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.859758:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894198784:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.859778:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.859805:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894198400:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.859828:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.859845:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894198912:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.859863:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.859878:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1789431560.859884:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894198528:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.859904:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.859933:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894198656
00000100:00100000:1.0:1789431560.859942:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894198656
00000100:00100000:1.0:1789431560.859979:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894198272
00000100:00100000:1.0:1789431560.859981:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894198272
00000100:00100000:1.0:1789431560.859993:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894198784
00000100:00100000:1.0:1789431560.859995:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894198784
00000100:00100000:1.0:1789431560.860002:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894198400
00000100:00100000:1.0:1789431560.860004:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894198400
00000100:00100000:1.0:1789431560.860010:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894198912
00000100:00100000:1.0:1789431560.860023:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894198912
00000100:00100000:1.0:1789431560.860031:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894198528
00000100:00100000:1.0:1789431560.860033:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894198528
00000100:00100000:1.0:1789431560.860043:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8207
00000100:00100000:1.0:1789431560.860068:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3311:x1876351894198656:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431560.860084:0:14486:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1269 count 1
00010000:00010000:1.0:1789431560.860101:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca98d896/0xd8e438fb63524e6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.860118:0:14486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050ddcf82/0xd8e438fb63522b41 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7db2 expref: 129 pid: 14499 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.860125:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f5:0x0].0x0 since=4s v=(0 0)
00010000:00010000:1.0:1789431560.860128:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f5:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.860132:0:14486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca98d896/0xd8e438fb63524e6b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.860155:0:14486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050ddcf82/0xd8e438fb63522b41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7db2 expref: 129 pid: 14499 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.860168:0:14486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050ddcf82/0xd8e438fb63522b41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7db2 expref: 129 pid: 14499 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.860180:0:14486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14486:1876351894199296:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431560.860222:0:14486:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3b40 going to sleep for 11 seconds
00000100:00100000:1.0:1789431560.860238:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8208
00000100:00100000:1.0:1789431560.860246:0:14491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+13:3311:x1876351894198272:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431560.860259:0:14491:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1266 count 1
00010000:00010000:1.0:1789431560.860271:0:14491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a74123e5/0xd8e438fb63524e72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.860290:0:14491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb635227c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7caf expref: 129 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.860297:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f2:0x0].0x0 since=4s v=(0 0)
00010000:00010000:1.0:1789431560.860300:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f2:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.860303:0:14491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a74123e5/0xd8e438fb63524e72 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.860323:0:14491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb635227c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7caf expref: 129 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.860541:0:14491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb635227c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7caf expref: 129 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.860553:0:14491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14491:1876351894199424:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431560.860581:0:14491:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3540 going to sleep for 11 seconds
00000100:00100000:0.0:1789431560.860896:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8209
00000100:00100000:0.0:1789431560.860910:0:14501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+13:3311:x1876351894198784:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431560.860927:0:14501:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1270 count 1
00010000:00010000:0.0:1789431560.860942:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a530aa6/0xd8e438fb63524e79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.860958:0:14501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000034e8b44c/0xd8e438fb63522c9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e14 expref: 129 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.860965:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f6:0x0].0x0 since=4s v=(0 0)
00010000:00010000:0.0:1789431560.860968:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f6:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.860972:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a530aa6/0xd8e438fb63524e79 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.860993:0:14501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000034e8b44c/0xd8e438fb63522c9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e14 expref: 129 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.861003:0:14501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000034e8b44c/0xd8e438fb63522c9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e14 expref: 129 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.861013:0:14501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14501:1876351894199552:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431560.861921:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8210
00000100:00100000:2.0:1789431560.861942:0:14505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+13:3313:x1876351894198400:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:2.0:1789431560.861969:0:14505:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1267 count 1
00010000:00010000:2.0:1789431560.861989:0:14505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63524e80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.862007:0:14505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000026ba4dc1/0xd8e438fb6352290a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d11 expref: 129 pid: 14471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.862015:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f3:0x0].0x0 since=4s v=(0 0)
00010000:00010000:2.0:1789431560.862019:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.862022:0:14505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63524e80 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.862063:0:14505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000026ba4dc1/0xd8e438fb6352290a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d11 expref: 129 pid: 14471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.862076:0:14505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000026ba4dc1/0xd8e438fb6352290a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d11 expref: 129 pid: 14471 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.862087:0:14505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a047b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:14505:1876351894199680:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.862411:0:14501:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c19c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431560.862447:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8211
00000100:00100000:0.0:1789431560.862458:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3313:x1876351894198912:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431560.862474:0:14469:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1271 count 1
00010000:00010000:0.0:1789431560.862492:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb63524e87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.862505:0:14469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e580c477/0xd8e438fb63522d4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e45 expref: 129 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.862512:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f7:0x0].0x0 since=3s v=(0 0)
00010000:00010000:0.0:1789431560.862515:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f7:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.862519:0:14469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb63524e87 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.862537:0:14469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e580c477/0xd8e438fb63522d4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e45 expref: 129 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.862547:0:14469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e580c477/0xd8e438fb63522d4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e45 expref: 129 pid: 14490 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.862556:0:14469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14469:1876351894199808:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431560.862964:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.863022:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.863243:0:14497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a045f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14497:1876351894197376:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431560.863271:0:14497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a3600127/0xd8e438fb63524e3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.863317:0:14471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a047800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14471:1876351894196992:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431560.863440:0:14471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000096242664/0xd8e438fb63524e25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.863470:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8212
00000100:00100000:3.0:1789431560.863483:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3313:x1876351894198528:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:3.0:1789431560.863508:0:8217:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1268 count 1
00010000:00010000:3.0:1789431560.863529:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524e8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.863544:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63522a06 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d57 expref: 129 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.863552:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f4:0x0].0x0 since=4s v=(0 0)
00010000:00010000:3.0:1789431560.863555:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f4:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431560.863559:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524e8e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.863591:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63522a06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d57 expref: 129 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.863604:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63522a06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d57 expref: 129 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.863617:0:8217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e829f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8217:1876351894199936:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431560.863771:0:8217:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2d449300 going to sleep for 11 seconds
00000100:00100000:3.0:1789431560.864111:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933422720
00000100:00100000:3.0:1789431560.864120:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933422720
00010000:00010000:3.0:1789431560.864157:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000006412014/0xd8e438fb63521d41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79a6 expref: 143 pid: 14491 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.864190:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933422848
00000100:00100000:3.0:1789431560.864193:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933422848
00010000:00010000:3.0:1789431560.864206:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2c7be19/0xd8e438fb63522934 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d1f expref: 144 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.864229:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16396
00000100:00100000:3.0:1789431560.864237:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+144:2350:x1876351933422720:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431560.864250:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431560.864256:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000006412014/0xd8e438fb63521d41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79a6 expref: 144 pid: 14491 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.864276:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000006412014/0xd8e438fb63521d41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79a6 expref: 144 pid: 14491 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.864301:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006412014/0xd8e438fb63521d41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79a6 expref: 144 pid: 14491 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.864317:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ed:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431560.864320:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ed:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431560.864327:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000096242664/0xd8e438fb63524e25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.864349:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096242664/0xd8e438fb63524e25 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.864381:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431560.864419:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+143:2350:x1876351933422720:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 182us (1456us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431560.864427:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16396
00010000:00010000:1.0:1789431560.864444:0:14471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000096242664/0xd8e438fb63524e25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.864451:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16397
00000100:00100000:3.0:1789431560.864462:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+142:2350:x1876351933422848:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431560.864463:0:14471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096242664/0xd8e438fb63524e25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.864474:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431560.864478:0:14471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096242664/0xd8e438fb63524e25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.864482:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2c7be19/0xd8e438fb63522934 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d1f expref: 142 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.864495:0:14471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096242664/0xd8e438fb63524e25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.864520:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2c7be19/0xd8e438fb63522934 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d1f expref: 142 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.864532:0:14471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431560.864536:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2c7be19/0xd8e438fb63522934 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d1f expref: 142 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.864548:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f4:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431560.864552:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f4:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431560.864556:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3600127/0xd8e438fb63524e3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.864565:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3600127/0xd8e438fb63524e3a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.864584:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431560.864605:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+141:2350:x1876351933422848:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 145us (1582us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431560.864612:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16397
00000100:00100000:3.0:1789431560.864653:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a044a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14468:1876351894197504:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431560.864680:0:14468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d8846b2/0xd8e438fb63524e41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.864703:0:14497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a3600127/0xd8e438fb63524e3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.864717:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3600127/0xd8e438fb63524e3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.864728:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3600127/0xd8e438fb63524e3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.864736:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3600127/0xd8e438fb63524e3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.864762:0:14497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:1.0:1789431560.864912:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3314:x1876351894195968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16432us (17065us total) trans 4294969584 rc 0/0
00000100:00100000:1.0:1789431560.864921:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8197
00010000:00010000:1.0:1789431560.864946:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1789431560.864954:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096242664/0xd8e438fb63524e25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.864968:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.864973:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096242664/0xd8e438fb63524e25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.864983:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096242664/0xd8e438fb63524e25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.864997:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096242664/0xd8e438fb63524e25 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.865004:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096242664/0xd8e438fb63524e25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.865035:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431560.865039:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3600127/0xd8e438fb63524e3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.865072:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.865077:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3600127/0xd8e438fb63524e3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.865084:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3600127/0xd8e438fb63524e3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.865096:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3600127/0xd8e438fb63524e3a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.865104:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3600127/0xd8e438fb63524e3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.865118:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.865120:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.865121:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:1.0:1789431560.865153:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba1b100/2, rc 0, transno 4294969584
00000100:00100000:1.0:1789431560.865169:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894195968:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431560.866283:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+14:3314:x1876351894196864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17196us (18250us total) trans 4294969585 rc 0/0
00000100:00100000:3.0:1789431560.866294:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8200
00000004:00080000:1.0:1789431560.866335:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba18700/2, rc 0, transno 4294969585
00000100:00100000:1.0:1789431560.866346:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894196864:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431560.866638:0:14505:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf08746d80 going to sleep for 11 seconds
00000100:00100000:2.0:1789431560.866690:0:14464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a045180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14464:1876351894197632:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431560.866717:0:14464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524e48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.866760:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a045c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:14499:1876351894197760:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431560.866772:0:14499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524e4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.866890:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1789431560.866907:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894200192:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431560.866921:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894200064:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431560.866961:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.866989:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894200192
00000100:00100000:1.0:1789431560.866997:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894200192
00000100:00100000:1.0:1789431560.867086:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8213
00000100:00100000:2.0:1789431560.867092:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.867102:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3312:x1876351894200192:12345-0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431560.867130:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894200064
00000100:00100000:2.0:1789431560.867136:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894200064
00002000:00080000:1.0:1789431560.867137:0:14471:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1270 count 1
00000100:00100000:2.0:1789431560.867168:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8214
00010000:00010000:1.0:1789431560.867169:0:14471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007327cee1/0xd8e438fb63524e95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.867180:0:14500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+15:3314:x1876351894200064:12345-0@lo:6:osp-syn-0-0.0
00010000:00010000:1.0:1789431560.867193:0:14471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007d812b8f/0xd8e438fb63522b6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7dc0 expref: 140 pid: 14502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00002000:00080000:2.0:1789431560.867195:0:14500:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1269 count 1
00010000:00010000:1.0:1789431560.867208:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f6:0x0].0x0 since=4s v=(0 0)
00010000:00010000:2.0:1789431560.867214:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c922d0dc/0xd8e438fb63524e9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.867215:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f6:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.867224:0:14471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007327cee1/0xd8e438fb63524e95 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.867235:0:14500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000744f6fb/0xd8e438fb63522a4c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d65 expref: 140 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.867244:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f5:0x0].0x0 since=4s v=(0 0)
00010000:00010000:2.0:1789431560.867248:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f5:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.867252:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c922d0dc/0xd8e438fb63524e9c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.867262:0:14471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007d812b8f/0xd8e438fb63522b6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7dc0 expref: 140 pid: 14502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.867278:0:14471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007d812b8f/0xd8e438fb63522b6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7dc0 expref: 140 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.867282:0:14500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000744f6fb/0xd8e438fb63522a4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d65 expref: 140 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.867302:0:14500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000744f6fb/0xd8e438fb63522a4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d65 expref: 140 pid: 14500 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.867308:0:14471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d508e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14471:1876351894200320:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431560.867324:0:14500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a046d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:14500:1876351894200448:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.867834:0:14469:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1c00 going to sleep for 11 seconds
00010000:00010000:0.0:1789431560.867865:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431560.870972:0:14500:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3e6d1e40 going to sleep for 11 seconds
00000100:00100000:0.0:1789431560.873232:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.873269:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.873360:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.873395:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933423104
00000100:00100000:0.0:1789431560.873407:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933423104
00010000:00010000:0.0:1789431560.873458:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb63521f7f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a55 expref: 141 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.873496:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933422976
00000100:00100000:0.0:1789431560.873500:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933422976
00010000:00010000:0.0:1789431560.873514:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d83003b2/0xd8e438fb635222b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b43 expref: 142 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.873532:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933423360
00000100:00100000:0.0:1789431560.873535:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933423360
00010000:00010000:0.0:1789431560.873549:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035363576/0xd8e438fb635224f7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7bdd expref: 130 pid: 14469 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.873570:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16398
00000100:00100000:0.0:1789431560.873582:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+142:2349:x1876351933423104:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431560.873600:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431560.873606:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb63521f7f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a55 expref: 142 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.873621:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb63521f7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a55 expref: 142 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.873651:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb63521f7f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a55 expref: 142 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.873684:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ee:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.873689:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ee:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.873696:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524e4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.873707:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524e4f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.873738:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431560.873803:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+141:2349:x1876351933423104:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 223us (584us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.873811:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16398
00000100:00100000:0.0:1789431560.873829:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16399
00000100:00100000:0.0:1789431560.873836:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+140:2349:x1876351933422976:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431560.873844:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431560.873849:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d83003b2/0xd8e438fb635222b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b43 expref: 140 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.873859:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d83003b2/0xd8e438fb635222b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b43 expref: 140 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.873872:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d83003b2/0xd8e438fb635222b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b43 expref: 140 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.873893:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ef:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.873896:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ef:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.873901:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d8846b2/0xd8e438fb63524e41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.873909:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d8846b2/0xd8e438fb63524e41 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.873928:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431560.873947:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+139:2349:x1876351933422976:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 111us (677us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.873953:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16399
00000100:00100000:0.0:1789431560.873966:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16400
00000100:00100000:0.0:1789431560.873973:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+130:2349:x1876351933423360:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431560.873981:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431560.873986:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035363576/0xd8e438fb635224f7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7bdd expref: 130 pid: 14469 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.873995:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035363576/0xd8e438fb635224f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7bdd expref: 130 pid: 14469 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874009:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f0:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.874012:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f0:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.874016:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000063a05555/0xd8e438fb63524e5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874025:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063a05555/0xd8e438fb63524e5d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874036:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431560.874076:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+130:2349:x1876351933423360:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 104us (715us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.874083:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16400
00010000:00010000:0.0:1789431560.874122:0:14468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d8846b2/0xd8e438fb63524e41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874132:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d8846b2/0xd8e438fb63524e41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874144:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d8846b2/0xd8e438fb63524e41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874153:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d8846b2/0xd8e438fb63524e41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874173:0:14468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431560.874476:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3312:x1876351894196224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25243us (26374us total) trans 4294969586 rc 0/0
00000100:00100000:0.0:1789431560.874485:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8201
00010000:00010000:0.0:1789431560.874510:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431560.874517:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d8846b2/0xd8e438fb63524e41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874526:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431560.874531:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d8846b2/0xd8e438fb63524e41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874543:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d8846b2/0xd8e438fb63524e41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874556:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d8846b2/0xd8e438fb63524e41 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874565:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d8846b2/0xd8e438fb63524e41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874585:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.874587:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.874588:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.874598:0:14499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524e4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874607:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524e4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874616:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524e4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874630:0:14499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524e4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874645:0:14499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431560.874777:0:14499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+16:3312:x1876351894196096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25287us (26584us total) trans 4294969587 rc 0/0
00000100:00100000:0.0:1789431560.874784:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8203
00010000:00010000:0.0:1789431560.874805:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431560.874811:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524e4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874818:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431560.874822:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524e4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874828:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524e4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874839:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524e4f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874845:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524e4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.874858:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.874861:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.874863:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:0.0:1789431560.874907:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba1a680/2, rc 0, transno 4294969587
00000100:00100000:0.0:1789431560.874921:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894196096:0@lo:6:osp-syn-0-0.0
00000004:00080000:0.0:1789431560.874935:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba19f80/2, rc 0, transno 4294969586
00000100:00100000:0.0:1789431560.874938:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894196224:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431560.875041:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894200576:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431560.875105:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431560.875148:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894200576
00000100:00100000:0.0:1789431560.875155:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894200576
00000100:00100000:0.0:1789431560.875186:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8215
00000100:00100000:0.0:1789431560.875193:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+16:3312:x1876351894200576:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431560.875220:0:14497:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1271 count 1
00010000:00010000:0.0:1789431560.875244:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63524ea3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.875262:0:14497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a3f3491/0xd8e438fb63522ca6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e1b expref: 138 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.875270:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f7:0x0].0x0 since=4s v=(0 0)
00010000:00010000:0.0:1789431560.875273:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f7:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.875278:0:14497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63524ea3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.875305:0:14497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002a3f3491/0xd8e438fb63522ca6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e1b expref: 138 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.875323:0:14497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002a3f3491/0xd8e438fb63522ca6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e1b expref: 138 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.875335:0:14497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14497:1876351894200832:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.875386:0:14497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1480 going to sleep for 11 seconds
00000100:00100000:0.0:1789431560.875413:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894200704:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431560.875442:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431560.875474:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894200704
00000100:00100000:0.0:1789431560.875479:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894200704
00000100:00100000:0.0:1789431560.875501:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8216
00000100:00100000:0.0:1789431560.875508:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3313:x1876351894200704:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431560.875521:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1272 count 1
00010000:00010000:0.0:1789431560.875534:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e67dd13f/0xd8e438fb63524eaa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.875547:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb63522df6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e76 expref: 138 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.875556:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f8:0x0].0x0 since=3s v=(0 0)
00010000:00010000:0.0:1789431560.875559:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f8:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.875564:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e67dd13f/0xd8e438fb63524eaa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.875568:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035363576/0xd8e438fb635224f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7bdd expref: 129 pid: 14469 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.875597:0:14472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b2c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14472:1876351894199040:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431560.875598:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb63522df6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e76 expref: 138 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.875613:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb63522df6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e76 expref: 138 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.875623:0:14472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000063a05555/0xd8e438fb63524e5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.875625:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1876351894200960:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431560.875640:0:14472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000063a05555/0xd8e438fb63524e5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.875649:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063a05555/0xd8e438fb63524e5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.875659:0:14472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063a05555/0xd8e438fb63524e5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.875662:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c13c0 going to sleep for 11 seconds
00010000:00010000:1.0:1789431560.875676:0:14472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063a05555/0xd8e438fb63524e5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.875692:0:14472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:1.0:1789431560.876450:0:14472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3313:x1876351894198016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19055us (23984us total) trans 4294969970 rc 0/0
00000100:00100000:1.0:1789431560.876462:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8205
00010000:00010000:1.0:1789431560.876597:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431560.876605:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063a05555/0xd8e438fb63524e5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.876617:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb18800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.876622:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063a05555/0xd8e438fb63524e5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.876632:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063a05555/0xd8e438fb63524e5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.876652:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063a05555/0xd8e438fb63524e5d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.876660:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063a05555/0xd8e438fb63524e5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.876682:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.876685:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.876687:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431560.876730:0:14471:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3f00 going to sleep for 11 seconds
00000100:00100000:1.0:1789431560.879689:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.880225:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a045500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1876351894197888:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431560.880265:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f6fc6983/0xd8e438fb63524e56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.880839:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.880895:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933423232
00000100:00100000:1.0:1789431560.880906:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933423232
00000100:00100000:0.0:1789431560.880942:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933423488
00000100:00100000:0.0:1789431560.880949:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933423488
00010000:00010000:1.0:1789431560.880961:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f4a0465/0xd8e438fb6352287e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ce7 expref: 140 pid: 6699 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.880975:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f25d5c2/0xd8e438fb6352270b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c77 expref: 140 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.881010:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16401
00000100:00100000:1.0:1789431560.881031:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb59c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+140:2349:x1876351933423232:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431560.881076:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431560.881085:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f4a0465/0xd8e438fb6352287e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ce7 expref: 140 pid: 6699 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.881099:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f4a0465/0xd8e438fb6352287e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ce7 expref: 140 pid: 6699 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.881129:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f4a0465/0xd8e438fb6352287e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ce7 expref: 140 pid: 6699 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.881153:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.881159:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.881167:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524e48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.881179:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524e48 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.881213:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431560.881263:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb59c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+139:2349:x1876351933423232:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 233us (1586us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431560.881271:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16401
00000100:00100000:1.0:1789431560.881323:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16402
00000100:00100000:1.0:1789431560.881341:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+138:2349:x1876351933423488:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431560.881348:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431560.881351:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f25d5c2/0xd8e438fb6352270b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c77 expref: 138 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.881359:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f25d5c2/0xd8e438fb6352270b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c77 expref: 138 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.881368:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f25d5c2/0xd8e438fb6352270b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c77 expref: 138 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.881376:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f2:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.881378:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f2:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.881381:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6fc6983/0xd8e438fb63524e56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.881386:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6fc6983/0xd8e438fb63524e56 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.881402:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431560.881416:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+137:2349:x1876351933423488:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 78us (582us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431560.881421:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16402
00010000:00010000:1.0:1789431560.881441:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f6fc6983/0xd8e438fb63524e56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.881450:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6fc6983/0xd8e438fb63524e56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.881462:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6fc6983/0xd8e438fb63524e56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.881471:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6fc6983/0xd8e438fb63524e56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.881489:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000004:00080000:0.0:1789431560.881498:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2e828a80/2, rc 0, transno 4294969970
00000100:00100000:0.0:1789431560.881514:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894198016:0@lo:6:osp-syn-1-0.0
00010000:00010000:0.0:1789431560.881533:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431560.881540:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6fc6983/0xd8e438fb63524e56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.881550:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce20f06a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431560.881555:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6fc6983/0xd8e438fb63524e56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.881566:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6fc6983/0xd8e438fb63524e56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.881580:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6fc6983/0xd8e438fb63524e56 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.881588:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6fc6983/0xd8e438fb63524e56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.881611:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.881614:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.881616:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431560.881685:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1789431560.881699:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894201088:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.881833:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3312:x1876351894196608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32212us (33591us total) trans 4294969588 rc 0/0
00000100:00100000:1.0:1789431560.881842:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8204
00010000:00010000:2.0:1789431560.883555:0:14464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524e48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.883577:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524e48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.883591:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524e48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.883607:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524e48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.883644:0:14464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1789431560.883962:0:14464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3312:x1876351894196736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 34595us (35819us total) trans 4294969589 rc 0/0
00000100:00100000:2.0:1789431560.883973:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8202
00000100:00100000:0.0:1789431560.884136:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000004:00080000:0.0:1789431560.884220:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba1bb80/2, rc 0, transno 4294969588
00000100:00100000:0.0:1789431560.884238:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894196608:0@lo:6:osp-syn-0-0.0
00000004:00080000:0.0:1789431560.884249:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba1b800/2, rc 0, transno 4294969589
00000100:00100000:0.0:1789431560.884253:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894196736:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431560.884349:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894201344:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431560.884393:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431560.884417:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1789431560.884423:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894201216:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431560.884443:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431560.884469:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894201088
00000100:00100000:0.0:1789431560.884476:0:14502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894201088
00000100:00100000:0.0:1789431560.884516:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894201344
00000100:00100000:0.0:1789431560.884519:0:14502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894201344
00000100:00100000:0.0:1789431560.884537:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894201216
00000100:00100000:0.0:1789431560.884540:0:14502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894201216
00000100:00100000:0.0:1789431560.884560:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8217
00000100:00100000:0.0:1789431560.884569:0:14502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+14:3313:x1876351894201088:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431560.884607:0:14502:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1272 count 1
00010000:00010000:0.0:1789431560.884639:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb63524eb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.884665:0:14502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005c365429/0xd8e438fb63522e20 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e84 expref: 128 pid: 14471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.884676:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f8:0x0].0x0 since=3s v=(0 0)
00010000:00010000:0.0:1789431560.884680:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f8:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.884686:0:14502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb63524eb1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.884717:0:14502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005c365429/0xd8e438fb63522e20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e84 expref: 128 pid: 14471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.884731:0:14502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005c365429/0xd8e438fb63522e20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e84 expref: 128 pid: 14471 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.884753:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:14502:1876351894201472:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.884822:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c10c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431560.884838:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8218
00000100:00100000:0.0:1789431560.884846:0:14464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3312:x1876351894201344:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431560.884859:0:14464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1274 count 1
00010000:00010000:0.0:1789431560.884876:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63524eb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.884894:0:14464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3a13eab/0xd8e438fb63523003 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f09 expref: 136 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.884902:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fa:0x0].0x0 since=3s v=(0 0)
00010000:00010000:0.0:1789431560.884905:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fa:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.884909:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63524eb8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.884930:0:14464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3a13eab/0xd8e438fb63523003 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f09 expref: 136 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.884940:0:14464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3a13eab/0xd8e438fb63523003 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f09 expref: 136 pid: 6700 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.884951:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14464:1876351894201600:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.884977:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1f00 going to sleep for 11 seconds
00000100:00100000:0.0:1789431560.884994:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8219
00000100:00100000:0.0:1789431560.885002:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3312:x1876351894201216:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431560.885014:0:14468:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1273 count 1
00010000:00010000:0.0:1789431560.885027:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e5af751/0xd8e438fb63524ebf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.885039:0:14468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63522f07 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ec3 expref: 136 pid: 14468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.885074:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f9:0x0].0x0 since=3s v=(0 0)
00010000:00010000:0.0:1789431560.885077:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f9:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.885081:0:14468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e5af751/0xd8e438fb63524ebf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.885100:0:14468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63522f07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ec3 expref: 136 pid: 14468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.885110:0:14468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63522f07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ec3 expref: 136 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.885121:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14468:1876351894201728:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.885148:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065ec00 going to sleep for 11 seconds
00010000:00010000:1.0:1789431560.885259:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431560.885268:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524e48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.885278:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.885284:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524e48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.885295:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524e48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.885318:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524e48 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.885326:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524e48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.885352:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.885354:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.885356:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431560.887916:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14482:1876351894199168:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431560.887957:0:14482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f8c51b6c/0xd8e438fb63524e64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.888129:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.888232:0:14491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14491:1876351894199424:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431560.888250:0:14491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a74123e5/0xd8e438fb63524e72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.889866:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933423616
00000100:00100000:0.0:1789431560.889884:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933423616
00010000:00010000:0.0:1789431560.889951:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb6352262b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c38 expref: 129 pid: 14499 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.890012:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16403
00000100:00100000:0.0:1789431560.890022:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+129:2349:x1876351933423616:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431560.890041:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431560.890062:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb6352262b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c38 expref: 129 pid: 14499 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.890075:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb6352262b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c38 expref: 129 pid: 14499 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.890103:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb6352262b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c38 expref: 129 pid: 14499 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.890123:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f1:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.890128:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f1:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.890134:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8c51b6c/0xd8e438fb63524e64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.890145:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8c51b6c/0xd8e438fb63524e64 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.890180:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431560.890266:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+128:2349:x1876351933423616:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 244us (2138us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.890273:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16403
00010000:00010000:1.0:1789431560.890471:0:14482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f8c51b6c/0xd8e438fb63524e64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.890483:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8c51b6c/0xd8e438fb63524e64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.890494:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8c51b6c/0xd8e438fb63524e64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.890501:0:14482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8c51b6c/0xd8e438fb63524e64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.890530:0:14482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:1.0:1789431560.890898:0:14482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3311:x1876351894198144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31855us (38345us total) trans 4294969971 rc 0/0
00000100:00100000:1.0:1789431560.890907:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8206
00010000:00010000:0.0:1789431560.890977:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431560.890986:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8c51b6c/0xd8e438fb63524e64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.890999:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf18a56200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431560.891004:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8c51b6c/0xd8e438fb63524e64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.891014:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8c51b6c/0xd8e438fb63524e64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.891030:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8c51b6c/0xd8e438fb63524e64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.891038:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8c51b6c/0xd8e438fb63524e64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.891090:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.891092:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.891093:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:2.0:1789431560.891457:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2e82bb80/2, rc 0, transno 4294969971
00000100:00100000:2.0:1789431560.891481:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894198144:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.891623:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1789431560.891641:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894201856:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.891691:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431560.892018:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894201856
00000100:00100000:0.0:1789431560.892027:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894201856
00000100:00100000:0.0:1789431560.892147:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8220
00000100:00100000:0.0:1789431560.892158:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3314:x1876351894201856:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431560.892190:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1273 count 1
00010000:00010000:0.0:1789431560.892220:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038ba2529/0xd8e438fb63524ec6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.892245:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000014acd8f5/0xd8e438fb63522f31 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ed1 expref: 127 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.892260:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f9:0x0].0x0 since=3s v=(0 0)
00010000:00010000:0.0:1789431560.892265:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f9:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.892270:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038ba2529/0xd8e438fb63524ec6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.892301:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000014acd8f5/0xd8e438fb63522f31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ed1 expref: 127 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.892315:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000014acd8f5/0xd8e438fb63522f31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ed1 expref: 127 pid: 6698 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.892330:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1876351894201984:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.892406:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e180 going to sleep for 11 seconds
00000100:00100000:3.0:1789431560.895697:0:8217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e829f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8217:1876351894199936:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431560.895736:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524e8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.896091:0:14501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14501:1876351894199552:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431560.896112:0:14501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008a530aa6/0xd8e438fb63524e79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.897560:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.898847:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933423872
00000100:00100000:1.0:1789431560.898864:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933423872
00010000:00010000:1.0:1789431560.898928:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63522a06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d57 expref: 128 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.898991:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16404
00000100:00100000:1.0:1789431560.899003:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e829f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+128:2349:x1876351933423872:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431560.899024:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431560.899032:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63522a06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d57 expref: 128 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.899082:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63522a06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d57 expref: 128 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.899112:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63522a06 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d57 expref: 128 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.899140:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f4:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.899145:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f4:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.899153:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.899164:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524e8e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.899199:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431560.899272:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e829f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+127:2349:x1876351933423872:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 270us (1723us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431560.899280:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16404
00010000:00010000:1.0:1789431560.899313:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.899322:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.899333:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.899341:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524e8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.899359:0:8217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431560.899378:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431560.899384:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524e8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.899393:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.899397:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524e8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.899407:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524e8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.899418:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524e8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.899425:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524e8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.899449:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.899451:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.899452:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431560.899776:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3313:x1876351894198528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36296us (39868us total) trans 4294969972 rc 0/0
00000100:00100000:1.0:1789431560.899785:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8212
00000100:00100000:2.0:1789431560.899899:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a045880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1876351894197248:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431560.899928:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f6f93f9d/0xd8e438fb63524e33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00080000:2.0:1789431560.899970:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2e829880/2, rc 0, transno 4294969972
00000100:00100000:2.0:1789431560.899986:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894198528:0@lo:6:osp-syn-1-0.0
00000100:00100000:2.0:1789431560.900091:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1789431560.900106:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a045880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894202112:0@lo:6:osp-syn-1-0.0
00000100:00100000:2.0:1789431560.900150:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431560.900186:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894202112
00000100:00100000:2.0:1789431560.900193:0:14499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894202112
00000100:00100000:2.0:1789431560.900222:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8221
00000100:00100000:2.0:1789431560.900231:0:14499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+16:3313:x1876351894202112:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:2.0:1789431560.900259:0:14499:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1274 count 1
00010000:00010000:2.0:1789431560.900283:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb63524ecd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.900300:0:14499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e2f9273/0xd8e438fb63523073 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f1e expref: 126 pid: 14499 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.900310:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fa:0x0].0x0 since=3s v=(0 0)
00010000:00010000:2.0:1789431560.900313:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fa:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.900317:0:14499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb63524ecd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.900344:0:14499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e2f9273/0xd8e438fb63523073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f1e expref: 126 pid: 14499 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.900358:0:14499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e2f9273/0xd8e438fb63523073 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f1e expref: 126 pid: 14499 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.900372:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a044e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:14499:1876351894202240:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431560.900424:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3e6d1240 going to sleep for 11 seconds
00000100:00100000:3.0:1789431560.903199:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.903270:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.903317:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.903354:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933424128
00000100:00100000:3.0:1789431560.903364:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933424128
00000100:00100000:3.0:1789431560.903424:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12428
00000100:00100000:3.0:1789431560.903437:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+258:14616:x1876351933424128:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431560.904525:0:14490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a047100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:14490:1876351894197120:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431560.904564:0:14490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524e2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.904598:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933423744
00000100:00100000:0.0:1789431560.904604:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933423744
00010000:00010000:0.0:1789431560.904637:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb635227c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7caf expref: 127 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.904661:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933424000
00000100:00100000:0.0:1789431560.904664:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933424000
00010000:00010000:0.0:1789431560.904677:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000034e8b44c/0xd8e438fb63522c9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e14 expref: 128 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.904702:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16405
00000100:00100000:0.0:1789431560.904710:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+128:2349:x1876351933423744:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431560.904724:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431560.904730:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb635227c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7caf expref: 128 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.904751:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb635227c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7caf expref: 128 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.904783:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb635227c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7caf expref: 128 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.904804:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f2:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.904809:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f2:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.904816:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a74123e5/0xd8e438fb63524e72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.904827:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a74123e5/0xd8e438fb63524e72 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.904859:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431560.904902:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+127:2349:x1876351933423744:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 192us (1720us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.904910:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16405
00000100:00100000:0.0:1789431560.904929:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16406
00000100:00100000:0.0:1789431560.904935:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+126:2349:x1876351933424000:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431560.904943:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431560.904948:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000034e8b44c/0xd8e438fb63522c9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e14 expref: 126 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.904959:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000034e8b44c/0xd8e438fb63522c9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e14 expref: 126 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.904972:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034e8b44c/0xd8e438fb63522c9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e14 expref: 126 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.904983:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f6:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.904986:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f6:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.904990:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a530aa6/0xd8e438fb63524e79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.904998:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a530aa6/0xd8e438fb63524e79 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905020:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431560.905039:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+125:2349:x1876351933424000:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 104us (1769us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.905046:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16406
00010000:00010000:0.0:1789431560.905100:0:14501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008a530aa6/0xd8e438fb63524e79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905109:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a530aa6/0xd8e438fb63524e79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905121:0:14501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a530aa6/0xd8e438fb63524e79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905129:0:14501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a530aa6/0xd8e438fb63524e79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905147:0:14501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431560.905471:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+17:3311:x1876351894198784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 44565us (45691us total) trans 4294969973 rc 0/0
00000100:00100000:0.0:1789431560.905481:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8209
00010000:00010000:0.0:1789431560.905508:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431560.905515:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a530aa6/0xd8e438fb63524e79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905525:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431560.905531:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a530aa6/0xd8e438fb63524e79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905543:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a530aa6/0xd8e438fb63524e79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905558:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a530aa6/0xd8e438fb63524e79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905566:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a530aa6/0xd8e438fb63524e79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905587:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.905590:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.905592:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.905604:0:14491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a74123e5/0xd8e438fb63524e72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905613:0:14491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a74123e5/0xd8e438fb63524e72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905621:0:14491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a74123e5/0xd8e438fb63524e72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905628:0:14491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a74123e5/0xd8e438fb63524e72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905649:0:14491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431560.905790:0:14491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+17:3311:x1876351894198272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 45545us (46057us total) trans 4294969974 rc 0/0
00000100:00100000:0.0:1789431560.905798:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8208
00010000:00010000:0.0:1789431560.905818:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431560.905824:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a74123e5/0xd8e438fb63524e72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905831:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb18600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431560.905835:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a74123e5/0xd8e438fb63524e72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905843:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a74123e5/0xd8e438fb63524e72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905855:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a74123e5/0xd8e438fb63524e72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905862:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a74123e5/0xd8e438fb63524e72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.905877:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.905879:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.905881:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:0.0:1789431560.905922:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2e829c00/2, rc 0, transno 4294969974
00000100:00100000:0.0:1789431560.905939:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894198272:0@lo:6:osp-syn-1-0.0
00000004:00080000:0.0:1789431560.905953:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2e82b480/2, rc 0, transno 4294969973
00000100:00100000:0.0:1789431560.905957:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894198784:0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431560.906090:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894202496:0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431560.906134:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431560.906173:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1789431560.906179:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894202368:0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431560.906199:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431560.906231:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894202496
00000100:00100000:0.0:1789431560.906237:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894202496
00000100:00100000:0.0:1789431560.906271:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894202368
00000100:00100000:0.0:1789431560.906274:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894202368
00000100:00100000:0.0:1789431560.906292:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8222
00000100:00100000:0.0:1789431560.906299:0:14482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3312:x1876351894202496:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431560.906331:0:14482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1276 count 1
00010000:00010000:0.0:1789431560.906357:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ed4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.906377:0:14482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb63523336 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ff0 expref: 124 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.906387:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fc:0x0].0x0 since=3s v=(0 0)
00010000:00010000:0.0:1789431560.906390:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fc:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.906395:0:14482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ed4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.906423:0:14482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb63523336 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ff0 expref: 124 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.906436:0:14482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb63523336 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ff0 expref: 124 pid: 14490 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.906448:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14482:1876351894202624:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.906503:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c19c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431560.906519:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8223
00000100:00100000:0.0:1789431560.906526:0:14501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+18:3312:x1876351894202368:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431560.906539:0:14501:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1275 count 1
00010000:00010000:0.0:1789431560.906550:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7a32057/0xd8e438fb63524edb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4fb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.906562:0:14501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d92e4ee/0xd8e438fb635231bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f87 expref: 124 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.906569:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fb:0x0].0x0 since=3s v=(0 0)
00010000:00010000:0.0:1789431560.906572:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fb:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.906576:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7a32057/0xd8e438fb63524edb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.906596:0:14501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d92e4ee/0xd8e438fb635231bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f87 expref: 124 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.906605:0:14501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d92e4ee/0xd8e438fb635231bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f87 expref: 124 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.906619:0:14501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14501:1876351894202752:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.906643:0:14501:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1180 going to sleep for 11 seconds
00000100:00100000:1.0:1789431560.909351:0:14486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14486:1876351894199296:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431560.909396:0:14486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ca98d896/0xd8e438fb63524e6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.912901:0:14505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a047b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:14505:1876351894199680:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431560.912945:0:14505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63524e80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.915958:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.916152:0:14469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14469:1876351894199808:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431560.916190:0:14469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb63524e87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.916348:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.916382:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.916403:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.916419:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.916441:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.916460:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.916519:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.916532:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.916545:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.916595:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.916608:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.916619:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431560.916719:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933425024
00000100:00100000:3.0:1789431560.916728:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933425024
00000100:00100000:2.0:1789431560.916912:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933424256
00000100:00100000:2.0:1789431560.916918:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933424256
00010000:00010000:2.0:1789431560.916963:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ab51f7/0xd8e438fb63522624 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c3f expref: 137 pid: 14500 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.916991:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933424512
00000100:00100000:2.0:1789431560.916994:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933424512
00010000:00010000:2.0:1789431560.917009:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050ddcf82/0xd8e438fb63522b41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7db2 expref: 125 pid: 14499 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.917022:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933424384
00000100:00100000:2.0:1789431560.917025:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933424384
00010000:00010000:2.0:1789431560.917036:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a626b0b0/0xd8e438fb635223d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b89 expref: 138 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.917073:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933424896
00000100:00100000:2.0:1789431560.917076:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933424896
00010000:00010000:2.0:1789431560.917090:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000744f6fb/0xd8e438fb63522a4c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d65 expref: 139 pid: 14500 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.917101:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933424640
00000100:00100000:2.0:1789431560.917103:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933424640
00010000:00010000:2.0:1789431560.917116:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000026ba4dc1/0xd8e438fb6352290a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d11 expref: 126 pid: 14471 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.917127:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933424768
00000100:00100000:2.0:1789431560.917130:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933424768
00010000:00010000:2.0:1789431560.917141:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e580c477/0xd8e438fb63522d4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e45 expref: 127 pid: 14490 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.917152:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933425408
00000100:00100000:2.0:1789431560.917155:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933425408
00010000:00010000:2.0:1789431560.917167:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb63522df6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e76 expref: 140 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.917178:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933425152
00000100:00100000:2.0:1789431560.917180:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933425152
00010000:00010000:2.0:1789431560.917192:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002a3f3491/0xd8e438fb63522ca6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e1b expref: 141 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.917202:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933425280
00000100:00100000:2.0:1789431560.917204:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933425280
00010000:00010000:2.0:1789431560.917219:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007d812b8f/0xd8e438fb63522b6b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7dc0 expref: 142 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.917230:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933425536
00000100:00100000:2.0:1789431560.917232:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933425536
00010000:00010000:2.0:1789431560.917245:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005c365429/0xd8e438fb63522e20 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e84 expref: 128 pid: 14471 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.917255:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933425664
00000100:00100000:2.0:1789431560.917258:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933425664
00010000:00010000:2.0:1789431560.917269:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a13eab/0xd8e438fb63523003 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f09 expref: 143 pid: 6700 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.918613:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12429
00000100:00100000:3.0:1789431560.918632:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+260:14617:x1876351933425024:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:2.0:1789431560.919416:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933425792
00000100:00100000:2.0:1789431560.919424:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933425792
00010000:00010000:2.0:1789431560.919457:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63522f07 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ec3 expref: 144 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.919475:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16407
00000100:00100000:2.0:1789431560.919483:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+144:2348:x1876351933424256:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431560.919500:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431560.919507:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a4ab51f7/0xd8e438fb63522624 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c3f expref: 144 pid: 14500 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.919523:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a4ab51f7/0xd8e438fb63522624 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c3f expref: 144 pid: 14500 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.919548:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4ab51f7/0xd8e438fb63522624 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7c3f expref: 144 pid: 14500 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.919568:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f1:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.919572:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f1:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.919578:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524e2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.919588:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524e2c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.919628:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431560.919702:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+143:2348:x1876351933424256:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 221us (3759us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.919710:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16407
00000100:00100000:2.0:1789431560.919733:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16408
00000100:00100000:2.0:1789431560.919741:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+128:2348:x1876351933424512:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431560.919761:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431560.919768:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050ddcf82/0xd8e438fb63522b41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7db2 expref: 128 pid: 14499 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.919780:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050ddcf82/0xd8e438fb63522b41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7db2 expref: 128 pid: 14499 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.919796:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050ddcf82/0xd8e438fb63522b41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7db2 expref: 128 pid: 14499 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.919807:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f5:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.919810:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f5:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.919814:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca98d896/0xd8e438fb63524e6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.919822:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca98d896/0xd8e438fb63524e6b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.919854:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431560.919873:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+127:2348:x1876351933424512:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 134us (3525us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.919880:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16408
00000100:00100000:2.0:1789431560.919929:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16409
00000100:00100000:2.0:1789431560.919937:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+142:2348:x1876351933424384:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431560.919946:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431560.919952:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a626b0b0/0xd8e438fb635223d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b89 expref: 142 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.919962:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a626b0b0/0xd8e438fb635223d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b89 expref: 142 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.919976:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a626b0b0/0xd8e438fb635223d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b89 expref: 142 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.919988:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f0:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.919991:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f0:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.919995:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6f93f9d/0xd8e438fb63524e33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.920003:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f93f9d/0xd8e438fb63524e33 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.920028:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431560.920079:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+141:2348:x1876351933424384:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 111us (3664us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.920085:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16409
00000100:00100000:2.0:1789431560.920100:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16410
00000100:00100000:2.0:1789431560.920108:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+140:2348:x1876351933424896:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431560.920115:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431560.920121:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000744f6fb/0xd8e438fb63522a4c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d65 expref: 140 pid: 14500 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.920130:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000744f6fb/0xd8e438fb63522a4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d65 expref: 140 pid: 14500 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.920142:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f5:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.920145:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f5:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.920150:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c922d0dc/0xd8e438fb63524e9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.920158:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c922d0dc/0xd8e438fb63524e9c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.920170:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431560.920188:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+140:2348:x1876351933424896:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 81us (3784us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.920198:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16410
00000100:00100000:2.0:1789431560.920212:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16411
00000100:00100000:2.0:1789431560.920219:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+126:2349:x1876351933424640:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431560.920227:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431560.920233:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000026ba4dc1/0xd8e438fb6352290a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d11 expref: 126 pid: 14471 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.920244:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000026ba4dc1/0xd8e438fb6352290a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d11 expref: 126 pid: 14471 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.920256:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026ba4dc1/0xd8e438fb6352290a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d11 expref: 126 pid: 14471 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.920265:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.920268:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.920272:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63524e80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.920433:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16412
00000100:00100000:0.0:1789431560.920444:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+125:2349:x1876351933424768:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431560.920454:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431560.920460:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e580c477/0xd8e438fb63522d4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e45 expref: 125 pid: 14490 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920469:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e580c477/0xd8e438fb63522d4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e45 expref: 125 pid: 14490 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920483:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e580c477/0xd8e438fb63522d4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e45 expref: 125 pid: 14490 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920495:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f7:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.920498:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f7:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.920502:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb63524e87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920515:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb63524e87 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920535:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431560.920559:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+124:2349:x1876351933424768:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 118us (4097us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.920564:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16412
00000100:00100000:0.0:1789431560.920581:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16413
00000100:00100000:0.0:1789431560.920588:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+139:2349:x1876351933425408:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431560.920596:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431560.920602:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb63522df6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e76 expref: 139 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920612:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb63522df6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e76 expref: 139 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920625:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f8:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.920628:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f8:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.920632:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e67dd13f/0xd8e438fb63524eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920640:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e67dd13f/0xd8e438fb63524eaa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920654:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431560.920671:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+139:2349:x1876351933425408:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 84us (4152us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.920676:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16413
00000100:00100000:0.0:1789431560.920688:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16414
00000100:00100000:0.0:1789431560.920695:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+138:2349:x1876351933425152:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431560.920704:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431560.920709:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002a3f3491/0xd8e438fb63522ca6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e1b expref: 138 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920718:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002a3f3491/0xd8e438fb63522ca6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e1b expref: 138 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920728:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f7:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.920731:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f7:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.920735:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63524ea3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920754:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63524ea3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920766:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431560.920780:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+138:2349:x1876351933425152:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 86us (4247us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.920790:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16414
00000100:00100000:0.0:1789431560.920804:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16415
00000100:00100000:0.0:1789431560.920811:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb59050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+137:2347:x1876351933425280:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431560.920818:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431560.920824:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007d812b8f/0xd8e438fb63522b6b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7dc0 expref: 137 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920833:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007d812b8f/0xd8e438fb63522b6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7dc0 expref: 137 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920845:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f6:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.920847:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f6:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.920851:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007327cee1/0xd8e438fb63524e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920858:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007327cee1/0xd8e438fb63524e95 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920868:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431560.920884:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb59050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+137:2347:x1876351933425280:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 74us (4338us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.920891:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16415
00000100:00100000:0.0:1789431560.920904:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16416
00000100:00100000:0.0:1789431560.920912:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+123:2347:x1876351933425536:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431560.920923:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431560.920928:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005c365429/0xd8e438fb63522e20 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e84 expref: 123 pid: 14471 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920939:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005c365429/0xd8e438fb63522e20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e84 expref: 123 pid: 14471 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920950:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f8:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.920953:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f8:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.920957:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb63524eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920965:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb63524eb1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.920977:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431560.920991:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+123:2347:x1876351933425536:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 80us (4396us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.920996:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16416
00000100:00100000:0.0:1789431560.921011:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16417
00000100:00100000:0.0:1789431560.921018:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+136:2350:x1876351933425664:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431560.921025:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431560.921031:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3a13eab/0xd8e438fb63523003 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f09 expref: 136 pid: 6700 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.921079:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3a13eab/0xd8e438fb63523003 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f09 expref: 136 pid: 6700 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.921093:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fa:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.921096:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fa:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.921100:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63524eb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.921108:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63524eb8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.921120:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431560.921133:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+136:2350:x1876351933425664:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 116us (4524us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.921139:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16417
00000100:00100000:0.0:1789431560.921153:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16418
00000100:00100000:0.0:1789431560.921160:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+135:2348:x1876351933425792:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431560.921168:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431560.921173:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63522f07 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ec3 expref: 135 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.921183:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63522f07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ec3 expref: 135 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.921200:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f9:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.921203:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f9:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.921207:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008e5af751/0xd8e438fb63524ebf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.921216:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e5af751/0xd8e438fb63524ebf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.921227:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431560.921239:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+135:2348:x1876351933425792:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 80us (4619us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.921245:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16418
00010000:00010000:0.0:1789431560.921387:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c365429/0xd8e438fb63522e20 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e84 expref: 122 pid: 14471 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.921401:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:14502:1876351894201472:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431560.921427:0:14502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb63524eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.921438:0:14502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb63524eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.921446:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb63524eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.921463:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb63524eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.921472:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb63524eb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.921494:0:14502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431560.921850:0:14502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+19:3313:x1876351894201088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 37280us (37713us total) trans 4294969975 rc 0/0
00010000:00010000:2.0:1789431560.921913:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63524e80 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.921937:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431560.921957:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+121:2349:x1876351933424640:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1738us (5536us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.921964:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16411
00010000:00010000:2.0:1789431560.922016:0:14505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63524e80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.922025:0:14505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63524e80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.922034:0:14505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63524e80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.922041:0:14505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63524e80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.922073:0:14505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:2.0:1789431560.922215:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+20:3313:x1876351894198400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 60281us (62384us total) trans 4294969976 rc 0/0
00000100:00100000:2.0:1789431560.922224:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8210
00000100:00100000:2.0:1789431560.922261:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a044e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:14499:1876351894202240:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.924353:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8217
00010000:00010000:0.0:1789431560.924407:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:0.0:1789431560.924418:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb63524eb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.924433:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431560.924440:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb63524eb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.924452:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb63524eb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.924478:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb63524eb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.924487:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb63524eb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.924496:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000744f6fb/0xd8e438fb63522a4c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7d65 expref: 134 pid: 14500 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.924517:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00000100:00100000:1.0:1789431560.924517:0:14500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a046d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:14500:1876351894200448:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431560.924525:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63524e80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.924533:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce20f06c00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431560.924536:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63524e80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.924544:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63524e80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.924549:0:14500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c922d0dc/0xd8e438fb63524e9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.924559:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63524e80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.924568:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63524e80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.924577:0:14486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ca98d896/0xd8e438fb63524e6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.924582:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.924585:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.924588:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.924591:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca98d896/0xd8e438fb63524e6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.924610:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca98d896/0xd8e438fb63524e6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.924621:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca98d896/0xd8e438fb63524e6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.924622:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb63522df6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e76 expref: 133 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.924646:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1876351894200960:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431560.924662:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e67dd13f/0xd8e438fb63524eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.924667:0:14486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431560.924675:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e67dd13f/0xd8e438fb63524eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.924684:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e67dd13f/0xd8e438fb63524eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.924693:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e67dd13f/0xd8e438fb63524eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.924701:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e67dd13f/0xd8e438fb63524eaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.924718:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:2.0:1789431560.925062:0:14499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb63524ecd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.925089:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f6f93f9d/0xd8e438fb63524e33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.925098:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6f93f9d/0xd8e438fb63524e33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.925116:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6f93f9d/0xd8e438fb63524e33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.925123:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f93f9d/0xd8e438fb63524e33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.925139:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool
00000100:00100000:0.0:1789431560.925481:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3313:x1876351894200704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49970us (50034us total) trans 4294969590 rc 0/0
00000100:00100000:1.0:1789431560.925489:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3311:x1876351894198656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 65436us (65832us total) trans 4294969977 rc 0/0
00000100:00100000:0.0:1789431560.925495:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8216
00000100:00100000:1.0:1789431560.925504:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8207
00010000:00010000:0.0:1789431560.925524:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp.  (2 blwis in pool)
00010000:00010000:0.0:1789431560.925531:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca98d896/0xd8e438fb63524e6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925540:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.925542:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:0.0:1789431560.925544:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca98d896/0xd8e438fb63524e6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.925551:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e67dd13f/0xd8e438fb63524eaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925556:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca98d896/0xd8e438fb63524e6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.925570:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308e00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.925576:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e67dd13f/0xd8e438fb63524eaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925579:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca98d896/0xd8e438fb63524e6b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925587:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca98d896/0xd8e438fb63524e6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925604:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431560.925608:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6f93f9d/0xd8e438fb63524e33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925615:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431560.925618:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6f93f9d/0xd8e438fb63524e33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925625:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6f93f9d/0xd8e438fb63524e33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925634:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6f93f9d/0xd8e438fb63524e33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925640:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6f93f9d/0xd8e438fb63524e33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925653:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.925655:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.925657:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.925664:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.925676:0:14469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb63524e87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925685:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb63524e87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925694:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb63524e87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925701:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb63524e87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925714:0:14469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431560.925852:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3313:x1876351894198912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 63397us (65987us total) trans 4294969978 rc 0/0
00000100:00100000:0.0:1789431560.925859:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8211
00010000:00010000:0.0:1789431560.925875:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431560.925879:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb63524e87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925886:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce27814e00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431560.925890:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb63524e87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925898:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb63524e87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925909:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb63524e87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925917:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb63524e87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925930:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.925932:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.925934:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.925962:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3a13eab/0xd8e438fb63523003 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f09 expref: 132 pid: 6700 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.925972:0:14464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14464:1876351894201600:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431560.925988:0:14464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63524eb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.925997:0:14464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63524eb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.926004:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63524eb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.926012:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63524eb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.926025:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63524eb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.926038:0:14464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431560.926190:0:14464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3312:x1876351894201344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 41345us (41796us total) trans 4294969592 rc 0/0
00000100:00100000:0.0:1789431560.926196:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8218
00010000:00010000:0.0:1789431560.926210:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431560.926215:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63524eb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.926223:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf18a56400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431560.926226:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63524eb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.926234:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63524eb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.926244:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63524eb8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.926252:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb63524eb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.926266:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.926268:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.926270:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.926551:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e67dd13f/0xd8e438fb63524eaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.926565:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e67dd13f/0xd8e438fb63524eaa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.926573:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e67dd13f/0xd8e438fb63524eaa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.926604:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.926606:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.926609:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.926659:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d812b8f/0xd8e438fb63522b6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7dc0 expref: 131 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.926671:0:14471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d508e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14471:1876351894200320:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431560.926689:0:14471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007327cee1/0xd8e438fb63524e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.926698:0:14471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007327cee1/0xd8e438fb63524e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.926705:0:14471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007327cee1/0xd8e438fb63524e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.926714:0:14471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007327cee1/0xd8e438fb63524e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.926722:0:14471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007327cee1/0xd8e438fb63524e95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.926782:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63522f07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ec3 expref: 130 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.926795:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14468:1876351894201728:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431560.926809:0:14468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008e5af751/0xd8e438fb63524ebf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.926817:0:14468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008e5af751/0xd8e438fb63524ebf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.926824:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e5af751/0xd8e438fb63524ebf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.926832:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e5af751/0xd8e438fb63524ebf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.926840:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e5af751/0xd8e438fb63524ebf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.926888:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3314:x1876351894196352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 77977us (78894us total) trans 4294969591 rc 0/0
00000100:00100000:2.0:1789431560.926897:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8199
00010000:00010000:1.0:1789431560.926901:0:14471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000004:00080000:2.0:1789431560.926948:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba19180/2, rc 0, transno 4294969591
00000100:00100000:2.0:1789431560.926961:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894196352:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431560.927127:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3312:x1876351894200192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 60028us (60166us total) trans 4294969593 rc 0/0
00000100:00100000:1.0:1789431560.927135:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8213
00000100:00100000:2.0:1789431560.927150:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.927233:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431560.927273:0:14500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c922d0dc/0xd8e438fb63524e9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.927285:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c922d0dc/0xd8e438fb63524e9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.927295:0:14500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c922d0dc/0xd8e438fb63524e9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.927304:0:14500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c922d0dc/0xd8e438fb63524e9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.927332:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.927385:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.927544:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933425920
00000100:00100000:2.0:1789431560.927552:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933425920
00010000:00010000:2.0:1789431560.927587:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000014acd8f5/0xd8e438fb63522f31 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ed1 expref: 121 pid: 6698 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.927610:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933426048
00000100:00100000:2.0:1789431560.927612:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933426048
00010000:00010000:2.0:1789431560.927622:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e2f9273/0xd8e438fb63523073 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f1e expref: 122 pid: 14499 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.927643:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933426304
00000100:00100000:2.0:1789431560.927645:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933426304
00010000:00010000:2.0:1789431560.927654:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d92e4ee/0xd8e438fb635231bc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f87 expref: 123 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.927668:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933426176
00000100:00100000:2.0:1789431560.927670:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933426176
00010000:00010000:2.0:1789431560.927679:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb63523336 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ff0 expref: 124 pid: 14490 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.927692:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16419
00000100:00100000:2.0:1789431560.927700:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+124:2348:x1876351933425920:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431560.927714:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431560.927720:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000014acd8f5/0xd8e438fb63522f31 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ed1 expref: 124 pid: 6698 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.927732:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000014acd8f5/0xd8e438fb63522f31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ed1 expref: 124 pid: 6698 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.927764:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f9:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.927769:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f9:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.927775:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000038ba2529/0xd8e438fb63524ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.927786:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038ba2529/0xd8e438fb63524ec6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.927807:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431560.927833:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+124:2348:x1876351933425920:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 133us (685us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.927839:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16419
00000100:00100000:2.0:1789431560.927852:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16420
00000100:00100000:2.0:1789431560.927857:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+123:2347:x1876351933426048:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431560.927864:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431560.927874:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e2f9273/0xd8e438fb63523073 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f1e expref: 123 pid: 14499 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.927886:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e2f9273/0xd8e438fb63523073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f1e expref: 123 pid: 14499 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.927899:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e2f9273/0xd8e438fb63523073 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f1e expref: 123 pid: 14499 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.927911:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fa:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.927914:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fa:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.927918:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb63524ecd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.927926:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb63524ecd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.927946:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431560.927960:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+122:2347:x1876351933426048:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 103us (726us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.927966:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16420
00000100:00100000:2.0:1789431560.927977:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16421
00000100:00100000:2.0:1789431560.927983:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a046a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+121:2348:x1876351933426304:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431560.927989:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431560.927994:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d92e4ee/0xd8e438fb635231bc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f87 expref: 121 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.928004:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d92e4ee/0xd8e438fb635231bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f87 expref: 121 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.928014:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fb:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.928017:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fb:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.928021:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7a32057/0xd8e438fb63524edb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.928029:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7a32057/0xd8e438fb63524edb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.928038:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431560.928077:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a046a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+121:2348:x1876351933426304:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 94us (745us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.928085:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16421
00000100:00100000:2.0:1789431560.928097:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16422
00000100:00100000:2.0:1789431560.928102:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e955050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+120:2348:x1876351933426176:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431560.928109:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431560.928113:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb63523336 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ff0 expref: 120 pid: 14490 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.928123:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb63523336 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ff0 expref: 120 pid: 14490 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.928135:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fc:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.928137:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fc:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.928142:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ed4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.928150:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ed4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.928159:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431560.928172:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e955050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+120:2348:x1876351933426176:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 71us (787us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.928178:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16422
00010000:00010000:2.0:1789431560.928246:0:14499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb63524ecd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.928261:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb63524ecd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.928270:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb63524ecd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.928278:0:14499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb63524ecd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.929660:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+260:14616:x1876351933424128:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 26212us (26326us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431560.929677:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12428
00010000:00010000:2.0:1789431560.931513:0:14499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool
00000100:00100000:2.0:1789431560.931930:0:14499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+19:3313:x1876351894202112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31695us (31774us total) trans 4294969979 rc 0/0
00000100:00100000:2.0:1789431560.931942:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8221
00010000:00010000:1.0:1789431560.932311:0:14500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool
00010000:00010000:1.0:1789431560.932333:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp.  (3 blwis in pool)
00010000:00010000:1.0:1789431560.932343:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007327cee1/0xd8e438fb63524e95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932358:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f77c00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.932366:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007327cee1/0xd8e438fb63524e95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932379:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007327cee1/0xd8e438fb63524e95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932406:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007327cee1/0xd8e438fb63524e95 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932414:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007327cee1/0xd8e438fb63524e95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932441:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp.  (2 blwis in pool)
00010000:00010000:1.0:1789431560.932445:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e5af751/0xd8e438fb63524ebf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932452:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f894a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.932455:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e5af751/0xd8e438fb63524ebf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932468:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e5af751/0xd8e438fb63524ebf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932477:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e5af751/0xd8e438fb63524ebf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932484:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1789431560.932488:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c922d0dc/0xd8e438fb63524e9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932495:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce20f06e00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.932503:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c922d0dc/0xd8e438fb63524e9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932512:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c922d0dc/0xd8e438fb63524e9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932522:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c922d0dc/0xd8e438fb63524e9c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932530:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c922d0dc/0xd8e438fb63524e9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932544:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431560.932548:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb63524ecd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932557:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.932560:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb63524ecd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932568:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb63524ecd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932578:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb63524ecd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932584:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb63524ecd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.932599:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.932601:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.932602:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.932851:0:14468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool
00010000:00010000:0.0:1789431560.932861:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e5af751/0xd8e438fb63524ebf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.932870:0:14500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+20:3314:x1876351894200064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 65690us (65777us total) trans 4294969594 rc 0/0
00000100:00100000:1.0:1789431560.932881:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8214
00000100:00100000:0.0:1789431560.933033:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3312:x1876351894201216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 48030us (48587us total) trans 4294969595 rc 0/0
00000100:00100000:0.0:1789431560.933041:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8219
00010000:00010000:0.0:1789431560.933127:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d92e4ee/0xd8e438fb635231bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f87 expref: 119 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.933142:0:14501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14501:1876351894202752:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431560.933168:0:14501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c7a32057/0xd8e438fb63524edb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.933181:0:14501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c7a32057/0xd8e438fb63524edb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.933189:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7a32057/0xd8e438fb63524edb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.933201:0:14501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7a32057/0xd8e438fb63524edb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.933209:0:14501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7a32057/0xd8e438fb63524edb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.933229:0:14501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431560.933401:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431560.933409:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7a32057/0xd8e438fb63524edb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00080000:2.0:1789431560.933416:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce3a045c00/2, rc 0, transno 4294969594
00010000:00010000:1.0:1789431560.933418:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b5e1c00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.933425:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7a32057/0xd8e438fb63524edb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.933429:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894200064:0@lo:6:osp-syn-0-0.0
00010000:00010000:1.0:1789431560.933443:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7a32057/0xd8e438fb63524edb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.933460:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7a32057/0xd8e438fb63524edb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.933468:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7a32057/0xd8e438fb63524edb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.933486:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.933488:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.933490:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431560.933976:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+19:3312:x1876351894202368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 27448us (27774us total) trans 4294969980 rc 0/0
00000100:00100000:0.0:1789431560.933985:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8223
00010000:00010000:0.0:1789431560.934024:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.934960:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:1.0:1789431560.935006:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2e82aa00/2, rc 0, transno 4294969977
00000100:00100000:1.0:1789431560.935030:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894198656:0@lo:6:osp-syn-1-0.0
00000004:00080000:1.0:1789431560.935096:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce3a045880/2, rc 0, transno 4294969979
00000100:00100000:1.0:1789431560.935101:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a045880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894202112:0@lo:6:osp-syn-1-0.0
00000004:00080000:1.0:1789431560.935111:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1c3e5f80/2, rc 0, transno 4294969975
00000100:00100000:1.0:1789431560.935114:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894201088:0@lo:6:osp-syn-1-0.0
00000004:00080000:1.0:1789431560.935125:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1ac76680/2, rc 0, transno 4294969590
00000100:00100000:1.0:1789431560.935129:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894200704:0@lo:6:osp-syn-0-0.0
00000004:00080000:1.0:1789431560.935137:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2e828700/2, rc 0, transno 4294969976
00000100:00100000:1.0:1789431560.935140:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894198400:0@lo:6:osp-syn-1-0.0
00000004:00080000:1.0:1789431560.935148:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2e82ad80/2, rc 0, transno 4294969978
00000100:00100000:1.0:1789431560.935152:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894198912:0@lo:6:osp-syn-1-0.0
00010000:00010000:1.0:1789431560.935181:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014acd8f5/0xd8e438fb63522f31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ed1 expref: 118 pid: 6698 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.935200:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1876351894201984:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431560.935225:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000038ba2529/0xd8e438fb63524ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.935235:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000038ba2529/0xd8e438fb63524ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.935242:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038ba2529/0xd8e438fb63524ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.935252:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038ba2529/0xd8e438fb63524ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.935259:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038ba2529/0xd8e438fb63524ec6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.935279:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431560.935617:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431560.935627:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038ba2529/0xd8e438fb63524ec6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.935637:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431560.935642:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038ba2529/0xd8e438fb63524ec6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.935652:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038ba2529/0xd8e438fb63524ec6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.935672:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038ba2529/0xd8e438fb63524ec6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.935680:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038ba2529/0xd8e438fb63524ec6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.935704:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431560.935706:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431560.935708:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.935818:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a3f3491/0xd8e438fb63522ca6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7e1b expref: 129 pid: 8217 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.935833:0:14497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14497:1876351894200832:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431560.935851:0:14497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63524ea3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.935861:0:14497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63524ea3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.935868:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63524ea3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.935875:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63524ea3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.935881:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63524ea3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.935898:0:14497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431560.936104:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+20:3312:x1876351894200576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 60910us (60998us total) trans 4294969596 rc 0/0
00000100:00100000:0.0:1789431560.936114:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8215
00010000:00010000:0.0:1789431560.936148:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431560.936153:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63524ea3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.936167:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431560.936170:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63524ea3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.936179:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63524ea3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.936193:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63524ea3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.936200:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63524ea3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.936219:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.936220:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.936222:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431560.937086:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:3.0:1789431560.937138:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1c3e6300/2, rc 0, transno 4294969980
00000100:00100000:3.0:1789431560.937150:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894202368:0@lo:6:osp-syn-1-0.0
00000004:00080000:3.0:1789431560.937171:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1c3e5880/2, rc 0, transno 4294969595
00000100:00100000:3.0:1789431560.937176:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894201216:0@lo:6:osp-syn-0-0.0
00000004:00080000:3.0:1789431560.937186:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1c3e4700/2, rc 0, transno 4294969592
00000100:00100000:3.0:1789431560.937189:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894201344:0@lo:6:osp-syn-0-0.0
00000004:00080000:3.0:1789431560.937200:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1ac75180/2, rc 0, transno 4294969596
00000100:00100000:3.0:1789431560.937203:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894200576:0@lo:6:osp-syn-0-0.0
00000004:00080000:3.0:1789431560.937213:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce3a045180/2, rc 0, transno 4294969593
00000100:00100000:3.0:1789431560.937216:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894200192:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431560.937480:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+258:14617:x1876351933425024:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 18852us (21034us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431560.937498:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12429
00000100:00100000:1.0:1789431560.937553:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3314:x1876351894201856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 45394us (45858us total) trans 4294969981 rc 0/0
00000100:00100000:1.0:1789431560.937565:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8220
00000100:00100000:2.0:1789431560.937577:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894203008:0@lo:6:osp-syn-0-0.0
00010000:00010000:1.0:1789431560.937605:0:14490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524e2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.937625:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524e2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.937625:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1789431560.937639:0:14490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524e2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.937649:0:14490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524e2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.937672:0:14490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431560.937693:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431560.937698:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524e2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.937707:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3c00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.937712:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524e2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.937721:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524e2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.937740:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524e2c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.937759:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524e2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.937781:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.937783:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.937785:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431560.938156:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894203008
00000100:00100000:0.0:1789431560.938165:0:14491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894203008
00000100:00100000:0.0:1789431560.938208:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8224
00000100:00100000:0.0:1789431560.938219:0:14491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+20:3314:x1876351894203008:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431560.938249:0:14491:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1275 count 1
00010000:00010000:0.0:1789431560.938356:0:14491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b5f4b29/0xd8e438fb63524ee2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4fb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.938376:0:14491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006427cb9a/0xd8e438fb63523129 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f64 expref: 128 pid: 14502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.938393:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fb:0x0].0x0 since=3s v=(0 0)
00010000:00010000:0.0:1789431560.938398:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fb:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.938404:0:14491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b5f4b29/0xd8e438fb63524ee2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.938439:0:14491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006427cb9a/0xd8e438fb63523129 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f64 expref: 128 pid: 14502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.938457:0:14491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006427cb9a/0xd8e438fb63523129 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f64 expref: 128 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.938473:0:14491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:14491:1876351894203776:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.938547:0:14491:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1480 going to sleep for 11 seconds
00000100:00100000:0.0:1789431560.938569:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894203264:0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431560.938613:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.938625:0:14490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3314:x1876351894196480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 89893us (90684us total) trans 4294969597 rc 0/0
00000100:00100000:1.0:1789431560.938635:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8198
00000100:00100000:0.0:1789431560.938646:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1789431560.938656:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894203136:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.938978:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894203264
00000100:00100000:1.0:1789431560.938985:0:14490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894203264
00000100:00100000:1.0:1789431560.939015:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8225
00000100:00100000:1.0:1789431560.939023:0:14490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3312:x1876351894203264:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431560.939040:0:14490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1280 count 1
00010000:00010000:1.0:1789431560.939084:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c16aeb0/0xd8e438fb63524ee9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x500:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.939101:0:14490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb6352380d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x500:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c816a expref: 117 pid: 14472 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.939109:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x500:0x0].0x0 since=2s v=(0 0)
00010000:00010000:1.0:1789431560.939113:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x500:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.939117:0:14490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c16aeb0/0xd8e438fb63524ee9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x500:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.939140:0:14490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb6352380d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x500:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c816a expref: 117 pid: 14472 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.939151:0:14490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb6352380d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x500:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c816a expref: 117 pid: 14472 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.939164:0:14490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d508e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14490:1876351894203904:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431560.939200:0:14490:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3f00 going to sleep for 11 seconds
00000100:00100000:1.0:1789431560.940679:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894202880:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.940762:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.941206:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894203392:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.941237:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.941268:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1789431560.941275:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894203520:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.941297:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.941342:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894202880
00000100:00100000:1.0:1789431560.941351:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894202880
00000100:00100000:0.0:1789431560.941390:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.941403:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894203392
00000100:00100000:1.0:1789431560.941407:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894203392
00000100:00100000:0.0:1789431560.941427:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894203648:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.941439:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894203520
00000100:00100000:1.0:1789431560.941443:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894203520
00000100:00100000:0.0:1789431560.941458:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.941472:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894203136
00000100:00100000:1.0:1789431560.941477:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894203136
00000100:00100000:1.0:1789431560.942263:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894203648
00000100:00100000:1.0:1789431560.942271:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894203648
00000100:00100000:3.0:1789431560.942388:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894204160:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431560.942445:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431560.942454:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8226
00000100:00100000:0.0:1789431560.942469:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3313:x1876351894202880:12345-0@lo:6:osp-syn-1-0.0
00000100:00100000:3.0:1789431560.942480:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894204672:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431560.942503:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00002000:00080000:0.0:1789431560.942506:0:14469:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1277 count 1
00000100:00100000:3.0:1789431560.942528:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1789431560.942536:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894204288:0@lo:6:osp-syn-0-0.0
00010000:00010000:0.0:1789431560.942543:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63524ef0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.942558:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:0.0:1789431560.942574:0:14469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000570a40a0/0xd8e438fb6352345c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c804b expref: 117 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.942585:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fd:0x0].0x0 since=3s v=(0 0)
00010000:00010000:0.0:1789431560.942590:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fd:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.942597:0:14469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63524ef0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.942629:0:14469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000570a40a0/0xd8e438fb6352345c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c804b expref: 117 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.942643:0:14469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000570a40a0/0xd8e438fb6352345c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c804b expref: 117 pid: 14469 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.942656:0:14469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14469:1876351894204800:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.942723:0:14469:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c10c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431560.942740:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894204160
00000100:00100000:0.0:1789431560.942755:0:14501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894204160
00000100:00100000:0.0:1789431560.942793:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894204672
00000100:00100000:0.0:1789431560.942796:0:14501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894204672
00000100:00100000:0.0:1789431560.942807:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894204288
00000100:00100000:0.0:1789431560.942809:0:14501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894204288
00000100:00100000:0.0:1789431560.942820:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8227
00000100:00100000:0.0:1789431560.942826:0:14501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+24:3313:x1876351894203392:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431560.942846:0:14501:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1281 count 1
00010000:00010000:0.0:1789431560.942859:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb63524ef7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x501:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.942872:0:14501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000213bdec2/0xd8e438fb63523a44 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x501:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8219 expref: 117 pid: 14471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.942879:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x501:0x0].0x0 since=2s v=(0 0)
00010000:00010000:0.0:1789431560.942882:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x501:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.942885:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb63524ef7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x501:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.942906:0:14501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000213bdec2/0xd8e438fb63523a44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x501:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8219 expref: 117 pid: 14471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.942916:0:14501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000213bdec2/0xd8e438fb63523a44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x501:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8219 expref: 117 pid: 14471 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.942927:0:14501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14501:1876351894204928:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.942953:0:14501:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1c00 going to sleep for 11 seconds
00000100:00100000:0.0:1789431560.942973:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8228
00000100:00100000:0.0:1789431560.942981:0:14464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3313:x1876351894203520:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431560.942994:0:14464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1282 count 1
00010000:00010000:0.0:1789431560.943007:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eed82372/0xd8e438fb63524efe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x502:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.943026:0:14464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe10e981/0xd8e438fb63523b16 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x502:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8258 expref: 117 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.943034:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x502:0x0].0x0 since=2s v=(0 0)
00010000:00010000:0.0:1789431560.943036:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x502:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.943040:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eed82372/0xd8e438fb63524efe lrc: 4/0,1 mode: --/PW res: [0x280000400:0x502:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.943078:0:14464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe10e981/0xd8e438fb63523b16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x502:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8258 expref: 117 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.943088:0:14464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe10e981/0xd8e438fb63523b16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x502:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8258 expref: 117 pid: 14500 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.943099:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14464:1876351894205056:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.943126:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1180 going to sleep for 11 seconds
00000100:00100000:3.0:1789431560.943145:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8229
00000100:00100000:3.0:1789431560.943158:0:14505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+24:3312:x1876351894203136:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:3.0:1789431560.943175:0:14505:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1278 count 1
00010000:00010000:3.0:1789431560.943189:0:14505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009f3ab8f/0xd8e438fb63524f05 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.943204:0:14505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c39cf53b/0xd8e438fb6352356d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8098 expref: 117 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.943212:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fe:0x0].0x0 since=3s v=(0 0)
00010000:00010000:3.0:1789431560.943215:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fe:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431560.943219:0:14505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009f3ab8f/0xd8e438fb63524f05 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.943249:0:14505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c39cf53b/0xd8e438fb6352356d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8098 expref: 117 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431560.943259:0:14505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c39cf53b/0xd8e438fb6352356d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8098 expref: 117 pid: 6698 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431560.943269:0:14505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:14505:1876351894205184:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431560.943310:0:14505:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2d449300 going to sleep for 11 seconds
00000100:00100000:3.0:1789431560.943368:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431560.946899:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8230
00000100:00100000:0.0:1789431560.946935:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3312:x1876351894203648:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431560.946980:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1283 count 1
00010000:00010000:0.0:1789431560.947014:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bdecb82/0xd8e438fb63524f0c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.947040:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5e11983/0xd8e438fb63523c2e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82ac expref: 117 pid: 14502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.947072:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x503:0x0].0x0 since=2s v=(0 0)
00010000:00010000:0.0:1789431560.947077:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x503:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.947082:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bdecb82/0xd8e438fb63524f0c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.947128:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5e11983/0xd8e438fb63523c2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82ac expref: 117 pid: 14502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.947145:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5e11983/0xd8e438fb63523c2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82ac expref: 117 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.947161:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1876351894205312:192.168.203.4@tcp:104:
00000004:00080000:2.0:1789431560.947412:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2d509f80/2, rc 0, transno 4294969981
00000100:00100000:2.0:1789431560.947429:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894201856:0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431560.948662:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1f00 going to sleep for 11 seconds
00000100:00100000:0.0:1789431560.948881:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8231
00000100:00100000:0.0:1789431560.948902:0:14502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+23:3313:x1876351894204160:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431560.948932:0:14502:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1277 count 1
00010000:00010000:0.0:1789431560.948963:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dfb62f/0xd8e438fb63524f13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.948986:0:14502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d72421c/0xd8e438fb63523391 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c800c expref: 128 pid: 14482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.948996:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fd:0x0].0x0 since=3s v=(0 0)
00010000:00010000:0.0:1789431560.949000:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fd:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.949006:0:14502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dfb62f/0xd8e438fb63524f13 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.949037:0:14502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d72421c/0xd8e438fb63523391 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c800c expref: 128 pid: 14482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.949069:0:14502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d72421c/0xd8e438fb63523391 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c800c expref: 128 pid: 14482 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.949084:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:14502:1876351894205568:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.949152:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c13c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431560.949171:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8232
00000100:00100000:0.0:1789431560.949179:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3313:x1876351894204672:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431560.949192:0:14468:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1281 count 1
00010000:00010000:0.0:1789431560.949205:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000852db662/0xd8e438fb63524f1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x501:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.949216:0:14468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004010fb47/0xd8e438fb6352393a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x501:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81c5 expref: 128 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.949223:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x501:0x0].0x0 since=2s v=(0 0)
00010000:00010000:0.0:1789431560.949226:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x501:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.949230:0:14468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000852db662/0xd8e438fb63524f1a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x501:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.949249:0:14468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004010fb47/0xd8e438fb6352393a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x501:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81c5 expref: 128 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.949258:0:14468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004010fb47/0xd8e438fb6352393a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x501:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81c5 expref: 128 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.949268:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14468:1876351894205696:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.949952:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e180 going to sleep for 11 seconds
00000100:00100000:0.0:1789431560.949994:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1789431560.950013:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894205440:0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431560.950088:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431560.950316:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894205440
00000100:00100000:0.0:1789431560.950325:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894205440
00000100:00100000:0.0:1789431560.950369:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8233
00000100:00100000:0.0:1789431560.950377:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3313:x1876351894204288:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431560.950399:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1278 count 1
00010000:00010000:0.0:1789431560.950421:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fab003c/0xd8e438fb63524f21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.950441:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000983102ae/0xd8e438fb635234d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8067 expref: 128 pid: 14468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.950449:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fe:0x0].0x0 since=3s v=(0 0)
00010000:00010000:0.0:1789431560.950453:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fe:0x0].0x0 since=0s v=(0 0)
00000100:00100000:1.0:1789431560.950455:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8234
00010000:00010000:0.0:1789431560.950459:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fab003c/0xd8e438fb63524f21 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.950472:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:3313:x1876351894205440:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431560.950490:0:14486:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1284 count 1
00010000:00010000:0.0:1789431560.950491:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000983102ae/0xd8e438fb635234d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8067 expref: 128 pid: 14468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.950507:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000983102ae/0xd8e438fb635234d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8067 expref: 128 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.950513:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524f28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x504:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.950521:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1876351894205824:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431560.950534:0:14486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004789398b/0xd8e438fb63523e1f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x504:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8346 expref: 117 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.950545:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x504:0x0].0x0 since=1s v=(0 0)
00010000:00010000:1.0:1789431560.950548:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x504:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.950553:0:14486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524f28 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x504:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.950569:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065ec00 going to sleep for 11 seconds
00010000:00010000:1.0:1789431560.950580:0:14486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004789398b/0xd8e438fb63523e1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x504:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8346 expref: 117 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.950591:0:14486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004789398b/0xd8e438fb63523e1f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x504:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8346 expref: 117 pid: 6699 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.950604:0:14486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d509c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14486:1876351894205952:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.950608:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894204032:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431560.950651:0:14486:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f36c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431560.950657:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.950676:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933426560
00000100:00100000:1.0:1789431560.950683:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933426560
00000100:00100000:0.0:1789431560.950685:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894204544:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431560.950718:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.950728:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295792
00000100:00100000:1.0:1789431560.950739:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+258:14616:x1876351933426560:12345-192.168.203.4@tcp:101:dbench.0
00000100:00100000:0.0:1789431560.950754:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00010000:00010000:1.0:1789431560.950770:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.950799:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524f2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c87de expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.950884:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63524f36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.950899:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63524f36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.950913:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63524f36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.950929:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3400/0xd8e438fb63524f3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.950935:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3400/0xd8e438fb63524f3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.950941:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3400/0xd8e438fb63524f3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951017:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63524f36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951025:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63524f36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951031:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63524f36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951037:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.951042:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63524f36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951072:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63524f36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951203:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.951206:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.951214:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63524f36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951221:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63524f36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951237:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3400/0xd8e438fb63524f3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951243:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3400/0xd8e438fb63524f3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951249:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3400/0xd8e438fb63524f3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951254:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.951257:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3400/0xd8e438fb63524f3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951263:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3400/0xd8e438fb63524f3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951271:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xa1f039dc (ffff90ce03149000)
00010000:00010000:1.0:1789431560.951273:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.951276:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3400/0xd8e438fb63524f3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951282:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3400/0xd8e438fb63524f3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa1f039dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951323:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524f2f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87de expref: 259 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951338:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431560.951340:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:1.0:1789431560.951344:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63524f2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87de expref: 259 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951354:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce249e1200, rc 0)
00000100:00100000:1.0:1789431560.951396:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+258:14616:x1876351933426560:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 660us (8027us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431560.951403:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295792
00010000:00010000:1.0:1789431560.951470:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb63523336 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7ff0 expref: 117 pid: 14490 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.951482:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14482:1876351894202624:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431560.951508:0:14482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ed4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951518:0:14482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ed4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951525:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ed4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951533:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ed4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951545:0:14482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ed4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.951571:0:14482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431560.952014:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894204416:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431560.952073:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431560.952118:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894204032
00000100:00100000:0.0:1789431560.952125:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894204032
00000100:00100000:0.0:1789431560.952154:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894204544
00000100:00100000:0.0:1789431560.952156:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894204544
00000100:00100000:0.0:1789431560.952164:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894204416
00000100:00100000:0.0:1789431560.952166:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894204416
00000100:00100000:0.0:1789431560.952176:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8235
00000100:00100000:0.0:1789431560.952184:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+26:3312:x1876351894204032:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431560.952207:0:14497:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1276 count 1
00010000:00010000:0.0:1789431560.952231:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b5f53c0/0xd8e438fb63524f44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.952250:0:14497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000efaed3dd/0xd8e438fb63523264 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fb8 expref: 128 pid: 14472 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.952259:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fc:0x0].0x0 since=3s v=(0 0)
00010000:00010000:0.0:1789431560.952263:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fc:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.952268:0:14497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b5f53c0/0xd8e438fb63524f44 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.952297:0:14497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000efaed3dd/0xd8e438fb63523264 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fb8 expref: 128 pid: 14472 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.952310:0:14497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000efaed3dd/0xd8e438fb63523264 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fb8 expref: 128 pid: 14472 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.952325:0:14497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14497:1876351894206080:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.952377:0:14497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba39600 going to sleep for 11 seconds
00000100:00100000:0.0:1789431560.952396:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8236
00000100:00100000:0.0:1789431560.952405:0:14472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3312:x1876351894204544:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431560.952417:0:14472:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1280 count 1
00010000:00010000:0.0:1789431560.952430:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63524f4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x500:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.952442:0:14472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a11e56e8/0xd8e438fb63523703 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x500:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8116 expref: 128 pid: 14505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.952450:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x500:0x0].0x0 since=2s v=(0 0)
00010000:00010000:0.0:1789431560.952453:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x500:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.952458:0:14472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63524f4b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x500:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.952475:0:14482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3312:x1876351894202496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 46174us (46338us total) trans 4294969982 rc 0/0
00010000:00010000:0.0:1789431560.952479:0:14472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a11e56e8/0xd8e438fb63523703 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x500:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8116 expref: 128 pid: 14505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.952492:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8222
00010000:00010000:0.0:1789431560.952496:0:14472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a11e56e8/0xd8e438fb63523703 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x500:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8116 expref: 128 pid: 14505 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.952508:0:14472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14472:1876351894206208:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431560.952517:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8237
00000100:00100000:1.0:1789431560.952527:0:14482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3312:x1876351894204416:12345-0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431560.952530:0:14472:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf0552ccc0 going to sleep for 11 seconds
00002000:00080000:1.0:1789431560.952541:0:14482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1279 count 1
00010000:00010000:1.0:1789431560.952557:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524f52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431560.952564:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1c3e7100/2, rc 0, transno 4294969982
00010000:00010000:1.0:1789431560.952571:0:14482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5921d19/0xd8e438fb63523615 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c80c9 expref: 128 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.952579:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894202496:0@lo:6:osp-syn-1-0.0
00010000:00010000:1.0:1789431560.952580:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ff:0x0].0x0 since=2s v=(0 0)
00010000:00010000:1.0:1789431560.952587:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ff:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.952592:0:14482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524f52 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.952615:0:14482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e5921d19/0xd8e438fb63523615 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c80c9 expref: 128 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.952626:0:14482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e5921d19/0xd8e438fb63523615 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c80c9 expref: 128 pid: 6700 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.952645:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894206464:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.952650:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14482:1876351894206336:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.952674:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.952686:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3b40 going to sleep for 11 seconds
00010000:00010000:1.0:1789431560.952709:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00000100:00100000:0.0:1789431560.952711:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894206464
00000100:00100000:0.0:1789431560.952716:0:14499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894206464
00010000:00010000:1.0:1789431560.952718:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ed4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.952728:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce20f06a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.952733:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ed4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.952737:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8238
00010000:00010000:1.0:1789431560.952760:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ed4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.952778:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ed4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.952787:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ed4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.952898:0:14499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+26:3311:x1876351894206464:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431560.952911:0:14499:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1285 count 1
00010000:00010000:0.0:1789431560.952927:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb63524f59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x505:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.952940:0:14499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e6d2028/0xd8e438fb63523f84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x505:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83af expref: 116 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.952954:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x505:0x0].0x0 since=1s v=(0 0)
00010000:00010000:0.0:1789431560.952957:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x505:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.952962:0:14499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb63524f59 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x505:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.952989:0:14499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e6d2028/0xd8e438fb63523f84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x505:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83af expref: 116 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.952993:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.952996:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.953001:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431560.953005:0:14499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e6d2028/0xd8e438fb63523f84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x505:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83af expref: 116 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.953017:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:14499:1876351894206592:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431560.953040:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf012ed480 going to sleep for 11 seconds
00000004:00080000:3.0:1789431560.954402:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba1b480/2, rc 0, transno 4294969597
00000100:00100000:3.0:1789431560.954541:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894196480:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431560.957077:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894206720:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431560.957168:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.957219:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894206720
00000100:00100000:1.0:1789431560.957231:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894206720
00000100:00100000:1.0:1789431560.957366:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8239
00000100:00100000:1.0:1789431560.957381:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3312:x1876351894206720:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:1.0:1789431560.957413:0:14471:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1282 count 1
00010000:00010000:1.0:1789431560.957446:0:14471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524f60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x502:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.957473:0:14471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055378d58/0xd8e438fb63523b0f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x502:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8251 expref: 128 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.957482:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x502:0x0].0x0 since=2s v=(0 0)
00010000:00010000:1.0:1789431560.957488:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x502:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.957493:0:14471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524f60 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x502:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.957526:0:14471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055378d58/0xd8e438fb63523b0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x502:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8251 expref: 128 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.957540:0:14471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055378d58/0xd8e438fb63523b0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x502:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8251 expref: 128 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.957553:0:14471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d509880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14471:1876351894206848:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431560.957695:0:14471:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3540 going to sleep for 11 seconds
00000100:00100000:1.0:1789431560.962190:0:14490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d508e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14490:1876351894203904:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431560.962234:0:14490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001c16aeb0/0xd8e438fb63524ee9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x500:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.966527:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.966574:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.966624:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933427072
00000100:00100000:2.0:1789431560.966636:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933427072
00010000:00010000:2.0:1789431560.966691:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006427cb9a/0xd8e438fb63523129 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f64 expref: 129 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.966734:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933426944
00000100:00100000:2.0:1789431560.966737:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933426944
00010000:00010000:2.0:1789431560.966765:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb6352380d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x500:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c816a expref: 117 pid: 14472 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.966792:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16423
00000100:00100000:2.0:1789431560.966804:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a046a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+129:2347:x1876351933427072:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431560.966824:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431560.966833:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006427cb9a/0xd8e438fb63523129 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f64 expref: 129 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.966849:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006427cb9a/0xd8e438fb63523129 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f64 expref: 129 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.966852:0:14491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:14491:1876351894203776:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431560.966889:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006427cb9a/0xd8e438fb63523129 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7f64 expref: 129 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.966893:0:14491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005b5f4b29/0xd8e438fb63524ee2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4fb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.966920:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fb:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.966927:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fb:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.966935:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005b5f4b29/0xd8e438fb63524ee2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.966947:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b5f4b29/0xd8e438fb63524ee2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.966983:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431560.967031:0:14491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005b5f4b29/0xd8e438fb63524ee2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.967041:0:14491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b5f4b29/0xd8e438fb63524ee2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.967088:0:14491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b5f4b29/0xd8e438fb63524ee2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.967090:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a046a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+128:2347:x1876351933427072:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 245us (536us total) trans 0 rc 0/0
00010000:00010000:0.0:1789431560.967106:0:14491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b5f4b29/0xd8e438fb63524ee2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.967107:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16423
00010000:00010000:0.0:1789431560.967132:0:14491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1789431560.967135:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16424
00000100:00100000:2.0:1789431560.967145:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+117:2348:x1876351933426944:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431560.967156:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431560.967162:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb6352380d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x500:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c816a expref: 117 pid: 14472 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.967176:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb6352380d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x500:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c816a expref: 117 pid: 14472 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.967194:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb6352380d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x500:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c816a expref: 117 pid: 14472 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.967196:0:14469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14469:1876351894204800:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431560.967213:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x500:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.967217:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x500:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.967222:0:14469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63524ef0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.967223:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001c16aeb0/0xd8e438fb63524ee9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x500:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.967248:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c16aeb0/0xd8e438fb63524ee9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x500:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.967268:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431560.967283:0:14490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001c16aeb0/0xd8e438fb63524ee9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.967295:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+116:2348:x1876351933426944:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 149us (717us total) trans 0 rc 0/0
00010000:00010000:1.0:1789431560.967297:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c16aeb0/0xd8e438fb63524ee9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.967310:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16424
00010000:00010000:1.0:1789431560.967317:0:14490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c16aeb0/0xd8e438fb63524ee9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.967328:0:14490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c16aeb0/0xd8e438fb63524ee9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.967351:0:14490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:1.0:1789431560.967369:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1789431560.967378:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b5f4b29/0xd8e438fb63524ee2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.967387:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b5e1800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.967393:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b5f4b29/0xd8e438fb63524ee2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.967409:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b5f4b29/0xd8e438fb63524ee2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.967424:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b5f4b29/0xd8e438fb63524ee2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.967432:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b5f4b29/0xd8e438fb63524ee2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.967460:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431560.967464:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c16aeb0/0xd8e438fb63524ee9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.967471:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f76400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431560.967474:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c16aeb0/0xd8e438fb63524ee9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.967483:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c16aeb0/0xd8e438fb63524ee9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.967495:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c16aeb0/0xd8e438fb63524ee9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.967503:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c16aeb0/0xd8e438fb63524ee9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.967531:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431560.967533:0:14491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+28:3314:x1876351894203008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29314us (29907us total) trans 4294969598 rc 0/0
00010000:00010000:1.0:1789431560.967534:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431560.967538:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431560.967546:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8224
00010000:00010000:0.0:1789431560.967572:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:0.0:1789431560.967606:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce156b1500/2, rc 0, transno 4294969598
00000100:00100000:0.0:1789431560.967630:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894203008:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431560.967782:0:14490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3312:x1876351894203264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28758us (29170us total) trans 4294969983 rc 0/0
00000100:00100000:1.0:1789431560.967866:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8225
00000004:00080000:0.0:1789431560.968003:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3b3b0e00/2, rc 0, transno 4294969983
00000100:00100000:0.0:1789431560.968024:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894203264:0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431560.968327:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894206976:0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431560.968377:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.968450:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894206976
00000100:00100000:1.0:1789431560.968459:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894206976
00000100:00100000:1.0:1789431560.968511:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8240
00000100:00100000:1.0:1789431560.968522:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3313:x1876351894206976:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431560.968556:0:6699:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1286 count 1
00010000:00010000:1.0:1789431560.968589:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63524f67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x506:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.968613:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000079975aaf/0xd8e438fb6352406b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x506:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83f5 expref: 115 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.968622:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x506:0x0].0x0 since=1s v=(0 0)
00010000:00010000:1.0:1789431560.968626:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x506:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.968630:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63524f67 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x506:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.968672:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000079975aaf/0xd8e438fb6352406b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x506:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83f5 expref: 115 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.968686:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000079975aaf/0xd8e438fb6352406b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x506:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83f5 expref: 115 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.968700:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d508380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6699:1876351894207104:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431560.968868:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3f00 going to sleep for 11 seconds
00000100:00100000:0.0:1789431560.971854:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1789431560.971885:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894207232:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431560.971970:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431560.972089:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894207232
00000100:00100000:2.0:1789431560.972101:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894207232
00000100:00100000:2.0:1789431560.972167:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8241
00000100:00100000:2.0:1789431560.972180:0:14500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+28:3313:x1876351894207232:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431560.972219:0:14500:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1284 count 1
00010000:00010000:2.0:1789431560.972255:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf53891/0xd8e438fb63524f6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x504:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.972283:0:14500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf2f1417/0xd8e438fb63523d3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x504:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8300 expref: 127 pid: 14486 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.972292:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x504:0x0].0x0 since=3s v=(0 0)
00010000:00010000:2.0:1789431560.972297:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x504:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431560.972303:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf53891/0xd8e438fb63524f6e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x504:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.973275:0:14500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cf2f1417/0xd8e438fb63523d3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x504:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8300 expref: 127 pid: 14486 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.973303:0:14500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cf2f1417/0xd8e438fb63523d3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x504:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8300 expref: 127 pid: 14486 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431560.973660:0:14500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a047100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:14500:1876351894207360:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431560.973789:0:14500:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3e6d1300 going to sleep for 11 seconds
00000100:00100000:2.0:1789431560.977329:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431560.977369:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431560.977486:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933426816
00000100:00100000:1.0:1789431560.977502:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933426816
00000100:00100000:1.0:1789431560.977579:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295793
00000100:00100000:1.0:1789431560.977592:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+258:14617:x1876351933426816:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431560.977622:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431560.977626:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:1.0:1789431560.977667:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63524e10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87d0 expref: 258 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.977690:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.977696:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431560.977712:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2e00/0xd8e438fb63524f75 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c87e5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.977891:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524f7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.977909:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524f7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.977920:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524f7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.977937:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524f83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.977945:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524f83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.977951:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524f83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:1.0:1789431560.978607:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x512:0x0], index 1: 0
00010000:00010000:1.0:1789431560.978823:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524f8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.978837:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.978847:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.978888:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524f7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.978896:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524f7c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.978904:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524f7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.978911:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431560.978916:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524f7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.978925:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524f7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.978940:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431560.978943:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431560.978948:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524f7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.978954:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb63524f7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431560.978966:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000013ffe196 reply state 000000000d14f4a6 transno 4295120886 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524f83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.978976:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431560.979010:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2e00/0xd8e438fb63524f75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87e5 expref: 260 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.979026:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524f8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87e5 expref: 259 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.979035:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa1:0x0].0x0 (ffff90ce03149b00)
00010000:00010000:1.0:1789431560.979037:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431560.979040:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e2800, rc 0)
00000100:00100000:1.0:1789431560.979160:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+260:14617:x1876351933426816:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1571us (1857us total) trans 4295120886 rc 0/0
00000100:00100000:1.0:1789431560.979169:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295793
00000100:00100000:3.0:1789431560.979179:0:14501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14501:1876351894204928:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431560.979213:0:14501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb63524ef7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x501:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.980862:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933427200
00000100:00100000:0.0:1789431560.980883:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933427200
00010000:00010000:0.0:1789431560.980940:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000570a40a0/0xd8e438fb6352345c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c804b expref: 116 pid: 14469 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431560.981009:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16425
00000100:00100000:0.0:1789431560.981022:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+116:2347:x1876351933427200:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431560.981043:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431560.981069:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000570a40a0/0xd8e438fb6352345c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c804b expref: 116 pid: 14469 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.981090:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000570a40a0/0xd8e438fb6352345c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c804b expref: 116 pid: 14469 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.981127:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000570a40a0/0xd8e438fb6352345c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c804b expref: 116 pid: 14469 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.981150:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fd:0x0].0x0 since=1s v=(0 0)
00010000:00010000:0.0:1789431560.981155:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fd:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431560.981161:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63524ef0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.981173:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63524ef0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.981213:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431560.989826:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+115:2347:x1876351933427200:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 8786us (12434us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431560.989847:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16425
00000100:00100000:0.0:1789431560.989990:0:8065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8065:1876351894207488:0@lo:5:osp-pre-1-0.0
00000100:00100000:0.0:1789431560.990095:0:8065:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431560.990140:0:8065:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf18a0bb40 going to sleep for 11 seconds
00010000:00010000:0.0:1789431560.990172:0:14469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63524ef0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.990189:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63524ef0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.990203:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63524ef0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.990212:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63524ef0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431560.990235:0:14469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431560.990602:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3313:x1876351894202880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 48125us (49828us total) trans 4294969984 rc 0/0
00000100:00100000:0.0:1789431560.990612:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8226
00000100:00100000:0.0:1789431560.990636:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894207488
00000100:00100000:0.0:1789431560.990852:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894207488
00000100:00100000:0.0:1789431560.990901:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8242
00000100:00100000:0.0:1789431560.990911:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:8065:x1876351894207488:12345-0@lo:5:osp-pre-1-0.0
00002000:00080000:0.0:1789431560.990961:0:14469:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1314
00010000:00010000:2.0:1789431560.996114:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431560.996133:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63524ef0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.996152:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf421ef000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431560.996159:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63524ef0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.996172:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63524ef0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.996202:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63524ef0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.996211:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa070246/0xd8e438fb63524ef0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431560.996248:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431560.996250:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431560.996252:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431560.996812:0:14464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14464:1876351894205056:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431560.996847:0:14464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eed82372/0xd8e438fb63524efe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x502:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431560.996908:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3b3b1880/2, rc 0, transno 4294969984
00000100:00100000:0.0:1789431560.996930:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894202880:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.997087:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894207616:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431560.997159:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431560.998183:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894207616
00000100:00100000:1.0:1789431560.998198:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894207616
00000100:00100000:1.0:1789431560.998258:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8243
00000100:00100000:1.0:1789431560.998270:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3311:x1876351894207616:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431560.998317:0:8217:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1287 count 1
00010000:00010000:1.0:1789431560.998348:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3a13eab/0xd8e438fb63524f98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x507:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.998374:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009cf5851c/0xd8e438fb635241c9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x507:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8450 expref: 114 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.998385:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x507:0x0].0x0 since=2s v=(0 0)
00010000:00010000:1.0:1789431560.998390:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x507:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431560.998396:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3a13eab/0xd8e438fb63524f98 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x507:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.998434:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009cf5851c/0xd8e438fb635241c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x507:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8450 expref: 114 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431560.998449:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009cf5851c/0xd8e438fb635241c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x507:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8450 expref: 114 pid: 6698 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431560.998466:0:8217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8217:1876351894207744:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431560.998563:0:8217:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1480 going to sleep for 11 seconds
00000100:00100000:3.0:1789431560.999982:0:14505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:14505:1876351894205184:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431561.000027:0:14505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009f3ab8f/0xd8e438fb63524f05 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.000073:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.000102:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.000138:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933427584
00000100:00100000:3.0:1789431561.000138:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933427456
00000100:00100000:2.0:1789431561.000147:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933427584
00000100:00100000:3.0:1789431561.000147:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933427456
00010000:00010000:3.0:1789431561.000193:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe10e981/0xd8e438fb63523b16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x502:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8258 expref: 116 pid: 14500 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.000227:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1876351894205312:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431561.000243:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16426
00010000:00010000:1.0:1789431561.000250:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003bdecb82/0xd8e438fb63524f0c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.000257:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+116:2347:x1876351933427456:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431561.000279:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431561.000298:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000fe10e981/0xd8e438fb63523b16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x502:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8258 expref: 116 pid: 14500 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.000314:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe10e981/0xd8e438fb63523b16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x502:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8258 expref: 116 pid: 14500 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.000342:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe10e981/0xd8e438fb63523b16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x502:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8258 expref: 116 pid: 14500 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.000361:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x502:0x0].0x0 since=1s v=(0 0)
00010000:00010000:3.0:1789431561.000366:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x502:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431561.000374:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eed82372/0xd8e438fb63524efe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x502:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.000385:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eed82372/0xd8e438fb63524efe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x502:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.000420:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431561.000459:0:14464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eed82372/0xd8e438fb63524efe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.000470:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eed82372/0xd8e438fb63524efe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.000482:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eed82372/0xd8e438fb63524efe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.000486:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+115:2347:x1876351933427456:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 231us (413us total) trans 0 rc 0/0
00010000:00010000:1.0:1789431561.000502:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eed82372/0xd8e438fb63524efe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.000503:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16426
00010000:00010000:1.0:1789431561.000529:0:14464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431561.000555:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c39cf53b/0xd8e438fb6352356d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8098 expref: 115 pid: 6698 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.000673:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16427
00000100:00100000:2.0:1789431561.000682:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a045f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+115:2349:x1876351933427584:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.000693:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.000699:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000c39cf53b/0xd8e438fb6352356d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8098 expref: 115 pid: 6698 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.000712:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c39cf53b/0xd8e438fb6352356d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8098 expref: 115 pid: 6698 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.000728:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c39cf53b/0xd8e438fb6352356d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8098 expref: 115 pid: 6698 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.000740:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fe:0x0].0x0 since=1s v=(0 0)
00010000:00010000:2.0:1789431561.000753:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4fe:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.000757:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009f3ab8f/0xd8e438fb63524f05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.000766:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009f3ab8f/0xd8e438fb63524f05 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.000789:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.000811:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a045f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+114:2349:x1876351933427584:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 131us (709us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.000818:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16427
00000100:00100000:2.0:1789431561.000870:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.000923:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.000977:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933427328
00000100:00100000:3.0:1789431561.000984:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933427328
00010000:00010000:3.0:1789431561.001006:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000213bdec2/0xd8e438fb63523a44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x501:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8219 expref: 113 pid: 14471 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.001041:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933427712
00000100:00100000:1.0:1789431561.001044:0:14464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3313:x1876351894203520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 58060us (59742us total) trans 4294969985 rc 0/0
00000100:00100000:3.0:1789431561.001071:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933427712
00000100:00100000:1.0:1789431561.001084:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8228
00010000:00010000:3.0:1789431561.001090:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5e11983/0xd8e438fb63523c2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82ac expref: 114 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.001115:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00000100:00100000:2.0:1789431561.001115:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.001121:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16428
00010000:00010000:1.0:1789431561.001125:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eed82372/0xd8e438fb63524efe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.001133:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+114:2348:x1876351933427328:12345-192.168.203.4@tcp:103:ldlm_bl.0
00000100:00100000:2.0:1789431561.001138:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933427840
00010000:00010000:1.0:1789431561.001143:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a800 already unused, calling callback (ffffffffc16f78b0)
00000100:00100000:2.0:1789431561.001145:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933427840
00010000:00010000:3.0:1789431561.001148:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431561.001150:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eed82372/0xd8e438fb63524efe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.001156:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000213bdec2/0xd8e438fb63523a44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x501:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8219 expref: 114 pid: 14471 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.001168:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eed82372/0xd8e438fb63524efe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.001174:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000213bdec2/0xd8e438fb63523a44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x501:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8219 expref: 114 pid: 14471 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.001184:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000983102ae/0xd8e438fb635234d3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8067 expref: 128 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.001191:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eed82372/0xd8e438fb63524efe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.001198:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000213bdec2/0xd8e438fb63523a44 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x501:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8219 expref: 114 pid: 14471 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.001207:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eed82372/0xd8e438fb63524efe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.001208:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16429
00000100:00100000:2.0:1789431561.001220:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e957c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+113:2347:x1876351933427712:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431561.001223:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x501:0x0].0x0 since=1s v=(0 0)
00010000:00010000:3.0:1789431561.001231:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x501:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.001234:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431561.001236:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb63524ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x501:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.001241:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000d5e11983/0xd8e438fb63523c2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x503:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82ac expref: 113 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.001245:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.001250:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.001253:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431561.001267:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb63524ef7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x501:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.001269:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5e11983/0xd8e438fb63523c2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x503:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82ac expref: 113 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.001294:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5e11983/0xd8e438fb63523c2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x503:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c82ac expref: 113 pid: 14502 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.001303:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431561.001314:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x503:0x0].0x0 since=1s v=(0 0)
00010000:00010000:3.0:1789431561.001317:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431561.001319:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x503:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.001325:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003bdecb82/0xd8e438fb63524f0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.001334:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bdecb82/0xd8e438fb63524f0c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.001348:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+112:2348:x1876351933427328:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 218us (476us total) trans 0 rc 0/0
00010000:00010000:2.0:1789431561.001357:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431561.001358:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16428
00000100:00100000:3.0:1789431561.001375:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933427968
00000100:00100000:3.0:1789431561.001379:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933427968
00000100:00100000:2.0:1789431561.001385:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e957c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+111:2347:x1876351933427712:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 166us (460us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.001395:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16429
00010000:00010000:3.0:1789431561.001398:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004010fb47/0xd8e438fb6352393a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x501:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81c5 expref: 129 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.001410:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.001420:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933428096
00000100:00100000:3.0:1789431561.001424:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933428096
00010000:00010000:3.0:1789431561.001439:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d72421c/0xd8e438fb63523391 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c800c expref: 130 pid: 14482 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.001457:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16430
00000100:00100000:1.0:1789431561.001479:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.001497:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00080000:0.0:1789431561.001512:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1789431561.001556:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.001583:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.001599:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.001627:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.001659:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.001711:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.001726:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.002334:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933428992
00000100:00100000:1.0:1789431561.002347:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933428992
00000100:00100000:1.0:1789431561.002396:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295794
00000100:00100000:3.0:1789431561.002405:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16431
00000100:00100000:1.0:1789431561.002408:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+260:14616:x1876351933428992:12345-192.168.203.4@tcp:101:dbench.0
00000100:00100000:3.0:1789431561.002420:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+130:2348:x1876351933427968:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431561.002432:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.002437:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431561.002446:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000004010fb47/0xd8e438fb6352393a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x501:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81c5 expref: 130 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.002457:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2a00/0xd8e438fb63524f9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c87ec expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.002461:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004010fb47/0xd8e438fb6352393a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x501:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81c5 expref: 130 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.002495:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x501:0x0].0x0 since=1s v=(0 0)
00010000:00010000:3.0:1789431561.002497:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x501:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431561.002502:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000852db662/0xd8e438fb63524f1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x501:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.002509:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000852db662/0xd8e438fb63524f1a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x501:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.002523:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431561.002544:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524fa6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.002557:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+130:2348:x1876351933427968:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 144us (1262us total) trans 0 rc 0/0
00010000:00010000:1.0:1789431561.002563:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524fa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.002564:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16431
00010000:00010000:1.0:1789431561.002578:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524fa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.002583:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933428352
00000100:00100000:3.0:1789431561.002588:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933428352
00010000:00010000:1.0:1789431561.002598:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524fad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.002608:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.002615:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.002850:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000efaed3dd/0xd8e438fb63523264 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fb8 expref: 130 pid: 14472 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.002867:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933428224
00000100:00100000:3.0:1789431561.002871:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933428224
00010000:00010000:3.0:1789431561.002888:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004789398b/0xd8e438fb63523e1f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x504:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8346 expref: 111 pid: 6699 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.002900:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933428480
00000100:00100000:3.0:1789431561.002903:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933428480
00010000:00010000:3.0:1789431561.002915:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a11e56e8/0xd8e438fb63523703 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x500:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8116 expref: 131 pid: 14505 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.002931:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933428736
00000100:00100000:3.0:1789431561.002934:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933428736
00010000:00010000:3.0:1789431561.002945:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e6d2028/0xd8e438fb63523f84 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x505:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83af expref: 112 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.002957:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933428608
00000100:00100000:3.0:1789431561.002959:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933428608
00010000:00010000:3.0:1789431561.002973:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e5921d19/0xd8e438fb63523615 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c80c9 expref: 132 pid: 6700 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.002978:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524fa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.002986:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933428864
00010000:00010000:1.0:1789431561.002989:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524fa6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.002991:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933428864
00010000:00010000:1.0:1789431561.003001:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524fa6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.003008:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055378d58/0xd8e438fb63523b0f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x502:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8251 expref: 133 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003011:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b5e1c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.003017:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524fa6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003031:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524fa6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003042:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.003045:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.003078:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524fa6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003085:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb63524fa6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003100:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003107:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524fad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003114:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524fad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003120:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.003125:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524fad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.003127:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+133:2347:x1876351933427840:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431561.003140:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524fad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.003146:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431561.003150:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xe94006ef (ffff90ce03149500)
00010000:00010000:1.0:1789431561.003155:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.003156:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000983102ae/0xd8e438fb635234d3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8067 expref: 133 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003159:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524fad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003177:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63524fad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.003180:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000983102ae/0xd8e438fb635234d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8067 expref: 133 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.003202:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fe:0x0].0x0 since=1s v=(0 0)
00010000:00010000:2.0:1789431561.003206:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fe:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.003210:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007fab003c/0xd8e438fb63524f21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.003221:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fab003c/0xd8e438fb63524f21 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003224:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2a00/0xd8e438fb63524f9f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87ec expref: 261 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003243:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.003246:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.003247:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431561.003253:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2a00/0xd8e438fb63524f9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87ec expref: 261 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003265:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e2a00, rc 0)
00000100:00100000:2.0:1789431561.003282:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+133:2347:x1876351933427840:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1815us (2168us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.003291:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16430
00000100:00100000:1.0:1789431561.003308:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+260:14616:x1876351933428992:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 903us (1646us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431561.003309:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933429120
00000100:00100000:2.0:1789431561.003315:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933429120
00000100:00100000:1.0:1789431561.003320:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295794
00010000:00010000:1.0:1789431561.003356:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524f83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003364:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524f83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003370:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524f83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003376:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.003379:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524f83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003390:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524f83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003401:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x148c06c6 (ffff90ce03149000)
00010000:00010000:1.0:1789431561.003403:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.003406:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524f83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003412:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb63524f83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.003473:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d508380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6699:1876351894207104:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431561.003497:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63524f67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x506:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003521:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003bdecb82/0xd8e438fb63524f0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003529:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bdecb82/0xd8e438fb63524f0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003537:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bdecb82/0xd8e438fb63524f0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003545:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bdecb82/0xd8e438fb63524f0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.003571:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:3.0:1789431561.003601:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933429248
00000100:00100000:3.0:1789431561.003605:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933429248
00010000:00010000:3.0:1789431561.003627:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000079975aaf/0xd8e438fb6352406b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x506:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83f5 expref: 113 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.003643:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16432
00000100:00100000:3.0:1789431561.003651:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+132:2347:x1876351933428096:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431561.003661:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431561.003667:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000008d72421c/0xd8e438fb63523391 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c800c expref: 132 pid: 14482 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.003685:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d72421c/0xd8e438fb63523391 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c800c expref: 132 pid: 14482 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.003700:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fd:0x0].0x0 since=1s v=(0 0)
00010000:00010000:3.0:1789431561.003704:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fd:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431561.003709:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000028dfb62f/0xd8e438fb63524f13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.003717:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dfb62f/0xd8e438fb63524f13 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.003733:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431561.003770:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+132:2347:x1876351933428096:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 119us (2362us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431561.003778:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16432
00000100:00100000:3.0:1789431561.003795:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16433
00000100:00100000:3.0:1789431561.003803:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+131:2347:x1876351933428352:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431561.003813:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431561.003819:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000efaed3dd/0xd8e438fb63523264 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fb8 expref: 131 pid: 14472 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.003829:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000efaed3dd/0xd8e438fb63523264 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fb8 expref: 131 pid: 14472 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.003846:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fc:0x0].0x0 since=1s v=(0 0)
00010000:00010000:3.0:1789431561.003850:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4fc:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431561.003854:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005b5f53c0/0xd8e438fb63524f44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.003862:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b5f53c0/0xd8e438fb63524f44 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.003875:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431561.003893:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+131:2347:x1876351933428352:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 91us (2416us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431561.003900:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16433
00000100:00100000:3.0:1789431561.003914:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16434
00000100:00100000:3.0:1789431561.003931:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+113:2350:x1876351933428224:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431561.003940:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431561.003945:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000004789398b/0xd8e438fb63523e1f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x504:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8346 expref: 113 pid: 6699 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.003956:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004789398b/0xd8e438fb63523e1f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x504:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8346 expref: 113 pid: 6699 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.003981:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x504:0x0].0x0 since=1s v=(0 0)
00010000:00010000:3.0:1789431561.003984:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x504:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431561.003988:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524f28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x504:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.004001:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524f28 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x504:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.004014:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431561.004344:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3312:x1876351894203648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 57427us (62884us total) trans 4294969986 rc 0/0
00000100:00100000:1.0:1789431561.004354:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8230
00010000:00010000:1.0:1789431561.004382:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431561.004389:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bdecb82/0xd8e438fb63524f0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.004398:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6ba00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431561.004402:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bdecb82/0xd8e438fb63524f0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.004410:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bdecb82/0xd8e438fb63524f0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.004423:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bdecb82/0xd8e438fb63524f0c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.004430:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bdecb82/0xd8e438fb63524f0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.004451:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.004453:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.004455:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431561.004485:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14482:1876351894206336:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431561.004502:0:14482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524f52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.004533:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004789398b/0xd8e438fb63523e1f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x504:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8346 expref: 113 pid: 6699 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.004544:0:14486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d509c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14486:1876351894205952:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431561.004554:0:14486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524f28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.004562:0:14486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524f28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.004570:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524f28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.004581:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524f28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.004590:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524f28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.004618:0:14486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431561.004632:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cf2f1417/0xd8e438fb63523d3f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x504:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8300 expref: 131 pid: 14486 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.004664:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16435
00000100:00100000:2.0:1789431561.004672:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+131:2347:x1876351933428480:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.004683:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.004689:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000a11e56e8/0xd8e438fb63523703 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x500:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8116 expref: 131 pid: 14505 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.004700:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a11e56e8/0xd8e438fb63523703 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x500:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8116 expref: 131 pid: 14505 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.004716:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x500:0x0].0x0 since=1s v=(0 0)
00010000:00010000:2.0:1789431561.004720:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x500:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.004725:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63524f4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x500:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.004734:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63524f4b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x500:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.004757:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.004783:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+131:2347:x1876351933428480:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 112us (3227us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.004791:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16435
00000100:00100000:2.0:1789431561.004806:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16436
00000100:00100000:2.0:1789431561.004814:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e957050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+112:2347:x1876351933428736:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.004823:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.004830:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000002e6d2028/0xd8e438fb63523f84 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x505:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83af expref: 112 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.004841:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e6d2028/0xd8e438fb63523f84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x505:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83af expref: 112 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.004854:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x505:0x0].0x0 since=1s v=(0 0)
00010000:00010000:2.0:1789431561.004857:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x505:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.004862:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb63524f59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x505:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.004870:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb63524f59 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x505:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.004890:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.004912:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e957050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+112:2347:x1876351933428736:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 98us (3329us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.004920:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16436
00000100:00100000:2.0:1789431561.004936:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16437
00000100:00100000:2.0:1789431561.004945:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+130:2348:x1876351933428608:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.004953:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.004959:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000e5921d19/0xd8e438fb63523615 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c80c9 expref: 130 pid: 6700 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.004970:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e5921d19/0xd8e438fb63523615 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c80c9 expref: 130 pid: 6700 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.004985:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5921d19/0xd8e438fb63523615 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c80c9 expref: 130 pid: 6700 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.004995:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ff:0x0].0x0 since=1s v=(0 0)
00010000:00010000:2.0:1789431561.004999:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ff:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.005004:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524f52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.005012:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524f52 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.005041:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.005078:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+129:2348:x1876351933428608:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 133us (3475us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.005088:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16437
00000100:00100000:1.0:1789431561.005089:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3313:x1876351894205440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 54620us (54997us total) trans 4294969987 rc 0/0
00000100:00100000:1.0:1789431561.005104:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8234
00000100:00100000:2.0:1789431561.005108:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16438
00000100:00100000:2.0:1789431561.005118:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+128:2348:x1876351933428864:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.005129:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431561.005135:0:14482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524f52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.005136:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000055378d58/0xd8e438fb63523b0f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x502:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8251 expref: 128 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.005159:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524f52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.005163:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055378d58/0xd8e438fb63523b0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x502:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8251 expref: 128 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.005177:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524f52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.005185:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x502:0x0].0x0 since=1s v=(0 0)
00010000:00010000:1.0:1789431561.005187:0:14482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524f52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.005191:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x502:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.005200:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524f60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x502:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.005210:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524f60 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x502:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.005214:0:14482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:2.0:1789431561.005230:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.005248:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+128:2348:x1876351933428864:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 132us (3619us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.005258:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16438
00000100:00100000:2.0:1789431561.005273:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16439
00000100:00100000:2.0:1789431561.005281:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+111:2348:x1876351933429248:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.005289:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.005294:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 0000000079975aaf/0xd8e438fb6352406b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x506:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83f5 expref: 111 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.005306:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000079975aaf/0xd8e438fb6352406b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x506:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83f5 expref: 111 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.005319:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079975aaf/0xd8e438fb6352406b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x506:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83f5 expref: 111 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.005331:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x506:0x0].0x0 since=1s v=(0 0)
00010000:00010000:2.0:1789431561.005334:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x506:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.005339:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63524f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x506:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.005347:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63524f67 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x506:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.005367:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.005385:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+110:2348:x1876351933429248:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 104us (3657us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.005392:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16439
00000100:00100000:2.0:1789431561.005409:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16440
00000100:00100000:2.0:1789431561.005417:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+127:2347:x1876351933429120:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.005426:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.005432:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cf2f1417/0xd8e438fb63523d3f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x504:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8300 expref: 127 pid: 14486 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.005444:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cf2f1417/0xd8e438fb63523d3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x504:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8300 expref: 127 pid: 14486 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.005457:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x504:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.005461:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x504:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.005466:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aaf53891/0xd8e438fb63524f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x504:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.005474:0:14482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3312:x1876351894204416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 52947us (53398us total) trans 4294969599 rc 0/0
00010000:00010000:2.0:1789431561.005477:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf53891/0xd8e438fb63524f6e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x504:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.005489:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8237
00010000:00010000:2.0:1789431561.005501:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431561.005515:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00000100:00100000:2.0:1789431561.005522:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+127:2347:x1876351933429120:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 104us (3808us total) trans 0 rc 0/0
00010000:00010000:1.0:1789431561.005524:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524f28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.005534:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16440
00010000:00010000:1.0:1789431561.005541:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431561.005546:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524f28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.005555:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524f28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.005569:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524f28 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.005577:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa6bbca6/0xd8e438fb63524f28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.005595:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431561.005599:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524f52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.005605:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431561.005608:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524f52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.005616:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524f52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.005627:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524f52 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.005634:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bf89bc7/0xd8e438fb63524f52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.005718:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.005720:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.005722:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.005734:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63524f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.005753:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63524f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.005762:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63524f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.005769:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63524f67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.005785:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431561.006014:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431561.006022:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63524f67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006032:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431561.006035:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63524f67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006044:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63524f67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006076:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63524f67 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006083:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af887e3b/0xd8e438fb63524f67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006103:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.006106:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431561.006106:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+109:2350:x1876351933428224:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 2181us (4604us total) trans 0 rc 0/0
00010000:00010000:0.0:1789431561.006110:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431561.006119:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16434
00010000:00010000:0.0:1789431561.006169:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d72421c/0xd8e438fb63523391 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c800c expref: 126 pid: 14482 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.006191:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:14502:1876351894205568:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431561.006199:0:14501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb63524ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.006211:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb63524ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006214:0:14502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000028dfb62f/0xd8e438fb63524f13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.006224:0:14501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb63524ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006229:0:14502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000028dfb62f/0xd8e438fb63524f13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.006239:0:14501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb63524ef7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006244:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dfb62f/0xd8e438fb63524f13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006262:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dfb62f/0xd8e438fb63524f13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.006269:0:14501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431561.006271:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dfb62f/0xd8e438fb63524f13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006293:0:14502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:1.0:1789431561.006385:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3313:x1876351894206976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 37865us (38007us total) trans 4294969988 rc 0/0
00000100:00100000:1.0:1789431561.006394:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8240
00010000:00010000:1.0:1789431561.006422:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1789431561.006429:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb63524ef7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.006438:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb2e000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431561.006441:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb63524ef7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.006450:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb63524ef7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.006468:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb63524ef7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.006476:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003102b737/0xd8e438fb63524ef7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.006501:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00000100:00100000:3.0:1789431561.006504:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+30:3313:x1876351894203392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 63675us (65263us total) trans 4294969989 rc 0/0
00010000:00010000:1.0:1789431561.006506:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dfb62f/0xd8e438fb63524f13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.006519:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8227
00010000:00010000:1.0:1789431561.006520:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6a600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431561.006526:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dfb62f/0xd8e438fb63524f13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.006533:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dfb62f/0xd8e438fb63524f13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.006539:0:14502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+29:3313:x1876351894204160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 57645us (64093us total) trans 4294969600 rc 0/0
00000100:00100000:0.0:1789431561.006550:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8231
00010000:00010000:3.0:1789431561.006551:0:14505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009f3ab8f/0xd8e438fb63524f05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.006552:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dfb62f/0xd8e438fb63524f13 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.006571:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dfb62f/0xd8e438fb63524f13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.006589:0:14505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009f3ab8f/0xd8e438fb63524f05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.006590:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.006593:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.006597:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431561.006605:0:14505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009f3ab8f/0xd8e438fb63524f05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.006606:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.006612:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004010fb47/0xd8e438fb6352393a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x501:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c81c5 expref: 125 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.006617:0:14505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009f3ab8f/0xd8e438fb63524f05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.006634:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14468:1876351894205696:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431561.006641:0:14505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431561.006664:0:14468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000852db662/0xd8e438fb63524f1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006674:0:14468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000852db662/0xd8e438fb63524f1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006682:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000852db662/0xd8e438fb63524f1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006691:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000852db662/0xd8e438fb63524f1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006698:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000852db662/0xd8e438fb63524f1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006717:0:14468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:3.0:1789431561.006810:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+30:3312:x1876351894203136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 63655us (65420us total) trans 4294969990 rc 0/0
00000100:00100000:3.0:1789431561.006818:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8229
00000100:00100000:0.0:1789431561.006889:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3313:x1876351894204672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 57709us (64383us total) trans 4294969601 rc 0/0
00000100:00100000:0.0:1789431561.006896:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8232
00010000:00010000:0.0:1789431561.006914:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:0.0:1789431561.006919:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009f3ab8f/0xd8e438fb63524f05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006926:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431561.006930:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009f3ab8f/0xd8e438fb63524f05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006943:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009f3ab8f/0xd8e438fb63524f05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006954:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009f3ab8f/0xd8e438fb63524f05 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006962:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009f3ab8f/0xd8e438fb63524f05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006976:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431561.006980:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000852db662/0xd8e438fb63524f1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006987:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6b800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431561.006990:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000852db662/0xd8e438fb63524f1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.006998:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000852db662/0xd8e438fb63524f1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.007009:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000852db662/0xd8e438fb63524f1a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.007017:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000852db662/0xd8e438fb63524f1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x501:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.007036:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.007038:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.007040:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.007045:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.007074:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.007105:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000983102ae/0xd8e438fb635234d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8067 expref: 124 pid: 14468 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.007116:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1876351894205824:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431561.007132:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007fab003c/0xd8e438fb63524f21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.007141:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007fab003c/0xd8e438fb63524f21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.007149:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fab003c/0xd8e438fb63524f21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.007157:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fab003c/0xd8e438fb63524f21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.007164:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fab003c/0xd8e438fb63524f21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.007183:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431561.007312:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3313:x1876351894204288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 56935us (64753us total) trans 4294969602 rc 0/0
00000100:00100000:0.0:1789431561.007319:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8233
00000004:00080000:0.0:1789431561.007363:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2d508e00/2, rc 0, transno 4294969988
00000100:00100000:0.0:1789431561.007380:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894206976:0@lo:6:osp-syn-1-0.0
00000004:00080000:0.0:1789431561.007393:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3b3b2a00/2, rc 0, transno 4294969987
00000100:00100000:0.0:1789431561.007397:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894205440:0@lo:6:osp-syn-1-0.0
00000004:00080000:0.0:1789431561.007410:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce156b2d80/2, rc 0, transno 4294969602
00000100:00100000:0.0:1789431561.007423:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894204288:0@lo:6:osp-syn-0-0.0
00000004:00080000:0.0:1789431561.007433:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce156b0380/2, rc 0, transno 4294969600
00000100:00100000:0.0:1789431561.007437:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894204160:0@lo:6:osp-syn-0-0.0
00000004:00080000:0.0:1789431561.007445:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce156b2680/2, rc 0, transno 4294969601
00000100:00100000:0.0:1789431561.007448:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894204672:0@lo:6:osp-syn-0-0.0
00000004:00080000:0.0:1789431561.007460:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3b3b1180/2, rc 0, transno 4294969985
00000100:00100000:0.0:1789431561.007464:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894203520:0@lo:6:osp-syn-1-0.0
00000004:00080000:0.0:1789431561.007473:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3b3b3800/2, rc 0, transno 4294969989
00000100:00100000:0.0:1789431561.007477:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894203392:0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431561.007602:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894208256:0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431561.007646:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431561.007680:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1789431561.007686:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894207872:0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431561.007708:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:3.0:1789431561.007753:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431561.007761:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fab003c/0xd8e438fb63524f21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.007773:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ce6aa00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431561.007778:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fab003c/0xd8e438fb63524f21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.007788:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fab003c/0xd8e438fb63524f21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.007802:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00010000:00010000:3.0:1789431561.007808:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fab003c/0xd8e438fb63524f21 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.007812:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894208384:0@lo:6:osp-syn-0-0.0
00010000:00010000:3.0:1789431561.007825:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fab003c/0xd8e438fb63524f21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.007848:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431561.007849:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:3.0:1789431561.007852:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431561.007856:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431561.007887:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894208256
00000100:00100000:0.0:1789431561.007895:0:14464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894208256
00000100:00100000:0.0:1789431561.007939:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894207872
00000100:00100000:0.0:1789431561.007943:0:14464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894207872
00000100:00100000:0.0:1789431561.007962:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894208384
00000100:00100000:0.0:1789431561.007965:0:14464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894208384
00000100:00100000:0.0:1789431561.008012:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8244
00000100:00100000:0.0:1789431561.008023:0:14464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3311:x1876351894208256:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431561.008073:0:14464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1291 count 1
00010000:00010000:0.0:1789431561.008101:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63524fb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x50b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.008120:0:14464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002cfe7545/0xd8e438fb635245ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x50b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8568 expref: 108 pid: 14464 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.008130:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50b:0x0].0x0 since=2s v=(0 0)
00010000:00010000:0.0:1789431561.008134:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431561.008139:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63524fb4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x50b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.008169:0:14464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002cfe7545/0xd8e438fb635245ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8568 expref: 108 pid: 14464 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.008174:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8245
00010000:00010000:0.0:1789431561.008189:0:14464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002cfe7545/0xd8e438fb635245ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x50b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8568 expref: 108 pid: 14464 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.008191:0:14482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3311:x1876351894207872:12345-0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431561.008210:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14464:1876351894208768:192.168.203.4@tcp:104:
00002000:00080000:3.0:1789431561.008211:0:14482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1288 count 1
00010000:00010000:3.0:1789431561.008230:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095b38ee6/0xd8e438fb63524fbb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x508:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.008245:0:14482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000017a8e0de/0xd8e438fb6352428d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x508:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8488 expref: 108 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.008253:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x508:0x0].0x0 since=2s v=(0 0)
00000100:00100000:0.0:1789431561.008269:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf04968c00 going to sleep for 11 seconds
00000100:00080000:0.0:1789431561.008284:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1789431561.008299:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8246
00000100:00100000:0.0:1789431561.008306:0:14501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+29:3311:x1876351894208384:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431561.008321:0:14501:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1285 count 1
00010000:00010000:0.0:1789431561.008336:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b43bd3ce/0xd8e438fb63524fc2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x505:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.008349:0:14501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000569b40c5/0xd8e438fb63523ef1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x505:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8385 expref: 123 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.008356:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x505:0x0].0x0 since=2s v=(0 0)
00010000:00010000:0.0:1789431561.008360:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x505:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431561.008363:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b43bd3ce/0xd8e438fb63524fc2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x505:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.008372:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x508:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431561.008380:0:14482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095b38ee6/0xd8e438fb63524fbb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x508:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.008385:0:14501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000569b40c5/0xd8e438fb63523ef1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x505:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8385 expref: 123 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.008402:0:14501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000569b40c5/0xd8e438fb63523ef1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x505:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8385 expref: 123 pid: 14490 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.008415:0:14482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000017a8e0de/0xd8e438fb6352428d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x508:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8488 expref: 108 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.008416:0:14501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:14501:1876351894208896:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431561.008434:0:14482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000017a8e0de/0xd8e438fb6352428d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x508:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8488 expref: 108 pid: 8217 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.008447:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055378d58/0xd8e438fb63523b0f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x502:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8251 expref: 123 pid: 14497 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.008451:0:14501:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf04968e40 going to sleep for 11 seconds
00000100:00100000:3.0:1789431561.008456:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14482:1876351894209024:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431561.008477:0:14471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d509880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14471:1876351894206848:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431561.008485:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894208000:0@lo:6:osp-syn-1-0.0
00000100:00100000:3.0:1789431561.008489:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2d449d80 going to sleep for 11 seconds
00010000:00010000:1.0:1789431561.008502:0:14471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524f60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.008514:0:14471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524f60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.008520:0:14471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524f60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.008527:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1789431561.008536:0:14471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524f60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.008544:0:14471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524f60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.008561:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894208512:0@lo:6:osp-syn-0-0.0
00010000:00010000:1.0:1789431561.008564:0:14471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431561.008587:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431561.008609:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:0.0:1789431561.008616:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894208128:0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431561.008641:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431561.008659:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894208640:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431561.008679:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:0.0:1789431561.008703:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431561.008708:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524f60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.008716:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3c00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431561.008720:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524f60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.008729:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524f60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.008755:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524f60 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.008763:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035b28618/0xd8e438fb63524f60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x502:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.008784:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.008787:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.008788:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431561.008801:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894208000
00000100:00100000:0.0:1789431561.008807:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894208000
00000100:00100000:0.0:1789431561.008835:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894208512
00000100:00100000:0.0:1789431561.008838:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894208512
00000100:00100000:0.0:1789431561.008855:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894208128
00000100:00100000:0.0:1789431561.008858:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894208128
00000100:00100000:0.0:1789431561.008870:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894208640
00000100:00100000:0.0:1789431561.008873:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894208640
00000100:00100000:0.0:1789431561.008886:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8247
00000100:00100000:0.0:1789431561.008891:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3313:x1876351894208000:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431561.008905:0:14468:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1289 count 1
00010000:00010000:0.0:1789431561.008922:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d888fc6e/0xd8e438fb63524fc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x509:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.008937:0:14468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008999eb73/0xd8e438fb6352434a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x509:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84c0 expref: 108 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.008944:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x509:0x0].0x0 since=2s v=(0 0)
00010000:00010000:0.0:1789431561.008947:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x509:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431561.008951:0:14468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d888fc6e/0xd8e438fb63524fc9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x509:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.008973:0:14468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008999eb73/0xd8e438fb6352434a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x509:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84c0 expref: 108 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.008984:0:14468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008999eb73/0xd8e438fb6352434a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x509:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84c0 expref: 108 pid: 6699 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.008991:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8248
00000100:00100000:3.0:1789431561.009006:0:14505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+31:3313:x1876351894208512:12345-0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431561.009007:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14468:1876351894209152:192.168.203.4@tcp:104:
00002000:00080000:3.0:1789431561.009026:0:14505:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1286 count 1
00000100:00100000:0.0:1789431561.009036:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf04968180 going to sleep for 11 seconds
00010000:00010000:3.0:1789431561.009041:0:14505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb63524fd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x506:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.009079:0:14505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4a3acbe/0xd8e438fb63523fae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x506:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83bd expref: 122 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.009082:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8249
00010000:00010000:3.0:1789431561.009093:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x506:0x0].0x0 since=2s v=(0 0)
00000100:00100000:0.0:1789431561.009094:0:14491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+33:3313:x1876351894208128:12345-0@lo:6:osp-syn-1-0.0
00010000:00010000:3.0:1789431561.009099:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x506:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431561.009105:0:14505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb63524fd0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x506:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00080000:0.0:1789431561.009111:0:14491:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1290 count 1
00010000:00010000:0.0:1789431561.009128:0:14491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63524fd7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x50a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.009130:0:14505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4a3acbe/0xd8e438fb63523fae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x506:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83bd expref: 122 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.009155:0:14491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb63524477 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x50a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c850d expref: 108 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.009156:0:14505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4a3acbe/0xd8e438fb63523fae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x506:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83bd expref: 122 pid: 14469 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.009176:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50a:0x0].0x0 since=2s v=(0 0)
00010000:00010000:0.0:1789431561.009181:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50a:0x0].0x0 since=0s v=(0 0)
00000100:00100000:3.0:1789431561.009182:0:14505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:14505:1876351894209280:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431561.009188:0:14491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63524fd7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x50a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.009213:0:14505:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2d449180 going to sleep for 11 seconds
00010000:00010000:0.0:1789431561.009218:0:14491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb63524477 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c850d expref: 108 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.009231:0:14491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb63524477 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x50a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c850d expref: 108 pid: 14501 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.009235:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8250
00000100:00100000:3.0:1789431561.009248:0:14502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+31:3313:x1876351894208640:12345-0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431561.009250:0:14491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14491:1876351894209408:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431561.009279:0:14491:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf04968900 going to sleep for 11 seconds
00010000:00010000:0.0:1789431561.009333:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a11e56e8/0xd8e438fb63523703 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x500:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8116 expref: 122 pid: 14505 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.009348:0:14472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14472:1876351894206208:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431561.009377:0:14472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63524f4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00080000:3.0:1789431561.009379:0:14502:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1287 count 1
00010000:00010000:0.0:1789431561.009391:0:14472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63524f4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.009398:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb63524fde lrc: 3/0,1 mode: --/PW res: [0x240000400:0x507:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.009399:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63524f4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.009423:0:14472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63524f4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.009426:0:14502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cbb0e5a/0xd8e438fb635240c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x507:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8403 expref: 121 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.009442:0:14472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63524f4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.009445:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x507:0x0].0x0 since=2s v=(0 0)
00010000:00010000:3.0:1789431561.009453:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x507:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431561.009461:0:14502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb63524fde lrc: 4/0,1 mode: --/PW res: [0x240000400:0x507:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.009473:0:14472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431561.009485:0:14502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005cbb0e5a/0xd8e438fb635240c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x507:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8403 expref: 121 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.009498:0:14502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005cbb0e5a/0xd8e438fb635240c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x507:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8403 expref: 121 pid: 14500 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.009509:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:14502:1876351894209536:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431561.009546:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2d449a80 going to sleep for 11 seconds
00000100:00100000:0.0:1789431561.009673:0:14472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3312:x1876351894204544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 57268us (58952us total) trans 4294969604 rc 0/0
00000100:00100000:0.0:1789431561.009680:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8236
00010000:00010000:0.0:1789431561.009706:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431561.009712:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63524f4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.009722:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431561.009725:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63524f4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.009733:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63524f4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.010236:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3312:x1876351894206720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 52259us (52469us total) trans 4294969603 rc 0/0
00000100:00100000:1.0:1789431561.010247:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8239
00000004:00080000:1.0:1789431561.010765:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3bbf4380/2, rc 0, transno 4294969603
00000100:00100000:1.0:1789431561.011123:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894206720:0@lo:6:osp-syn-0-0.0
00000004:00080000:1.0:1789431561.011148:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce156b1880/2, rc 0, transno 4294969599
00000100:00100000:2.0:1789431561.011322:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.011388:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.011416:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933429504
00000100:00100000:2.0:1789431561.011423:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933429504
00010000:00010000:2.0:1789431561.011462:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009cf5851c/0xd8e438fb635241c9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x507:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8450 expref: 109 pid: 6698 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.011510:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16441
00000100:00100000:2.0:1789431561.011521:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+109:2347:x1876351933429504:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.011536:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.011542:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009cf5851c/0xd8e438fb635241c9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x507:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8450 expref: 109 pid: 6698 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.011563:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009cf5851c/0xd8e438fb635241c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x507:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8450 expref: 109 pid: 6698 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.011583:0:8217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8217:1876351894207744:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431561.011592:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cf5851c/0xd8e438fb635241c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x507:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8450 expref: 109 pid: 6698 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.011611:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x507:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.011615:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x507:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.011622:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3a13eab/0xd8e438fb63524f98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x507:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.011719:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894204416:0@lo:6:osp-syn-0-0.0
00010000:00010000:2.0:1789431561.011719:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3a13eab/0xd8e438fb63524f98 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x507:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00080000:1.0:1789431561.011753:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce156b2300/2, rc 0, transno 4294969604
00010000:00010000:3.0:1789431561.011757:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d3a13eab/0xd8e438fb63524f98 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x507:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.011762:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894204544:0@lo:6:osp-syn-0-0.0
00010000:00010000:2.0:1789431561.011762:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431561.011778:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d3a13eab/0xd8e438fb63524f98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.011786:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3a13eab/0xd8e438fb63524f98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00080000:1.0:1789431561.011798:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3b3b0000/2, rc 0, transno 4294969990
00010000:00010000:3.0:1789431561.011798:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3a13eab/0xd8e438fb63524f98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.011805:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+108:2347:x1876351933429504:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 282us (413us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.011817:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894203136:0@lo:6:osp-syn-1-0.0
00010000:00010000:3.0:1789431561.011818:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3a13eab/0xd8e438fb63524f98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.011824:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16441
00000004:00080000:1.0:1789431561.011838:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3b3b0700/2, rc 0, transno 4294969986
00000100:00100000:1.0:1789431561.011845:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894203648:0@lo:6:osp-syn-1-0.0
00010000:00010000:3.0:1789431561.011849:0:8217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:1.0:1789431561.011866:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce029f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894209792:0@lo:6:osp-syn-0-0.0
00010000:00010000:2.0:1789431561.011890:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf2f1417/0xd8e438fb63523d3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x504:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8300 expref: 121 pid: 14486 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.011905:0:14500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a047100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:14500:1876351894207360:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431561.011917:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:2.0:1789431561.011921:0:14500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aaf53891/0xd8e438fb63524f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.011931:0:14500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aaf53891/0xd8e438fb63524f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.011939:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf53891/0xd8e438fb63524f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.011948:0:14500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf53891/0xd8e438fb63524f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.011952:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00010000:00010000:2.0:1789431561.011960:0:14500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf53891/0xd8e438fb63524f6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.011964:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce029f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894209664:0@lo:6:osp-syn-0-0.0
00010000:00010000:2.0:1789431561.011985:0:14500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:2.0:1789431561.011998:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00000100:00100000:1.0:1789431561.012004:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:2.0:1789431561.012007:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3a13eab/0xd8e438fb63524f98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.012018:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431561.012024:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3a13eab/0xd8e438fb63524f98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.012034:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3a13eab/0xd8e438fb63524f98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.012075:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3a13eab/0xd8e438fb63524f98 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.012085:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3a13eab/0xd8e438fb63524f98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.012108:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431561.012113:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf53891/0xd8e438fb63524f6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.012120:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ae59600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431561.012124:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf53891/0xd8e438fb63524f6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.012133:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf53891/0xd8e438fb63524f6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.012146:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf53891/0xd8e438fb63524f6e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.012154:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf53891/0xd8e438fb63524f6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x504:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.012180:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.012182:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.012185:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431561.012231:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3311:x1876351894207616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13962us (15071us total) trans 4294969991 rc 0/0
00000100:00100000:3.0:1789431561.012242:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8243
00000100:00100000:3.0:1789431561.012266:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933429376
00000100:00100000:3.0:1789431561.012272:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933429376
00000100:00100000:3.0:1789431561.012486:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894209792
00000100:00100000:3.0:1789431561.012491:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894209792
00000100:00100000:3.0:1789431561.012515:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894209664
00000100:00100000:3.0:1789431561.012518:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894209664
00000100:00100000:1.0:1789431561.012534:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8251
00000100:00100000:3.0:1789431561.012548:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8252
00000100:00100000:1.0:1789431561.012556:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8253
00000100:00100000:3.0:1789431561.012559:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3312:x1876351894209792:12345-0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431561.012569:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3312:x1876351894209664:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:1.0:1789431561.012587:0:14471:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1288 count 1
00002000:00080000:3.0:1789431561.012587:0:8217:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1289 count 1
00010000:00010000:1.0:1789431561.012613:0:14471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63524fe5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x508:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.012631:0:14471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c35d39f9/0xd8e438fb635241d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x508:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8457 expref: 120 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.012652:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x508:0x0].0x0 since=2s v=(0 0)
00010000:00010000:1.0:1789431561.012656:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x508:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431561.012660:0:14471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63524fe5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x508:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.012680:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524fec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x509:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.012689:0:14471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c35d39f9/0xd8e438fb635241d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x508:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8457 expref: 120 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.012699:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009bca4ae2/0xd8e438fb63524320 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x509:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84b2 expref: 120 pid: 14486 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.012708:0:14471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c35d39f9/0xd8e438fb635241d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x508:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8457 expref: 120 pid: 6700 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.012710:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x509:0x0].0x0 since=2s v=(0 0)
00010000:00010000:3.0:1789431561.012718:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x509:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431561.012726:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524fec lrc: 4/0,1 mode: --/PW res: [0x240000400:0x509:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.012733:0:14471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d509880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14471:1876351894210048:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431561.012764:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009bca4ae2/0xd8e438fb63524320 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x509:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84b2 expref: 120 pid: 14486 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.012775:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009bca4ae2/0xd8e438fb63524320 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x509:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84b2 expref: 120 pid: 14486 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.012787:0:8217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce029f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8217:1876351894210176:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431561.012805:0:14471:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1180 going to sleep for 11 seconds
00000100:00100000:3.0:1789431561.012817:0:8217:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf08746900 going to sleep for 11 seconds
00000100:00100000:1.0:1789431561.012856:0:14490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+108:2347:x1876351933429376:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.012868:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.012886:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b5f4b29/0xd8e438fb63524ff3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c87f3 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789431561.012909:0:14490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x512:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:1.0:1789431561.012924:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x512:0x0].0x0 since=3019s v=(0 0)
00010000:00010000:1.0:1789431561.012928:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x512:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431561.012936:0:14490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b5f4b29/0xd8e438fb63524ff3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87f3 expref: 109 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.012951:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b5f4b29/0xd8e438fb63524ff3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87f3 expref: 109 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.012969:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b5e1800, rc 0)
00000100:00100000:1.0:1789431561.013003:0:14490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+109:2347:x1876351933429376:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 458us (1684us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.013010:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8251
00000100:00100000:2.0:1789431561.014144:0:14500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+34:3313:x1876351894207232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 41958us (42164us total) trans 4294969605 rc 0/0
00000100:00100000:2.0:1789431561.014159:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8241
00000004:00080000:1.0:1789431561.014255:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2d50a300/2, rc 0, transno 4294969991
00000100:00100000:1.0:1789431561.014265:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894207616:0@lo:6:osp-syn-1-0.0
00010000:00010000:1.0:1789431561.014319:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efaed3dd/0xd8e438fb63523264 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7fb8 expref: 120 pid: 14472 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.014339:0:14497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14497:1876351894206080:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431561.014369:0:14497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005b5f53c0/0xd8e438fb63524f44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.014381:0:14497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005b5f53c0/0xd8e438fb63524f44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.014389:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b5f53c0/0xd8e438fb63524f44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.014401:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b5f53c0/0xd8e438fb63524f44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.014410:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b5f53c0/0xd8e438fb63524f44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.014447:0:14497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431561.014774:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431561.014782:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b5f53c0/0xd8e438fb63524f44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.014792:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431561.014797:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b5f53c0/0xd8e438fb63524f44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.014807:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b5f53c0/0xd8e438fb63524f44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.014828:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b5f53c0/0xd8e438fb63524f44 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.014835:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b5f53c0/0xd8e438fb63524f44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.014858:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.014860:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.014863:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431561.014873:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+34:3312:x1876351894204032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 62688us (64214us total) trans 4294969606 rc 0/0
00000100:00100000:1.0:1789431561.014883:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8235
00010000:00010000:1.0:1789431561.015043:0:14499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e6d2028/0xd8e438fb63523f84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x505:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83af expref: 108 pid: 14501 timeout: 3118 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.015082:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:14499:1876351894206592:192.168.203.4@tcp:104:
00000004:00080000:3.0:1789431561.015084:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce156b3b80/2, rc 0, transno 4294969606
00000100:00100000:3.0:1789431561.015107:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894204032:0@lo:6:osp-syn-0-0.0
00010000:00010000:1.0:1789431561.015109:0:14499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb63524f59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.015186:0:14499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb63524f59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.015195:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb63524f59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.015203:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb63524f59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.015211:0:14499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb63524f59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.015233:0:14499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431561.015304:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431561.015311:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb63524f59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.015320:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431561.015323:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb63524f59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.015332:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb63524f59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.015346:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb63524f59 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.015353:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb63524f59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.015373:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.015375:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.015379:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431561.015432:0:14499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+34:3311:x1876351894206464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 62536us (62757us total) trans 4294969992 rc 0/0
00000100:00100000:1.0:1789431561.015441:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8238
00000004:00080000:2.0:1789431561.015761:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3bbf7b80/2, rc 0, transno 4294969992
00000100:00100000:2.0:1789431561.015768:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894206464:0@lo:6:osp-syn-1-0.0
00010000:00010000:2.0:1789431561.016225:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431561.016259:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894210560:0@lo:6:osp-syn-1-0.0
00000100:00100000:2.0:1789431561.016320:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431561.016365:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1789431561.016373:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894210432:0@lo:6:osp-syn-1-0.0
00000100:00100000:2.0:1789431561.016400:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431561.016435:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894210560
00000100:00100000:2.0:1789431561.016443:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894210560
00000100:00100000:2.0:1789431561.016495:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894210432
00000100:00100000:2.0:1789431561.016499:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894210432
00000100:00100000:1.0:1789431561.016510:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8254
00000100:00100000:1.0:1789431561.016524:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+35:3312:x1876351894210560:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431561.016558:0:14497:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1293 count 1
00010000:00010000:1.0:1789431561.016593:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ffa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x50d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.016616:0:14497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb63524875 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x50d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c863a expref: 107 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.016626:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50d:0x0].0x0 since=1s v=(0 0)
00010000:00010000:1.0:1789431561.016631:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50d:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431561.016887:0:14497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ffa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x50d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.016931:0:14497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb63524875 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c863a expref: 107 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.016946:0:14497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb63524875 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x50d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c863a expref: 107 pid: 8217 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.016961:0:14497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:14497:1876351894210944:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431561.017045:0:14497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1f00 going to sleep for 11 seconds
00010000:00010000:0.0:1789431561.017855:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63524f4b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.017872:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63524f4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x500:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.017928:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894209920:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431561.017987:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431561.018017:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894210688:0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431561.018039:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000004:00080000:0.0:1789431561.018120:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce3a046d80/2, rc 0, transno 4294969605
00000100:00100000:0.0:1789431561.018133:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894207232:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431561.018147:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:0.0:1789431561.018153:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894210304:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431561.018176:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431561.018202:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894210816:0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431561.018227:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431561.018306:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894211072:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431561.018336:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894209920
00000100:00100000:0.0:1789431561.018338:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431561.018346:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894209920
00000100:00100000:0.0:1789431561.018376:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894210688
00000100:00100000:0.0:1789431561.018381:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894210688
00000100:00100000:1.0:1789431561.021335:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:8065:x1876351894207488:12345-0@lo:5:osp-pre-1-0.0 Request processed in 30414us (31228us total) trans 4294969993 rc 0/0
00000100:00100000:2.0:1789431561.025206:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894210304
00000100:00100000:2.0:1789431561.025230:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894210304
00000100:00100000:2.0:1789431561.025288:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894210816
00000100:00100000:2.0:1789431561.025291:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894210816
00000100:00100000:2.0:1789431561.025308:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894211072
00000100:00100000:2.0:1789431561.025311:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894211072
00000100:00100000:2.0:1789431561.025332:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8255
00000100:00100000:2.0:1789431561.025343:0:14500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+38:3312:x1876351894210432:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:2.0:1789431561.025385:0:14500:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1292 count 1
00010000:00010000:2.0:1789431561.025423:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8eaf536/0xd8e438fb63525001 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x50c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.025453:0:14500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003662928/0xd8e438fb63524710 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x50c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85d1 expref: 107 pid: 14491 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.025463:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50c:0x0].0x0 since=1s v=(0 0)
00010000:00010000:2.0:1789431561.025469:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.025474:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8eaf536/0xd8e438fb63525001 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x50c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.025524:0:14500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003662928/0xd8e438fb63524710 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85d1 expref: 107 pid: 14491 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.025538:0:14500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003662928/0xd8e438fb63524710 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x50c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85d1 expref: 107 pid: 14491 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.025555:0:14500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a044e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:14500:1876351894211200:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431561.025689:0:14500:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3e6d1300 going to sleep for 11 seconds
00000100:00100000:2.0:1789431561.027184:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8256
00000100:00100000:2.0:1789431561.027212:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3313:x1876351894210304:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431561.027252:0:6699:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1291 count 1
00010000:00010000:2.0:1789431561.027288:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f909f98a/0xd8e438fb63525008 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x50b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.027315:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d98238d4/0xd8e438fb635244f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x50b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8530 expref: 119 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.027325:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50b:0x0].0x0 since=2s v=(0 0)
00010000:00010000:2.0:1789431561.027330:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.027335:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f909f98a/0xd8e438fb63525008 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x50b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.027375:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d98238d4/0xd8e438fb635244f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8530 expref: 119 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.027391:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d98238d4/0xd8e438fb635244f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x50b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8530 expref: 119 pid: 14469 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.027408:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a047100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1876351894211328:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431561.027524:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3e6d1b40 going to sleep for 11 seconds
00000100:00100000:0.0:1789431561.030824:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8257
00000100:00100000:0.0:1789431561.030856:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3313:x1876351894210816:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431561.030902:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1295 count 1
00010000:00010000:0.0:1789431561.030942:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e5af751/0xd8e438fb6352500f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x50f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.030970:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a09022e/0xd8e438fb63524b00 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x50f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86f7 expref: 107 pid: 14468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.030981:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50f:0x0].0x0 since=1s v=(0 0)
00010000:00010000:0.0:1789431561.030986:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50f:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431561.030991:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e5af751/0xd8e438fb6352500f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x50f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.031038:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a09022e/0xd8e438fb63524b00 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86f7 expref: 107 pid: 14468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.031924:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a09022e/0xd8e438fb63524b00 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x50f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86f7 expref: 107 pid: 14468 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.031951:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1876351894211456:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431561.032226:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065ec00 going to sleep for 11 seconds
00000100:00100000:0.0:1789431561.032301:0:8065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8065:1876351894207488:0@lo:5:osp-pre-1-0.0
00000004:00080000:0.0:1789431561.032321:0:8065:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x512:0x0]-[0x280000400:0x541:0x0]
00000100:00100000:0.0:1789431561.032366:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8258
00000100:00100000:0.0:1789431561.032383:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3311:x1876351894211072:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431561.032411:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1292 count 1
00010000:00010000:0.0:1789431561.032440:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b9f3956/0xd8e438fb63525016 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x50c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.032459:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000060ea8e37/0xd8e438fb6352463e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x50c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8592 expref: 119 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.032468:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50c:0x0].0x0 since=1s v=(0 0)
00010000:00010000:0.0:1789431561.032472:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431561.032477:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b9f3956/0xd8e438fb63525016 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x50c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.032509:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000060ea8e37/0xd8e438fb6352463e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8592 expref: 119 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.032520:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000060ea8e37/0xd8e438fb6352463e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x50c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8592 expref: 119 pid: 14500 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.032532:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1876351894211584:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431561.032622:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e180 going to sleep for 11 seconds
00000100:00100000:0.0:1789431561.032839:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8259
00000100:00100000:0.0:1789431561.032854:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3313:x1876351894209920:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431561.032872:0:14486:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1290 count 1
00010000:00010000:0.0:1789431561.032888:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb6352501d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x50a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.032902:0:14486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb63524431 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x50a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84ff expref: 119 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.032910:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50a:0x0].0x0 since=2s v=(0 0)
00010000:00010000:0.0:1789431561.032914:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50a:0x0].0x0 since=0s v=(0 0)
00000100:00100000:1.0:1789431561.032916:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8242
00010000:00010000:0.0:1789431561.032920:0:14486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb6352501d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x50a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.032948:0:14486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb63524431 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84ff expref: 119 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.032960:0:14486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb63524431 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x50a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84ff expref: 119 pid: 14490 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.032963:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8260
00000100:00100000:0.0:1789431561.032978:0:14486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14486:1876351894211712:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431561.032980:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3313:x1876351894210688:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431561.033002:0:14469:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1294 count 1
00000100:00100000:0.0:1789431561.033026:0:14486:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf0552ccc0 going to sleep for 11 seconds
00010000:00010000:1.0:1789431561.033026:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63525024 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x50e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.033045:0:14469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008a0f0e7e/0xd8e438fb635249d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x50e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c869c expref: 107 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.033083:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50e:0x0].0x0 since=1s v=(0 0)
00010000:00010000:1.0:1789431561.033086:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431561.033089:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.033091:0:14469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63525024 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x50e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.033093:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.033097:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.033122:0:14469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008a0f0e7e/0xd8e438fb635249d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c869c expref: 107 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.033135:0:14469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008a0f0e7e/0xd8e438fb635249d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x50e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c869c expref: 107 pid: 6699 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.033146:0:14469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14469:1876351894211840:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431561.033182:0:14469:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c13c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431561.042393:0:14464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14464:1876351894208768:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431561.042408:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14482:1876351894209024:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431561.042447:0:14464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63524fb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x50b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.042447:0:14482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000095b38ee6/0xd8e438fb63524fbb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x508:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.042453:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.042493:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.042509:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933429632
00000100:00100000:0.0:1789431561.042511:0:14501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:14501:1876351894208896:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431561.042519:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933429632
00000100:00100000:1.0:1789431561.042526:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431561.042533:0:14501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b43bd3ce/0xd8e438fb63524fc2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x505:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.042567:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002cfe7545/0xd8e438fb635245ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x50b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8568 expref: 108 pid: 14464 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.042585:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14468:1876351894209152:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431561.042597:0:14468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d888fc6e/0xd8e438fb63524fc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x509:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.042833:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933429888
00000100:00100000:3.0:1789431561.042838:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933429888
00010000:00010000:3.0:1789431561.042855:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000017a8e0de/0xd8e438fb6352428d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x508:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8488 expref: 109 pid: 8217 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.042911:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933429760
00000100:00100000:2.0:1789431561.042916:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933429760
00010000:00010000:2.0:1789431561.042939:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000569b40c5/0xd8e438fb63523ef1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x505:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8385 expref: 120 pid: 14490 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.042977:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16442
00000100:00100000:2.0:1789431561.042989:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+109:2347:x1876351933429632:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.043009:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.043016:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002cfe7545/0xd8e438fb635245ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x50b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8568 expref: 109 pid: 14464 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.043031:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002cfe7545/0xd8e438fb635245ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8568 expref: 109 pid: 14464 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.043109:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cfe7545/0xd8e438fb635245ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x50b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8568 expref: 109 pid: 14464 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.043129:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.043134:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.043141:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63524fb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.043152:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63524fb4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x50b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.043184:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431561.043291:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16443
00000100:00100000:0.0:1789431561.043301:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e956850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+108:2347:x1876351933429888:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431561.043310:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431561.043316:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000017a8e0de/0xd8e438fb6352428d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x508:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8488 expref: 108 pid: 8217 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.043337:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000017a8e0de/0xd8e438fb6352428d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x508:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8488 expref: 108 pid: 8217 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.043352:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017a8e0de/0xd8e438fb6352428d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x508:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8488 expref: 108 pid: 8217 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.043362:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x508:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431561.043366:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x508:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431561.043369:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000095b38ee6/0xd8e438fb63524fbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x508:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.043377:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095b38ee6/0xd8e438fb63524fbb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x508:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.043398:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431561.043457:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16444
00000100:00100000:3.0:1789431561.043466:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+120:2347:x1876351933429760:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431561.043475:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431561.043480:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000569b40c5/0xd8e438fb63523ef1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x505:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8385 expref: 120 pid: 14490 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.043492:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000569b40c5/0xd8e438fb63523ef1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x505:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8385 expref: 120 pid: 14490 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.043508:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000569b40c5/0xd8e438fb63523ef1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x505:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8385 expref: 120 pid: 14490 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.043520:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x505:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431561.043523:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x505:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431561.043528:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b43bd3ce/0xd8e438fb63524fc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x505:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.043537:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b43bd3ce/0xd8e438fb63524fc2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x505:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.043557:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431561.047409:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.048248:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.048294:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.048310:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.048323:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.048337:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.048440:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.048534:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933430016
00000100:00100000:2.0:1789431561.048548:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933430016
00010000:00010000:2.0:1789431561.048659:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008999eb73/0xd8e438fb6352434a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x509:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84c0 expref: 108 pid: 6699 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.048696:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933430272
00000100:00100000:2.0:1789431561.048700:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933430272
00010000:00010000:2.0:1789431561.048722:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4a3acbe/0xd8e438fb63523fae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x506:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83bd expref: 120 pid: 14469 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.048736:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933430528
00000100:00100000:2.0:1789431561.048739:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933430528
00010000:00010000:2.0:1789431561.048767:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005cbb0e5a/0xd8e438fb635240c6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x507:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8403 expref: 121 pid: 14500 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.048781:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933430400
00000100:00100000:2.0:1789431561.048784:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933430400
00010000:00010000:2.0:1789431561.048796:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb63524477 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x50a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c850d expref: 109 pid: 14501 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.048807:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933430656
00000100:00100000:2.0:1789431561.048810:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933430656
00010000:00010000:2.0:1789431561.048823:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c35d39f9/0xd8e438fb635241d0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x508:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8457 expref: 122 pid: 6700 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.048834:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933430784
00000100:00100000:2.0:1789431561.048837:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933430784
00010000:00010000:2.0:1789431561.048852:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009bca4ae2/0xd8e438fb63524320 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x509:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84b2 expref: 123 pid: 14486 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.048869:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16445
00000100:00100000:2.0:1789431561.048881:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+109:2347:x1876351933430016:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.048906:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.048913:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008999eb73/0xd8e438fb6352434a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x509:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84c0 expref: 109 pid: 6699 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.048929:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008999eb73/0xd8e438fb6352434a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x509:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84c0 expref: 109 pid: 6699 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.048960:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008999eb73/0xd8e438fb6352434a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x509:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84c0 expref: 109 pid: 6699 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.048983:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x509:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.048988:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x509:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.048995:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d888fc6e/0xd8e438fb63524fc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x509:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.049006:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d888fc6e/0xd8e438fb63524fc9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x509:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.049042:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.049123:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+108:2347:x1876351933430016:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 242us (1739us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.049132:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16445
00000100:00100000:1.0:1789431561.049143:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.049157:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933431040
00000100:00100000:2.0:1789431561.049162:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933431040
00000100:00100000:1.0:1789431561.049169:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431561.049181:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003662928/0xd8e438fb63524710 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x50c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85d1 expref: 108 pid: 14491 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.049198:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933431296
00000100:00100000:2.0:1789431561.049202:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933431296
00000100:00100000:1.0:1789431561.049204:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431561.049218:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a09022e/0xd8e438fb63524b00 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x50f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86f7 expref: 109 pid: 14468 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.049229:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.049236:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933430912
00000100:00100000:2.0:1789431561.049240:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933430912
00010000:00010000:2.0:1789431561.049256:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb63524875 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x50d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c863a expref: 110 pid: 8217 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.049267:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.049275:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933431168
00000100:00100000:2.0:1789431561.049278:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933431168
00010000:00010000:2.0:1789431561.049294:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d98238d4/0xd8e438fb635244f5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x50b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8530 expref: 124 pid: 14469 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.049308:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933430144
00000100:00100000:2.0:1789431561.049313:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16446
00000100:00100000:1.0:1789431561.049316:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933430144
00000100:00100000:2.0:1789431561.049324:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+124:2347:x1876351933430272:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.049336:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.049342:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4a3acbe/0xd8e438fb63523fae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x506:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83bd expref: 124 pid: 14469 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.049360:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4a3acbe/0xd8e438fb63523fae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x506:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83bd expref: 124 pid: 14469 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.049366:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295795
00000100:00100000:1.0:1789431561.049380:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+259:14616:x1876351933430144:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.049383:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x506:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.049388:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x506:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.049393:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb63524fd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x506:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.049402:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb63524fd0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x506:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.049405:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.049419:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431561.049433:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb6352502b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c87fa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.049445:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+124:2347:x1876351933430272:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 122us (1148us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.049452:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16446
00000100:00100000:2.0:1789431561.049467:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16447
00000100:00100000:2.0:1789431561.049475:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+123:2347:x1876351933430528:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.049484:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.049490:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005cbb0e5a/0xd8e438fb635240c6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x507:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8403 expref: 123 pid: 14500 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.049500:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005cbb0e5a/0xd8e438fb635240c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x507:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8403 expref: 123 pid: 14500 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.049521:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x507:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.049525:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x507:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431561.049528:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525032 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.049530:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb63524fde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x507:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.049550:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb63524fde lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x507:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.049555:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525032 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.049567:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431561.049570:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525032 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.049593:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525039 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.049601:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525039 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.049607:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525039 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.049678:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+123:2347:x1876351933430528:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 201us (1364us total) trans 0 rc 0/0
00010000:00010000:1.0:1789431561.049679:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525032 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.049693:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16447
00010000:00010000:1.0:1789431561.049695:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525032 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.049703:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525032 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.049709:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc211f4f0)
00000100:00100000:2.0:1789431561.049713:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16448
00010000:00010000:1.0:1789431561.049717:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525032 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.049724:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+110:2347:x1876351933430400:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431561.049730:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525032 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.049736:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.049754:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb63524477 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x50a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c850d expref: 110 pid: 14501 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.049760:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.049766:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.049769:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb63524477 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x50a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c850d expref: 110 pid: 14501 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.049774:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525032 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.049786:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525032 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.049791:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50a:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.049795:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50a:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.049800:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63524fd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.049810:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63524fd7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x50a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.049823:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.049844:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+110:2347:x1876351933430400:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 124us (1521us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.049852:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16448
00000100:00100000:2.0:1789431561.049866:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16449
00000100:00100000:2.0:1789431561.049874:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+122:2347:x1876351933430656:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.049883:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.049888:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c35d39f9/0xd8e438fb635241d0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x508:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8457 expref: 122 pid: 6700 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.049898:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c35d39f9/0xd8e438fb635241d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x508:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8457 expref: 122 pid: 6700 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.049911:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x508:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.049914:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x508:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.049918:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63524fe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x508:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.049925:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63524fe5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x508:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.049944:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.049963:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+122:2347:x1876351933430656:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 90us (1625us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.049969:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16449
00000100:00100000:2.0:1789431561.049983:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16450
00000100:00100000:2.0:1789431561.049990:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e956450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+121:2347:x1876351933430784:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.049998:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.050003:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009bca4ae2/0xd8e438fb63524320 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x509:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84b2 expref: 121 pid: 14486 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050013:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009bca4ae2/0xd8e438fb63524320 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x509:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84b2 expref: 121 pid: 14486 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050024:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x509:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.050027:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x509:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.050032:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524fec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x509:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050040:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524fec lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x509:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050073:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.050089:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e956450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+121:2347:x1876351933430784:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 100us (1648us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.050099:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16450
00000100:00100000:2.0:1789431561.050114:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16451
00000100:00100000:2.0:1789431561.050121:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+109:2347:x1876351933431040:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.050129:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.050135:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003662928/0xd8e438fb63524710 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x50c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85d1 expref: 109 pid: 14491 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050145:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003662928/0xd8e438fb63524710 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x50c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85d1 expref: 109 pid: 14491 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050157:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.050160:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.050164:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8eaf536/0xd8e438fb63525001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050172:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8eaf536/0xd8e438fb63525001 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x50c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050185:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.050200:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+109:2347:x1876351933431040:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 79us (1059us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.050206:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16451
00000100:00100000:2.0:1789431561.050220:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16452
00000100:00100000:2.0:1789431561.050226:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+108:2347:x1876351933431296:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.050236:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.050241:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a09022e/0xd8e438fb63524b00 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x50f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86f7 expref: 108 pid: 14468 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050251:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a09022e/0xd8e438fb63524b00 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x50f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86f7 expref: 108 pid: 14468 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050264:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50f:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.050267:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50f:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.050271:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e5af751/0xd8e438fb6352500f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050279:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e5af751/0xd8e438fb6352500f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x50f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050290:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.050305:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+108:2347:x1876351933431296:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 79us (1138us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.050311:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16452
00000100:00100000:2.0:1789431561.050324:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16453
00000100:00100000:2.0:1789431561.050332:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+107:2347:x1876351933430912:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.050339:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.050345:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb63524875 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x50d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c863a expref: 107 pid: 8217 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050361:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb63524875 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x50d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c863a expref: 107 pid: 8217 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050374:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50d:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.050377:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50d:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.050381:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ffa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050389:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ffa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x50d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050401:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.050415:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+107:2347:x1876351933430912:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 85us (1225us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.050421:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16453
00000100:00100000:2.0:1789431561.050434:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16454
00000100:00100000:2.0:1789431561.050441:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+120:2347:x1876351933431168:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.050453:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.050458:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d98238d4/0xd8e438fb635244f5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x50b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8530 expref: 120 pid: 14469 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050469:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d98238d4/0xd8e438fb635244f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x50b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8530 expref: 120 pid: 14469 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050488:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.050492:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.050496:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f909f98a/0xd8e438fb63525008 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050506:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f909f98a/0xd8e438fb63525008 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x50b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050520:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.050538:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+120:2347:x1876351933431168:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 95us (1308us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.050545:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16454
00010000:00010000:1.0:1789431561.050553:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525039 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.050563:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525039 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.050570:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525039 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.050576:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.050580:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525039 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.050586:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525039 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.050596:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x18178cb5 (ffff90cf22651800)
00010000:00010000:1.0:1789431561.050599:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.050602:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525039 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.050608:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525039 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.050650:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb6352502b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87fa expref: 260 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.050661:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.050664:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.050670:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb6352502b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87fa expref: 260 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.050681:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b5e1c00, rc 0)
00000100:00100000:0.0:1789431561.050690:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e956850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+106:2347:x1876351933429888:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 7387us (8194us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431561.050690:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+119:2347:x1876351933429760:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 7224us (8164us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431561.050699:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16444
00000100:00100000:1.0:1789431561.050714:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+259:14616:x1876351933430144:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1335us (2474us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431561.050724:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295795
00010000:00010000:2.0:1789431561.050770:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d98238d4/0xd8e438fb635244f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x50b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8530 expref: 118 pid: 14469 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.050784:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a047100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1876351894211328:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431561.050784:0:14505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4a3acbe/0xd8e438fb63523fae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x506:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c83bd expref: 117 pid: 14469 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050807:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f909f98a/0xd8e438fb63525008 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050818:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f909f98a/0xd8e438fb63525008 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050825:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f909f98a/0xd8e438fb63525008 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050841:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f909f98a/0xd8e438fb63525008 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050848:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f909f98a/0xd8e438fb63525008 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.050873:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1789431561.051233:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3313:x1876351894210304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24034us (33053us total) trans 4294969607 rc 0/0
00000100:00100000:2.0:1789431561.051242:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8256
00010000:00010000:2.0:1789431561.051268:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431561.051276:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f909f98a/0xd8e438fb63525008 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.051285:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ae58200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431561.051288:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f909f98a/0xd8e438fb63525008 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.051298:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f909f98a/0xd8e438fb63525008 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.051311:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f909f98a/0xd8e438fb63525008 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.051318:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f909f98a/0xd8e438fb63525008 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.051337:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.051339:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.051340:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.051365:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003662928/0xd8e438fb63524710 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x50c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85d1 expref: 106 pid: 14491 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.051376:0:14500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a044e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:14500:1876351894211200:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431561.051390:0:14500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b8eaf536/0xd8e438fb63525001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.051399:0:14500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b8eaf536/0xd8e438fb63525001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.051406:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8eaf536/0xd8e438fb63525001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.051416:0:14500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8eaf536/0xd8e438fb63525001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.051424:0:14500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8eaf536/0xd8e438fb63525001 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.051441:0:14500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431561.051453:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431561.051457:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8eaf536/0xd8e438fb63525001 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.051465:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ae59000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431561.051468:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8eaf536/0xd8e438fb63525001 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.051476:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8eaf536/0xd8e438fb63525001 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.051488:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8eaf536/0xd8e438fb63525001 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.051496:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8eaf536/0xd8e438fb63525001 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.051517:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.051519:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.051520:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431561.051695:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933431552
00000100:00100000:1.0:1789431561.051705:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933431552
00000100:00100000:2.0:1789431561.051889:0:14500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+38:3312:x1876351894210432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26546us (35485us total) trans 4294969994 rc 0/0
00000100:00100000:2.0:1789431561.051898:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8255
00000100:00100000:2.0:1789431561.051937:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+105:2347:x1876351933429632:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 8949us (9489us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.051950:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12430
00000100:00100000:1.0:1789431561.051970:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+259:14617:x1876351933431552:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431561.052039:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16443
00010000:00010000:0.0:1789431561.052101:0:14501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b43bd3ce/0xd8e438fb63524fc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.052113:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b43bd3ce/0xd8e438fb63524fc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.052123:0:14501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b43bd3ce/0xd8e438fb63524fc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.052131:0:14501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b43bd3ce/0xd8e438fb63524fc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.052152:0:14501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:1.0:1789431561.052355:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+260:14617:x1876351933431552:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 393us (3090us total) trans 4295120887 rc 0/0
00000100:00100000:0.0:1789431561.052367:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+37:3311:x1876351894208384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 44058us (44517us total) trans 4294969608 rc 0/0
00000100:00100000:1.0:1789431561.052367:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12430
00000100:00100000:0.0:1789431561.052379:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8246
00010000:00010000:0.0:1789431561.052404:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431561.052411:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b43bd3ce/0xd8e438fb63524fc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.052419:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ace00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431561.052423:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b43bd3ce/0xd8e438fb63524fc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.052431:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b43bd3ce/0xd8e438fb63524fc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.052447:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b43bd3ce/0xd8e438fb63524fc2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.052455:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b43bd3ce/0xd8e438fb63524fc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x505:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.052474:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.052476:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.052478:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:0.0:1789431561.052514:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1c3e4a80/2, rc 0, transno 4294969608
00000100:00100000:0.0:1789431561.052528:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894208384:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431561.052901:0:14505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:14505:1876351894209280:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431561.052927:0:14505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb63524fd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.052936:0:14505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb63524fd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.052943:0:14505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb63524fd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.052952:0:14505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb63524fd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.052965:0:14505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb63524fd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.052985:0:14505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431561.053108:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb63524875 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x50d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c863a expref: 104 pid: 8217 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.053123:0:14497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:14497:1876351894210944:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431561.053146:0:14497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ffa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.053155:0:14497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ffa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.053162:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ffa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.053176:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ffa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.053184:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ffa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.053203:0:14497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:3.0:1789431561.053206:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+37:3313:x1876351894208512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 44202us (44615us total) trans 4294969609 rc 0/0
00000100:00100000:3.0:1789431561.053214:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8248
00010000:00010000:3.0:1789431561.053261:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cbb0e5a/0xd8e438fb635240c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x507:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8403 expref: 116 pid: 14500 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.053273:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:14502:1876351894209536:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431561.053285:0:14502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb63524fde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.053294:0:14502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb63524fde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.053302:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb63524fde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.053311:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb63524fde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.053319:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb63524fde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.053346:0:14502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool
00000100:00100000:1.0:1789431561.053387:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+38:3312:x1876351894210560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36865us (37066us total) trans 4294969995 rc 0/0
00000100:00100000:3.0:1789431561.053476:0:14502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+37:3313:x1876351894208640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 44230us (44794us total) trans 4294969610 rc 0/0
00000100:00100000:3.0:1789431561.053482:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8250
00010000:00010000:3.0:1789431561.053521:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bca4ae2/0xd8e438fb63524320 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x509:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84b2 expref: 115 pid: 14486 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.053533:0:8217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce029f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8217:1876351894210176:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431561.053547:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524fec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.053555:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524fec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.053563:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524fec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.053572:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524fec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.053580:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524fec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.053594:0:8217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool
00000100:00100000:3.0:1789431561.053715:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3312:x1876351894209792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 41158us (41798us total) trans 4294969611 rc 0/0
00000100:00100000:3.0:1789431561.053721:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8252
00000100:00100000:1.0:1789431561.054502:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8254
00010000:00010000:1.0:1789431561.054540:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp.  (3 blwis in pool)
00010000:00010000:1.0:1789431561.054548:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb63524fd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.054560:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431561.054564:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb63524fd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.054575:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb63524fd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.054596:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb63524fd0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.054604:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb63524fd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.054624:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp.  (2 blwis in pool)
00010000:00010000:1.0:1789431561.054629:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ffa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.054635:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce20f06a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431561.054638:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ffa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.054646:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ffa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.054656:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ffa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.054663:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6fc6983/0xd8e438fb63524ffa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.054677:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1789431561.054680:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb63524fde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.054687:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431561.054690:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb63524fde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.054701:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb63524fde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.054710:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb63524fde lrc: 1/0,0 mode: --/PW res: [0x240000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.054717:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb63524fde lrc: 0/0,0 mode: --/PW res: [0x240000400:0x507:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.054728:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431561.054732:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524fec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.054739:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ac42400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431561.055085:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524fec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.055099:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524fec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.055114:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524fec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.055121:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038ba2529/0xd8e438fb63524fec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.055145:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.055146:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.055148:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.055201:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c35d39f9/0xd8e438fb635241d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x508:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8457 expref: 114 pid: 6700 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.055213:0:14471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d509880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14471:1876351894210048:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431561.055240:0:14471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63524fe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.055249:0:14471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63524fe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.055257:0:14471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63524fe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.055268:0:14471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63524fe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.055276:0:14471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63524fe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.055308:0:14471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431561.055407:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431561.055415:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63524fe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.055425:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431561.055428:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63524fe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.055437:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63524fe5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.055451:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63524fe5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.055459:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63524fe5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.055478:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431561.055480:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431561.055482:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.055535:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431561.055551:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1789431561.055571:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894211968:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431561.055626:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3312:x1876351894209664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 43059us (43623us total) trans 4294969612 rc 0/0
00000100:00100000:1.0:1789431561.055635:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8253
00000100:00100000:0.0:1789431561.055711:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:0.0:1789431561.055772:0:14464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63524fb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.055787:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63524fb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.055796:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63524fb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.055804:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63524fb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.055828:0:14464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431561.056037:0:14464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3311:x1876351894208256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 48016us (48389us total) trans 4294969996 rc 0/0
00000100:00100000:0.0:1789431561.056067:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8244
00000100:00100000:0.0:1789431561.056088:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894211968
00000100:00100000:0.0:1789431561.056095:0:14464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894211968
00000100:00100000:0.0:1789431561.056135:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8261
00000100:00100000:0.0:1789431561.056146:0:14464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3311:x1876351894211968:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431561.056179:0:14464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1293 count 1
00010000:00010000:0.0:1789431561.056205:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63525040 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x50d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.056223:0:14464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002386c4fe/0xd8e438fb6352478e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x50d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85ed expref: 113 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.056232:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50d:0x0].0x0 since=1s v=(0 0)
00010000:00010000:0.0:1789431561.056237:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50d:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431561.056242:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63525040 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x50d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.056278:0:14464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002386c4fe/0xd8e438fb6352478e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85ed expref: 113 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.056293:0:14464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002386c4fe/0xd8e438fb6352478e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x50d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85ed expref: 113 pid: 6700 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.056307:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14464:1876351894212096:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431561.056384:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf0620a900 going to sleep for 11 seconds
00000004:00080000:0.0:1789431561.056421:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3bbf5f80/2, rc 0, transno 4294969996
00000100:00100000:0.0:1789431561.056436:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894208256:0@lo:6:osp-syn-1-0.0
00010000:00010000:0.0:1789431561.056496:0:14468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d888fc6e/0xd8e438fb63524fc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.056506:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d888fc6e/0xd8e438fb63524fc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.056515:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d888fc6e/0xd8e438fb63524fc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.056523:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d888fc6e/0xd8e438fb63524fc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.056542:0:14468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:3.0:1789431561.057064:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:3.0:1789431561.057074:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63524fb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.057083:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431561.057087:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63524fb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.057097:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63524fb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.057117:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63524fb4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.057126:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63524fb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.057147:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431561.057151:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d888fc6e/0xd8e438fb63524fc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.057158:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431561.057161:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d888fc6e/0xd8e438fb63524fc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.057169:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d888fc6e/0xd8e438fb63524fc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.057178:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d888fc6e/0xd8e438fb63524fc9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.057185:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d888fc6e/0xd8e438fb63524fc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x509:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.057202:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431561.057203:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431561.057206:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.058167:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a09022e/0xd8e438fb63524b00 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x50f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86f7 expref: 103 pid: 14468 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.058189:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1876351894211456:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431561.058218:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008e5af751/0xd8e438fb6352500f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.058229:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008e5af751/0xd8e438fb6352500f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.058236:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e5af751/0xd8e438fb6352500f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.058249:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e5af751/0xd8e438fb6352500f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.058257:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e5af751/0xd8e438fb6352500f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.058287:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431561.058572:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431561.058580:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e5af751/0xd8e438fb6352500f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.058589:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f894a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431561.058593:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e5af751/0xd8e438fb6352500f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.058602:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e5af751/0xd8e438fb6352500f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.058620:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e5af751/0xd8e438fb6352500f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.058627:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e5af751/0xd8e438fb6352500f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.058647:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431561.058649:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431561.058651:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431561.058699:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3313:x1876351894210816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 27855us (40465us total) trans 4294969998 rc 0/0
00000100:00100000:2.0:1789431561.058700:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16442
00000100:00100000:1.0:1789431561.058715:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8257
00010000:00010000:2.0:1789431561.058778:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.058782:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb63524477 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x50a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c850d expref: 101 pid: 14501 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.058831:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3313:x1876351894208000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 49938us (50306us total) trans 4294969997 rc 0/0
00000100:00100000:0.0:1789431561.058840:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8247
00010000:00010000:0.0:1789431561.058863:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431561.058868:0:14491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14491:1876351894209408:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431561.058886:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00010000:00010000:1.0:1789431561.058888:0:14491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63524fd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.058899:0:14491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63524fd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.058905:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894212224:0@lo:6:osp-syn-1-0.0
00010000:00010000:1.0:1789431561.058912:0:14491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63524fd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.058924:0:14491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63524fd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.058932:0:14491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63524fd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.058950:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1789431561.058984:0:14491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1789431561.059036:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894212224
00000100:00100000:2.0:1789431561.059045:0:14490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894212224
00000100:00100000:2.0:1789431561.059128:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8262
00000100:00100000:2.0:1789431561.059140:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3314:x1876351894212224:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:2.0:1789431561.059173:0:6699:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1296 count 1
00000100:00100000:1.0:1789431561.059180:0:14491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+39:3313:x1876351894208128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 50085us (50534us total) trans 4294969999 rc 0/0
00000100:00100000:1.0:1789431561.059188:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8249
00010000:00010000:2.0:1789431561.059201:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb63525047 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x510:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.059215:0:14482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000095b38ee6/0xd8e438fb63524fbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.059222:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb63524c73 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x510:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8760 expref: 100 pid: 14499 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.059234:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095b38ee6/0xd8e438fb63524fbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.059239:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x510:0x0].0x0 since=1s v=(0 0)
00010000:00010000:2.0:1789431561.059248:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x510:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431561.059252:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095b38ee6/0xd8e438fb63524fbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.059254:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb63525047 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x510:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.059278:0:14482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095b38ee6/0xd8e438fb63524fbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.059769:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb63524c73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x510:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8760 expref: 100 pid: 14499 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.059787:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb63524c73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x510:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8760 expref: 100 pid: 14499 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.059802:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a044e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6699:1876351894212352:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431561.059891:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3e6d1b40 going to sleep for 11 seconds
00010000:00010000:0.0:1789431561.062906:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431561.062906:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:0.0:1789431561.062930:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095b38ee6/0xd8e438fb63524fbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.062930:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63524fd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.062960:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431561.062968:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431561.062969:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095b38ee6/0xd8e438fb63524fbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.062975:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63524fd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.062986:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095b38ee6/0xd8e438fb63524fbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.062989:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63524fd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.063021:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095b38ee6/0xd8e438fb63524fbb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.063021:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63524fd7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.063046:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63524fd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.063110:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.063114:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.063116:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.063183:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.063186:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.063229:0:14482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool
00010000:00010000:1.0:1789431561.063240:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095b38ee6/0xd8e438fb63524fbb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.063547:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431561.063551:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431561.063949:0:14482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3311:x1876351894207872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 55759us (56234us total) trans 4294970000 rc 0/0
00000100:00100000:1.0:1789431561.063961:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8245
00000004:00080000:1.0:1789431561.064242:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2d509180/2, rc 0, transno 4294969607
00000100:00100000:1.0:1789431561.064267:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894210304:0@lo:6:osp-syn-0-0.0
00000004:00080000:1.0:1789431561.064285:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce3a046680/2, rc 0, transno 4294969998
00000100:00100000:1.0:1789431561.064300:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894210816:0@lo:6:osp-syn-1-0.0
00000004:00080000:1.0:1789431561.064312:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3bbf5c00/2, rc 0, transno 4294969999
00000100:00100000:1.0:1789431561.064316:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894208128:0@lo:6:osp-syn-1-0.0
00000004:00080000:1.0:1789431561.064326:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf37e93b80/2, rc 0, transno 4294969610
00000100:00100000:1.0:1789431561.064330:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894208640:0@lo:6:osp-syn-0-0.0
00000004:00080000:1.0:1789431561.064341:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3bbf7800/2, rc 0, transno 4294969997
00000100:00100000:1.0:1789431561.064345:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894208000:0@lo:6:osp-syn-1-0.0
00000004:00080000:1.0:1789431561.064355:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf37e90a80/2, rc 0, transno 4294969609
00000100:00100000:1.0:1789431561.064359:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894208512:0@lo:6:osp-syn-0-0.0
00000004:00080000:1.0:1789431561.064385:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce387b3b80/2, rc 0, transno 4294969994
00000100:00100000:1.0:1789431561.064389:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894210432:0@lo:6:osp-syn-1-0.0
00000004:00080000:1.0:1789431561.064398:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce387b0380/2, rc 0, transno 4294969995
00000100:00100000:1.0:1789431561.064401:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894210560:0@lo:6:osp-syn-1-0.0
00000004:00080000:1.0:1789431561.064411:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce029f6d80/2, rc 0, transno 4294969612
00000100:00100000:1.0:1789431561.064414:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce029f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894209664:0@lo:6:osp-syn-0-0.0
00000004:00080000:1.0:1789431561.064423:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce029f4a80/2, rc 0, transno 4294969611
00000100:00100000:1.0:1789431561.064426:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce029f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894209792:0@lo:6:osp-syn-0-0.0
00000004:00080000:0.0:1789431561.064532:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3bbf4e00/2, rc 0, transno 4294970000
00000100:00100000:0.0:1789431561.064538:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894207872:0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431561.066304:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1876351894211584:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431561.066317:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431561.066353:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b9f3956/0xd8e438fb63525016 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x50c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.066379:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.066411:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.066455:0:14469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14469:1876351894211840:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431561.066474:0:14469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63525024 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x50e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.066529:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933431680
00000100:00100000:0.0:1789431561.066539:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933431680
00000100:00100000:3.0:1789431561.066570:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933431936
00000100:00100000:3.0:1789431561.066576:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933431936
00010000:00010000:0.0:1789431561.066584:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000060ea8e37/0xd8e438fb6352463e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x50c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8592 expref: 114 pid: 14500 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.066626:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933431808
00000100:00100000:0.0:1789431561.066630:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933431808
00010000:00010000:0.0:1789431561.066658:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb63524431 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x50a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84ff expref: 115 pid: 14490 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.066688:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16455
00000100:00100000:0.0:1789431561.066698:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+115:2350:x1876351933431680:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431561.066717:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431561.066723:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000060ea8e37/0xd8e438fb6352463e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x50c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8592 expref: 115 pid: 14500 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.066739:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000060ea8e37/0xd8e438fb6352463e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8592 expref: 115 pid: 14500 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.066770:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a0f0e7e/0xd8e438fb635249d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x50e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c869c expref: 101 pid: 6699 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.066783:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060ea8e37/0xd8e438fb6352463e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x50c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8592 expref: 115 pid: 14500 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.066815:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50c:0x0].0x0 since=0s v=(0 0)
00000100:00100000:2.0:1789431561.066818:0:14486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14486:1876351894211712:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431561.066825:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431561.066834:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b9f3956/0xd8e438fb63525016 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.066846:0:14486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb6352501d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x50a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.066847:0:14506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b9f3956/0xd8e438fb63525016 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x50c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.066890:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431561.066907:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b9f3956/0xd8e438fb63525016 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.066917:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b9f3956/0xd8e438fb63525016 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.066929:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b9f3956/0xd8e438fb63525016 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.066938:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b9f3956/0xd8e438fb63525016 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.066956:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+114:2350:x1876351933431680:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 257us (644us total) trans 0 rc 0/0
00010000:00010000:2.0:1789431561.066961:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431561.066966:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16455
00000100:00100000:0.0:1789431561.066987:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16456
00000100:00100000:0.0:1789431561.066994:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e954050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+113:2347:x1876351933431808:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431561.067004:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431561.067010:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb63524431 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x50a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84ff expref: 113 pid: 14490 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.067021:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb63524431 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84ff expref: 113 pid: 14490 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.067036:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb63524431 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x50a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c84ff expref: 113 pid: 14490 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.067091:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50a:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431561.067095:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50a:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431561.067099:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb6352501d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.067107:0:14506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb6352501d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x50a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.067126:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431561.067150:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e954050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+112:2347:x1876351933431808:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 157us (738us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.067157:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16456
00000100:00100000:0.0:1789431561.067172:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16457
00000100:00100000:0.0:1789431561.067179:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+101:2347:x1876351933431936:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431561.067190:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431561.067195:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a0f0e7e/0xd8e438fb635249d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x50e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c869c expref: 101 pid: 6699 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.067206:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a0f0e7e/0xd8e438fb635249d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x50e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c869c expref: 101 pid: 6699 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.067221:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a0f0e7e/0xd8e438fb635249d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x50e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c869c expref: 101 pid: 6699 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.067236:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431561.067239:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431561.067243:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63525024 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.067251:0:14506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63525024 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x50e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.067272:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431561.067293:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+100:2347:x1876351933431936:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 114us (915us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.067299:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16457
00000100:00100000:2.0:1789431561.067355:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3311:x1876351894211072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 34971us (49009us total) trans 4294969613 rc 0/0
00000100:00100000:2.0:1789431561.067364:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8258
00010000:00010000:0.0:1789431561.069418:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431561.069435:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b9f3956/0xd8e438fb63525016 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.069521:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce27814e00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431561.069527:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b9f3956/0xd8e438fb63525016 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.069541:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b9f3956/0xd8e438fb63525016 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.069565:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b9f3956/0xd8e438fb63525016 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.069699:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b9f3956/0xd8e438fb63525016 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.069740:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.069985:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.069987:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:0.0:1789431561.070074:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf37e90000/2, rc 0, transno 4294969613
00000100:00100000:0.0:1789431561.070158:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894211072:0@lo:6:osp-syn-0-0.0
00010000:00010000:0.0:1789431561.070188:0:14486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb6352501d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.070199:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb6352501d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.070211:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb6352501d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.070221:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb6352501d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.070287:0:14486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431561.071133:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3313:x1876351894209920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 38278us (53141us total) trans 4294969614 rc 0/0
00000100:00100000:0.0:1789431561.071145:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8259
00000004:00080000:0.0:1789431561.071216:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2d50b480/2, rc 0, transno 4294969614
00000100:00100000:0.0:1789431561.071348:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894209920:0@lo:6:osp-syn-0-0.0
00010000:00010000:0.0:1789431561.071377:0:14469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63525024 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.071389:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63525024 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.071400:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63525024 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.071408:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63525024 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.072124:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1789431561.072136:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb6352501d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.072149:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431561.072154:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb6352501d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.072172:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb6352501d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.072200:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb6352501d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.072208:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb6352501d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.072233:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431561.072238:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63525024 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.072246:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce20f06c00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431561.072249:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63525024 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.072256:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63525024 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.072267:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63525024 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.072276:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.072278:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.072280:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.072387:0:14469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool
00010000:00010000:0.0:1789431561.072395:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088532493/0xd8e438fb63525024 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.072597:0:14464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14464:1876351894212096:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431561.072624:0:14464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63525040 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x50d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.072879:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a044e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6699:1876351894212352:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431561.072898:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb63525047 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x510:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.073262:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3313:x1876351894210688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 40286us (55218us total) trans 4294970001 rc 0/0
00000004:00080000:0.0:1789431561.073284:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce387b0a80/2, rc 0, transno 4294970001
00000100:00100000:0.0:1789431561.073306:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894210688:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431561.073346:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8260
00010000:00010000:2.0:1789431561.073348:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431561.076031:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.076235:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.076320:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.076381:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933432320
00000100:00100000:2.0:1789431561.076394:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933432320
00010000:00010000:2.0:1789431561.076450:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002386c4fe/0xd8e438fb6352478e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x50d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85ed expref: 112 pid: 6700 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.076507:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16458
00000100:00100000:2.0:1789431561.076519:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+112:2347:x1876351933432320:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.076543:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.076554:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002386c4fe/0xd8e438fb6352478e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x50d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85ed expref: 112 pid: 6700 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.076573:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002386c4fe/0xd8e438fb6352478e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85ed expref: 112 pid: 6700 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.076602:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002386c4fe/0xd8e438fb6352478e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x50d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c85ed expref: 112 pid: 6700 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.076624:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50d:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.076629:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50d:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.076635:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63525040 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.076647:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63525040 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x50d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.076685:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.076770:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+111:2347:x1876351933432320:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 253us (754us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.076777:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16458
00000100:00100000:1.0:1789431561.076839:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.076860:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933432192
00000100:00100000:2.0:1789431561.076866:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933432192
00010000:00010000:2.0:1789431561.076886:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb63524c73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x510:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8760 expref: 100 pid: 14499 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.076921:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16459
00000100:00100000:2.0:1789431561.076928:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+100:2348:x1876351933432192:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.076938:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.077012:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb63524c73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x510:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8760 expref: 100 pid: 14499 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.077177:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933432576
00000100:00100000:3.0:1789431561.077184:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933432576
00000100:00100000:3.0:1789431561.077256:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933432704
00000100:00100000:3.0:1789431561.077260:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933432704
00010000:00010000:2.0:1789431561.077296:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb63524c73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x510:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8760 expref: 100 pid: 14499 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.077315:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb63524c73 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x510:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8760 expref: 100 pid: 14499 timeout: 3119 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.077329:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x510:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.077332:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x510:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431561.077338:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb63525047 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x510:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.077347:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb63525047 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x510:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.077351:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295796
00000100:00100000:1.0:1789431561.077368:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+261:14617:x1876351933432576:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431561.077382:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.077416:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+99:2348:x1876351933432192:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 488us (578us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.077424:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16459
00010000:00010000:2.0:1789431561.077454:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb63525047 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.077465:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb63525047 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.077476:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb63525047 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.077486:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb63525047 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.077506:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431561.077598:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431561.077621:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63524f8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87e5 expref: 261 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.077638:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa1:0x0].0x0 (ffff90ce03149b00)
00010000:00010000:1.0:1789431561.077779:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431561.077809:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352504e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.077825:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352504e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.077836:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352504e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.077853:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525055 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.077861:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.077869:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.077993:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3314:x1876351894212224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18854us (19042us total) trans 4294970002 rc 0/0
00010000:00010000:1.0:1789431561.077994:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352505c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aa1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.078010:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8262
00010000:00010000:1.0:1789431561.078011:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352505c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.078022:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352505c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.078041:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431561.078083:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb63525047 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.078093:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ae59600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431561.078098:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb63525047 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.078108:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb63525047 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.078126:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb63525047 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.078133:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaf53891/0xd8e438fb63525047 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.078159:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.078161:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.078163:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000040:00080000:1.0:1789431561.079234:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1215, 64 off86016
00000100:00100000:3.0:1789431561.079479:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295797
00000100:00100000:3.0:1789431561.079498:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+261:14616:x1876351933432704:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431561.079522:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.079525:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431561.079553:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63524e1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87d7 expref: 261 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.079563:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525063 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aa1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.079577:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525063 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.079921:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431561.079928:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431561.079942:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb6352506a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8801 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.080075:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63525071 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.080086:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63525071 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.080095:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63525071 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.080110:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb63525078 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.080117:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb63525078 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.080124:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb63525078 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:3.0:1789431561.080693:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x513:0x0], index 0: 0
00010000:00010000:1.0:1789431561.080729:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525063 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.080753:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525063 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.080761:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525063 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.080767:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525063 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.080795:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431561.080823:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352505c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.080829:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352505c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aa1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.080835:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352505c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.080842:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.080846:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352505c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.080855:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352505c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aa1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.080866:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa1:0x0].0x0 (ffff90cf22651200)
00010000:00010000:1.0:1789431561.080869:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431561.080873:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352505c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aa1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.080879:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352505c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aa1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.080894:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb6352507f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.080898:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352504e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.080905:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352504e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.080905:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb6352507f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.080911:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352504e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.080914:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb6352507f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.080921:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.080923:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352504e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.080929:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352504e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.080936:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431561.080938:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.080941:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352504e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.080947:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352504e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.080948:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63525071 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.080954:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63525071 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431561.080958:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000939d25b4 reply state 00000000833de681 transno 4295120888 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.080960:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63525071 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.080965:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf18a56200 already unused, calling callback (ffffffffc211f4f0)
00000100:00100000:1.0:1789431561.080968:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431561.080968:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63525071 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.080973:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63525071 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.080980:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431561.080982:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.080984:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63525071 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.080993:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63525071 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431561.081003:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cd9cb31f reply state 00000000f66cc842 transno 4295120889 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb63525078 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.081009:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431561.081037:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56400/0xd8e438fb6352506a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8801 expref: 264 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.081071:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb6352507f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8801 expref: 263 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.081075:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+263:14617:x1876351933432576:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3713us (4840us total) trans 4295120888 rc 0/0
00010000:00010000:3.0:1789431561.081081:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa2:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431561.081083:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00000100:00100000:1.0:1789431561.081084:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295796
00010000:00010000:3.0:1789431561.081085:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0f894a00, rc 0)
00000100:00100000:3.0:1789431561.081109:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+263:14616:x1876351933432704:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1621us (4790us total) trans 4295120889 rc 0/0
00000100:00100000:3.0:1789431561.081115:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295797
00010000:00010000:2.0:1789431561.081156:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431561.081167:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525063 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.081175:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431561.081179:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525063 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.081187:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525063 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.081197:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa1:0x0].0x0 (ffff90cf22651200)
00010000:00010000:2.0:1789431561.081200:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431561.081203:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525063 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10aa1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.081208:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525063 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aa1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.081229:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.081231:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.081233:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.082091:0:14464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63525040 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.082117:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63525040 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.082127:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63525040 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.082135:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63525040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.082165:0:14464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431561.082505:0:14464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3311:x1876351894211968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26357us (26791us total) trans 4294969615 rc 0/0
00000100:00100000:0.0:1789431561.082516:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8261
00000004:00080000:0.0:1789431561.082594:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf37e97480/2, rc 0, transno 4294970002
00000100:00100000:0.0:1789431561.082612:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894212224:0@lo:6:osp-syn-1-0.0
00010000:00010000:2.0:1789431561.082802:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431561.082810:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63525040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.082821:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431561.082826:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63525040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.082836:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63525040 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.082858:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63525040 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.082866:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009111a1a3/0xd8e438fb63525040 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.082891:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.082893:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.082894:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:2.0:1789431561.083125:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf37e94a80/2, rc 0, transno 4294969615
00000100:00100000:2.0:1789431561.083142:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894211968:0@lo:6:osp-syn-0-0.0
00010000:00010000:2.0:1789431561.086115:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.086138:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525055 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.086149:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525055 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.086156:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.086161:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525055 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.086170:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525055 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.086192:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x148c06c6 (ffff90cf22651800)
00010000:00010000:2.0:1789431561.086195:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.086201:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525055 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.086208:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525055 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.100344:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb63525078 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.100368:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb63525078 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.100383:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb63525078 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.100393:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf18a56e00 already unused, calling callback (ffffffffc211f4f0)
00000100:00100000:1.0:1789431561.100396:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431561.100401:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb63525078 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.100416:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb63525078 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.100442:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x18178cb5 (ffff90cf18b78700)
00010000:00010000:2.0:1789431561.100456:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.100463:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb63525078 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.100469:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb63525078 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.100964:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933432832
00000100:00100000:3.0:1789431561.100979:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933432832
00000100:00100000:3.0:1789431561.101116:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8263
00000100:00100000:3.0:1789431561.101131:0:14500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+111:2348:x1876351933432832:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431561.101158:0:14500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.101186:0:14500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb6352508d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8808 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431561.101226:0:14500:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x513:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431561.101255:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x513:0x0].0x0 since=3019s v=(0 0)
00010000:00010000:3.0:1789431561.101260:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x513:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431561.101272:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb6352508d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8808 expref: 112 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.101302:0:14500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb6352508d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8808 expref: 112 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.101315:0:14500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf18a56400, rc 0)
00000100:00100000:2.0:1789431561.101484:0:14500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+112:2348:x1876351933432832:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 354us (1096us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.101493:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8263
00000100:00100000:1.0:1789431561.105510:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.105623:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.105705:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933433216
00000100:00100000:2.0:1789431561.105709:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933432960
00000100:00100000:2.0:1789431561.105720:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933432960
00000100:00100000:3.0:1789431561.105720:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933433216
00000100:00100000:3.0:1789431561.105818:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12431
00000100:00100000:2.0:1789431561.105819:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295798
00000100:00100000:3.0:1789431561.105837:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+262:14616:x1876351933433216:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431561.105838:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+262:14617:x1876351933432960:12345-192.168.203.4@tcp:41:dbench.0
00000100:00100000:3.0:1789431561.106367:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+263:14616:x1876351933433216:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 532us (738us total) trans 4295120890 rc 0/0
00000100:00100000:3.0:1789431561.106376:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12431
00000004:00000024:2.0:1789431561.107412:0:5849:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7643070464 avail 7530872832
00000100:00100000:2.0:1789431561.107650:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+262:14617:x1876351933432960:12345-192.168.203.4@tcp:41:dbench.0 Request processed in 1805us (2143us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.107662:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295798
00000100:00100000:1.0:1789431561.113561:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.114148:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933433344
00000100:00100000:2.0:1789431561.114163:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933433344
00000100:00100000:2.0:1789431561.114906:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295799
00000100:00100000:2.0:1789431561.114924:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+262:14617:x1876351933433344:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.114960:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.114990:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525094 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c880f expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115163:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352509b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115184:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352509b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115199:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352509b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115219:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb635250a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x69e939dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115227:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb635250a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x69e939dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115234:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb635250a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x69e939dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115307:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352509b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115315:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352509b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115323:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352509b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115329:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ae59000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.115335:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352509b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115343:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352509b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115357:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431561.115360:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.115368:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352509b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115374:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352509b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115395:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb635250a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x69e939dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115402:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb635250a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x69e939dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115409:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb635250a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x69e939dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115414:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ae58200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.115417:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb635250a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x69e939dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115423:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb635250a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x69e939dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115430:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x69e939dc (ffff90cf13195a00)
00010000:00010000:2.0:1789431561.115433:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.115436:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb635250a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x69e939dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115442:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb635250a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x69e939dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115481:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525094 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c880f expref: 263 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115492:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431561.115494:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.115498:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525094 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c880f expref: 263 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.115508:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ae59600, rc 0)
00000100:00100000:2.0:1789431561.115609:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+262:14617:x1876351933433344:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 691us (2062us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431561.115618:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295799
00000100:00100000:1.0:1789431561.117229:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.121418:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933433600
00000100:00100000:3.0:1789431561.121441:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933433600
00000100:00100000:3.0:1789431561.121531:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295800
00000100:00100000:3.0:1789431561.121544:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+262:14616:x1876351933433600:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431561.121624:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431561.121668:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb6352507f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8801 expref: 262 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.121697:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa2:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431561.121711:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431561.121748:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635250a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.121776:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635250a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.121788:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635250a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.121806:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635250b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.121814:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635250b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.121820:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635250b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.121967:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635250b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aa2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.121976:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635250b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.121983:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635250b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.122454:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.122670:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933433728
00000100:00100000:0.0:1789431561.122678:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933433728
00000040:00080000:3.0:1789431561.122717:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1214, 64 off85888
00000100:00100000:0.0:1789431561.122805:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295801
00010000:00010000:3.0:1789431561.122808:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635250be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aa2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.122820:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+263:14617:x1876351933433728:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431561.122823:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635250be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.122836:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635250be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.122842:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.122844:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635250be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.122853:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635250be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.122860:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635250be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.122861:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635250c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8816 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.122894:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431561.122921:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635250b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.122927:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635250b7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.122935:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635250b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.122938:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635250cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.122943:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.122949:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635250b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.122961:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635250b7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.122966:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635250cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.122974:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa2:0x0].0x0 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431561.122979:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431561.122980:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635250cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.122984:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635250b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.122994:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635250b7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.123014:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635250a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431561.123017:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b9:0x0]: returning size 16384
00010000:00010000:3.0:1789431561.123025:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635250a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431561.123026:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00010000:00010000:3.0:1789431561.123035:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635250a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.123040:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf18a56200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.123043:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635250a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431561.123075:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635250cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.123075:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635250a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.123092:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431561.123094:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.123098:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635250a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.123108:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb635250a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431561.123124:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004a8415a3 reply state 00000000533389d7 transno 4295120891 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635250b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.123130:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635250c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8816 expref: 265 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.123138:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431561.123165:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635250cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8816 expref: 265 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.123174:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431561.123176:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431561.123180:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4800, rc 0)
00000100:00100000:3.0:1789431561.123242:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+265:14616:x1876351933433600:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1699us (6020us total) trans 4295120891 rc 0/0
00010000:00010000:1.0:1789431561.123246:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00000100:00100000:3.0:1789431561.123253:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295800
00010000:00010000:1.0:1789431561.123257:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635250be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.123266:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431561.123270:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635250be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.123278:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635250be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.123294:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa2:0x0].0x0 (ffff90cf18b78f00)
00010000:00010000:1.0:1789431561.123296:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431561.123299:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635250be lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10aa2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.123304:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635250be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aa2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.123330:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.123333:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.123334:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431561.123503:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+264:14617:x1876351933433728:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 688us (1051us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.123515:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295801
00010000:00010000:2.0:1789431561.128524:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635250b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.128549:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635250b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.128559:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635250b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.128567:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf18a56e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.128574:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635250b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.128589:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635250b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.128610:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x18178cb5 (ffff90cf18b78800)
00010000:00010000:2.0:1789431561.128614:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.128621:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635250b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.128866:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635250b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.139008:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.139848:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933433856
00000100:00100000:2.0:1789431561.139864:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933433856
00000100:00100000:2.0:1789431561.139957:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295802
00000100:00100000:2.0:1789431561.139971:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+263:14616:x1876351933433856:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.140007:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.140038:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb635250d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c881d expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140161:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb635250da lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140180:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb635250da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140195:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb635250da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140214:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635250e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140223:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635250e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140231:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635250e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140303:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb635250da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140312:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb635250da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140320:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb635250da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140326:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ae59000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.140332:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb635250da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140341:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb635250da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140354:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431561.140358:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.140364:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb635250da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140371:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb635250da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140390:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635250e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140397:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635250e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140403:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635250e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140409:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ae59600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.140411:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635250e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140418:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635250e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140425:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xe94006ef (ffff90cf13195a00)
00010000:00010000:2.0:1789431561.140427:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.140430:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635250e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140436:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb635250e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140474:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb635250d3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c881d expref: 264 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140486:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431561.140488:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.140492:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb635250d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c881d expref: 264 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.140508:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ae58200, rc 0)
00000100:00100000:2.0:1789431561.140600:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+263:14616:x1876351933433856:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 633us (1607us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431561.140609:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295802
00000100:00100000:1.0:1789431561.149016:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.149170:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.149233:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933434112
00000100:00100000:0.0:1789431561.149247:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933434112
00000100:00100000:0.0:1789431561.149472:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295803
00000100:00100000:0.0:1789431561.149485:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+263:14616:x1876351933434112:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431561.149518:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00000100:00100000:2.0:1789431561.149543:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933433984
00010000:00010000:0.0:1789431561.149549:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635250e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8824 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.149551:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933433984
00010000:00010000:0.0:1789431561.149638:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb635250ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.149669:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb635250ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.149684:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb635250ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431561.149732:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:0.0:1789431561.149737:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000100:00100000:2.0:1789431561.149771:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12432
00000100:00100000:2.0:1789431561.149783:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+265:14617:x1876351933433984:12345-192.168.203.4@tcp:37:dbench.0
00000004:00010000:0.0:1789431561.149933:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb635250ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.149968:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635250e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8824 expref: 266 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.149993:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb635250ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8824 expref: 265 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.150004:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431561.150007:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431561.150012:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4a00, rc 0)
00000100:00100000:0.0:1789431561.150136:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+265:14616:x1876351933434112:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 653us (1134us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.150147:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295803
00000100:00100000:3.0:1789431561.154510:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.154606:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933434240
00000100:00100000:2.0:1789431561.154619:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933434240
00000100:00100000:2.0:1789431561.154692:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12433
00000100:00100000:2.0:1789431561.154705:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+266:14616:x1876351933434240:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:2.0:1789431561.159182:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+266:14617:x1876351933433984:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 9384us (9994us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.159199:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12432
00000100:00100000:2.0:1789431561.177728:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+264:14616:x1876351933434240:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 23008us (23216us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.177754:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12433
00000100:00100000:3.0:1789431561.178147:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.178434:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933434368
00000100:00100000:0.0:1789431561.178446:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933434368
00000100:00100000:0.0:1789431561.178511:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295804
00000100:00100000:0.0:1789431561.178522:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+264:14617:x1876351933434368:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431561.178548:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431561.178578:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635250f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c882b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178663:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635250fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178682:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635250fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178698:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635250fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178717:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63525104 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x2d602a61 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178725:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63525104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x2d602a61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178731:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63525104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x2d602a61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178816:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635250fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178831:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635250fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178838:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635250fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178845:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.178850:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635250fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178859:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635250fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178874:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431561.178877:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.178884:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635250fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178890:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635250fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178907:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63525104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x2d602a61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178914:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63525104 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x2d602a61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178920:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63525104 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x2d602a61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178925:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.178928:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63525104 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x2d602a61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178934:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63525104 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x2d602a61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178942:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x2d602a61 (ffff90ce07190900)
00010000:00010000:0.0:1789431561.178945:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.178948:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63525104 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x2d602a61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178953:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63525104 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x2d602a61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.178994:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635250f6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c882b expref: 265 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.179005:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431561.179007:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.179011:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635250f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c882b expref: 265 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.179020:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd5400, rc 0)
00000100:00100000:0.0:1789431561.179117:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+264:14617:x1876351933434368:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 596us (971us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431561.179124:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295804
00000100:00100000:0.0:1789431561.185815:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.185918:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.186222:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933434624
00000100:00100000:2.0:1789431561.186233:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933434624
00000100:00100000:2.0:1789431561.186318:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933434752
00000100:00100000:2.0:1789431561.186322:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933434752
00000100:00100000:1.0:1789431561.186358:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295805
00000100:00100000:1.0:1789431561.186372:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+265:14616:x1876351933434624:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.186402:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.186423:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb6352510b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8832 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.186501:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63525112 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.186516:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63525112 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.186529:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63525112 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.186545:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525119 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.186552:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.186559:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.187872:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63525112 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.187895:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63525112 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.187903:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63525112 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.187909:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce20f06a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.187913:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63525112 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.187926:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63525112 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.187941:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.187943:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.187948:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63525112 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.187955:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63525112 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.187967:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.187973:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525119 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.187978:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525119 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.187983:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce20f06c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.187986:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525119 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.187992:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525119 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.187999:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xe94006ef (ffff90cf22651300)
00010000:00010000:1.0:1789431561.188002:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.188004:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525119 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.188011:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525119 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xe94006ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.189015:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295806
00000100:00100000:3.0:1789431561.189036:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+266:14617:x1876351933434752:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431561.189115:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.189133:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525120 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8839 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189193:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525127 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189207:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525127 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.189214:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb6352510b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8832 expref: 267 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189220:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525127 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.189232:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.189236:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:3.0:1789431561.189240:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352512e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x1489dbad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.189242:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb6352510b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8832 expref: 267 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189254:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352512e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x1489dbad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.189263:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce20f06e00, rc 0)
00010000:00010000:3.0:1789431561.189264:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352512e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x1489dbad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189310:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525127 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189317:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525127 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189323:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525127 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189331:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00000100:00100000:1.0:1789431561.189332:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+266:14616:x1876351933434624:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2962us (3525us total) trans 0 rc 301/301
00010000:00010000:3.0:1789431561.189336:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525127 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.189344:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295805
00010000:00010000:3.0:1789431561.189455:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525127 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189464:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431561.189467:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.189471:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525127 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189477:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525127 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189487:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352512e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x1489dbad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189493:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352512e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x1489dbad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189499:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352512e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x1489dbad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189504:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.189507:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352512e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x1489dbad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189512:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352512e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x1489dbad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189519:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x1489dbad (ffff90cf18b78500)
00010000:00010000:3.0:1789431561.189521:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.189524:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352512e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x1489dbad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189529:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352512e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x1489dbad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189552:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525120 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8839 expref: 265 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189559:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431561.189561:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.189564:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525120 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8839 expref: 265 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.189573:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035ca800, rc 0)
00000100:00100000:3.0:1789431561.190035:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+264:14617:x1876351933434752:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1006us (4114us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431561.190043:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295806
00000100:00100000:2.0:1789431561.197288:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.197472:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933434880
00000100:00100000:0.0:1789431561.197483:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933434880
00000100:00100000:0.0:1789431561.197542:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295807
00000100:00100000:0.0:1789431561.197552:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+264:14616:x1876351933434880:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431561.197572:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431561.197592:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63525135 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8840 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197654:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352513c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197668:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352513c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197680:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352513c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197694:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525143 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197701:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197708:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197770:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352513c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197778:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352513c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197785:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352513c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197791:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.197796:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352513c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197803:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352513c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197814:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431561.197816:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.197821:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352513c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197827:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352513c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197840:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197846:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525143 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197853:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525143 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197859:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.197862:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525143 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197869:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525143 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197895:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xdaec91b0 (ffff90ce07190900)
00010000:00010000:0.0:1789431561.197898:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.197901:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525143 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197907:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525143 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197939:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63525135 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8840 expref: 265 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197949:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431561.197952:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.197955:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63525135 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8840 expref: 265 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.197965:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd5400, rc 0)
00000100:00100000:0.0:1789431561.198133:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+264:14616:x1876351933434880:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 581us (852us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431561.198140:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295807
00000100:00100000:1.0:1789431561.198940:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.199372:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933435008
00000100:00100000:2.0:1789431561.199381:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933435008
00000100:00100000:2.0:1789431561.199429:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295808
00000100:00100000:2.0:1789431561.199439:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+264:14617:x1876351933435008:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.199454:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.199472:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb6352514a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8847 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199527:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525151 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199541:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525151 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199552:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525151 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199566:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb63525158 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x3eeb752e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199573:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb63525158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x3eeb752e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199580:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb63525158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x3eeb752e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199626:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525151 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199633:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525151 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199639:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525151 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199645:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ae59600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.199649:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525151 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199656:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525151 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199667:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431561.199671:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.199675:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525151 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199681:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525151 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199697:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb63525158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x3eeb752e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199704:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb63525158 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x3eeb752e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199709:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb63525158 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x3eeb752e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199713:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ae59000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.199716:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb63525158 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x3eeb752e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199721:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb63525158 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x3eeb752e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199732:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x3eeb752e (ffff90cf13195a00)
00010000:00010000:2.0:1789431561.199735:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.199738:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb63525158 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x3eeb752e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199755:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb63525158 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x3eeb752e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199784:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb6352514a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8847 expref: 265 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199793:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431561.199795:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.199799:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb6352514a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8847 expref: 265 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.199807:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ae58200, rc 0)
00000100:00100000:2.0:1789431561.199864:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+264:14617:x1876351933435008:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 427us (927us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431561.199871:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295808
00000100:00100000:1.0:1789431561.207148:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.207233:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933435136
00000100:00100000:3.0:1789431561.207243:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933435136
00000100:00100000:3.0:1789431561.207297:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295809
00000100:00100000:3.0:1789431561.207307:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+264:14617:x1876351933435136:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431561.207326:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.207345:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352515f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c884e expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207406:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525166 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207422:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525166 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207433:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525166 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207446:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352516d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xd9c58084 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207453:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352516d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd9c58084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207459:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352516d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd9c58084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207510:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525166 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207521:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525166 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207527:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525166 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207532:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.207536:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525166 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207543:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525166 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207554:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431561.207557:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.207562:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525166 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207568:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525166 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207580:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352516d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd9c58084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207586:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352516d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd9c58084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207592:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352516d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd9c58084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207596:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.207599:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352516d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd9c58084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207605:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352516d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd9c58084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207611:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xd9c58084 (ffff90cf18b78500)
00010000:00010000:3.0:1789431561.207614:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.207617:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352516d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xd9c58084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207622:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352516d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xd9c58084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207649:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352515f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c884e expref: 265 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207658:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431561.207661:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.207665:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352515f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c884e expref: 265 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.207673:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035ca800, rc 0)
00000100:00100000:3.0:1789431561.207731:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+264:14617:x1876351933435136:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 425us (592us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431561.207739:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295809
00000100:00100000:2.0:1789431561.215908:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.216105:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933435264
00000100:00100000:3.0:1789431561.216114:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933435264
00000100:00100000:3.0:1789431561.216163:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295810
00000100:00100000:3.0:1789431561.216172:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+264:14617:x1876351933435264:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431561.216193:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.216213:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525174 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8855 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216271:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352517b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216351:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352517b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216365:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352517b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216382:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525182 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x8982f138 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216389:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8982f138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216396:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8982f138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216445:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352517b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216453:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352517b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216460:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352517b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216465:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.216470:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352517b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216478:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352517b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216489:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431561.216492:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.216497:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352517b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216503:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352517b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216515:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8982f138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216521:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525182 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8982f138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216527:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525182 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8982f138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216532:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.216535:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525182 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8982f138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216542:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525182 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x8982f138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216548:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x8982f138 (ffff90cf18b78d00)
00010000:00010000:3.0:1789431561.216551:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.216555:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525182 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x8982f138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216560:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525182 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x8982f138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216590:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525174 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8855 expref: 265 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216600:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431561.216603:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.216606:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525174 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8855 expref: 265 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.216615:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb600, rc 0)
00000100:00100000:3.0:1789431561.216672:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+264:14617:x1876351933435264:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 500us (774us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431561.216679:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295810
00000100:00100000:2.0:1789431561.220818:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.220882:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933435392
00000100:00100000:3.0:1789431561.220891:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933435392
00000100:00100000:3.0:1789431561.220944:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295811
00000100:00100000:3.0:1789431561.220954:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+264:14616:x1876351933435392:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431561.220973:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.220994:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63525189 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c885c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221083:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63525190 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221103:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63525190 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221114:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63525190 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221129:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63525197 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221137:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63525197 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221143:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63525197 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221193:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63525190 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221200:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63525190 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221207:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63525190 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221212:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f894a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.221216:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63525190 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221224:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63525190 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221239:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431561.221242:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.221247:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63525190 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221253:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0f894a00/0xd8e438fb63525190 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221265:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63525197 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221282:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63525197 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221289:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63525197 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221294:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.221297:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63525197 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221304:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63525197 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221311:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x18178cb5 (ffff90cf18b78100)
00010000:00010000:3.0:1789431561.221314:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.221316:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63525197 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221322:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2800/0xd8e438fb63525197 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221353:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63525189 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c885c expref: 265 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221363:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431561.221366:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.221369:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56200/0xd8e438fb63525189 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c885c expref: 265 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.221378:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf18a56200, rc 0)
00000100:00100000:3.0:1789431561.221432:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+264:14616:x1876351933435392:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 479us (623us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431561.221439:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295811
00000100:00100000:3.0:1789431561.229502:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.229533:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933435520
00000100:00100000:3.0:1789431561.229544:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933435520
00000100:00100000:3.0:1789431561.229703:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295812
00000100:00100000:3.0:1789431561.229714:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+264:14617:x1876351933435520:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431561.229734:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.229763:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2000/0xd8e438fb6352519e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8863 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.229829:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb635251a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.229844:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb635251a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.229859:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb635251a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.229873:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635251ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xfe99ec38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.229880:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635251ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xfe99ec38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.229886:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635251ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xfe99ec38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.229935:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb635251a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.229943:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb635251a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.229948:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb635251a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.229954:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.229958:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb635251a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.229965:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb635251a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.229976:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431561.229979:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.229984:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb635251a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.229989:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2200/0xd8e438fb635251a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.230001:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635251ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xfe99ec38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.230008:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635251ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xfe99ec38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.230014:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635251ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xfe99ec38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.230018:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.230021:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635251ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xfe99ec38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.230027:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635251ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xfe99ec38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.230035:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xfe99ec38 (ffff90cf18b78500)
00010000:00010000:3.0:1789431561.230037:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.230040:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635251ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xfe99ec38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.230045:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3a00/0xd8e438fb635251ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xfe99ec38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.230099:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2000/0xd8e438fb6352519e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8863 expref: 265 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.230113:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431561.230115:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.230118:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2000/0xd8e438fb6352519e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8863 expref: 265 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.230127:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e2000, rc 0)
00000100:00100000:3.0:1789431561.230183:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+264:14617:x1876351933435520:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 471us (690us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431561.230190:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295812
00000100:00100000:3.0:1789431561.234085:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.234121:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933435776
00000100:00100000:3.0:1789431561.234130:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933435776
00000100:00100000:3.0:1789431561.234180:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295813
00000100:00100000:3.0:1789431561.234191:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+264:14616:x1876351933435776:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431561.234211:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.234214:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431561.234239:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb635250ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8824 expref: 264 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.234258:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431561.234264:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431561.235067:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb635251b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c886a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.235181:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2a00/0xd8e438fb635251ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.235196:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2a00/0xd8e438fb635251ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.235206:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2a00/0xd8e438fb635251ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.235219:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2e00/0xd8e438fb635251c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.235225:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2e00/0xd8e438fb635251c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.235231:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2e00/0xd8e438fb635251c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:3.0:1789431561.235623:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x513:0x0], index 1: 0
00010000:00010000:3.0:1789431561.236281:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb635251c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.236295:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb635251c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.236304:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb635251c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.236338:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2a00/0xd8e438fb635251ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.236345:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2a00/0xd8e438fb635251ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.236356:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2a00/0xd8e438fb635251ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.236362:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.236366:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2a00/0xd8e438fb635251ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.236373:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2a00/0xd8e438fb635251ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.236391:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431561.236395:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.236399:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2a00/0xd8e438fb635251ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.236405:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2a00/0xd8e438fb635251ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431561.236417:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008436b308 reply state 0000000076186d73 transno 4295120892 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2e00/0xd8e438fb635251c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.236426:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431561.236454:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3000/0xd8e438fb635251b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c886a expref: 266 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.236467:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb635251c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c886a expref: 265 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.236474:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa3:0x0].0x0 (ffff90cf18b78200)
00010000:00010000:3.0:1789431561.236477:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431561.236480:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e2400, rc 0)
00000100:00100000:3.0:1789431561.236539:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+266:14616:x1876351933435776:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2350us (2463us total) trans 4295120892 rc 0/0
00000100:00100000:3.0:1789431561.236546:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295813
00000100:00100000:3.0:1789431561.237826:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.237853:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933435904
00000100:00100000:3.0:1789431561.237862:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933435904
00000100:00100000:3.0:1789431561.237901:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295814
00000100:00100000:3.0:1789431561.237909:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+266:14617:x1876351933435904:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431561.237926:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.237940:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3400/0xd8e438fb635251d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8871 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.237990:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635251dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238001:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635251dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238010:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635251dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238024:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635251e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa6e377a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238031:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635251e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa6e377a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238037:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635251e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa6e377a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238098:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635251dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238106:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635251dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238112:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635251dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238118:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.238121:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635251dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238128:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635251dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238138:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431561.238141:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.238146:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635251dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238152:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2600/0xd8e438fb635251dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238163:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635251e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa6e377a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238169:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635251e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa6e377a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238175:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635251e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa6e377a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238180:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf18a56e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.238183:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635251e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa6e377a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238189:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635251e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa6e377a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238194:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xa6e377a8 (ffff90cf18b78800)
00010000:00010000:3.0:1789431561.238197:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.238199:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635251e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa6e377a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238204:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a56e00/0xd8e438fb635251e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa6e377a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238230:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3400/0xd8e438fb635251d6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8871 expref: 267 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238238:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431561.238240:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.238244:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3400/0xd8e438fb635251d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8871 expref: 267 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.238251:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2a7e3400, rc 0)
00000100:00100000:3.0:1789431561.238291:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+266:14617:x1876351933435904:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 382us (471us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431561.238297:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295814
00010000:00010000:1.0:1789431561.239314:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2e00/0xd8e438fb635251c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.239328:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2e00/0xd8e438fb635251c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.239335:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2e00/0xd8e438fb635251c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.239340:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2a7e2e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.239343:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2e00/0xd8e438fb635251c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.239351:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2e00/0xd8e438fb635251c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.239364:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x18178cb5 (ffff90cf18b78400)
00010000:00010000:1.0:1789431561.239366:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.239371:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2e00/0xd8e438fb635251c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.239376:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2e00/0xd8e438fb635251c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.247976:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.248020:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.248072:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933436160
00000100:00100000:1.0:1789431561.248082:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933436160
00000100:00100000:1.0:1789431561.248130:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295815
00000100:00100000:1.0:1789431561.248140:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+265:14617:x1876351933436160:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.248161:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.248182:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb635251eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c887f expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.248247:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635251f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.248261:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635251f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.248362:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933436032
00000100:00100000:0.0:1789431561.248367:0:14505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933436032
00000100:00100000:0.0:1789431561.248398:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8264
00000100:00100000:0.0:1789431561.248405:0:14505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+99:2349:x1876351933436032:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431561.248414:0:14505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431561.248429:0:14505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb635251f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8878 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789431561.248459:0:14505:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x513:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431561.248475:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x513:0x0].0x0 since=3019s v=(0 0)
00010000:00010000:0.0:1789431561.248480:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x513:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431561.248487:0:14505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb635251f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8878 expref: 100 pid: 14505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.248501:0:14505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb635251f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8878 expref: 100 pid: 14505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.248512:0:14505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce27814e00, rc 0)
00000100:00100000:0.0:1789431561.248566:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+100:2349:x1876351933436032:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 161us (599us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.248573:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8264
00010000:00010000:1.0:1789431561.249022:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635251f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249068:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525200 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xd138b873 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249078:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525200 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd138b873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249086:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525200 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd138b873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249136:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635251f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249144:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635251f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249151:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635251f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249157:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce20f06e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.249161:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635251f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249168:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635251f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249179:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431561.249182:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.249186:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635251f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249192:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06e00/0xd8e438fb635251f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249204:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525200 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd138b873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249211:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525200 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd138b873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249216:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525200 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd138b873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249221:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce20f06c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.249224:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525200 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd138b873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249229:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525200 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xd138b873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249236:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xd138b873 (ffff90cf22651300)
00010000:00010000:1.0:1789431561.249239:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.249241:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525200 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xd138b873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249247:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06c00/0xd8e438fb63525200 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xd138b873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249337:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb635251eb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c887f expref: 266 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249348:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431561.249350:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.249355:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1c00/0xd8e438fb635251eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c887f expref: 266 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.249364:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b5e1c00, rc 0)
00000100:00100000:1.0:1789431561.249447:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+265:14617:x1876351933436160:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1308us (1425us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431561.249454:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295815
00000100:00100000:1.0:1789431561.261826:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.261860:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.261888:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933436544
00000100:00100000:1.0:1789431561.261897:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933436544
00000100:00100000:1.0:1789431561.261945:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295816
00000100:00100000:1.0:1789431561.261955:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+265:14617:x1876351933436544:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.261975:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.261995:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63525207 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8886 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262075:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352520e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262093:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352520e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262105:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352520e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262120:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525215 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262127:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525215 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262134:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525215 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262233:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352521c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262242:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352521c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262249:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352521c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431561.262288:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bd:0x0]: returning size 260096
00000004:00200000:1.0:1789431561.262293:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431561.262311:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352521c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262323:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352521c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262332:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352520e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262338:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352520e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262345:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352520e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262352:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f77a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.262356:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352520e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262365:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352520e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262375:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431561.262378:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.262383:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352520e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262389:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352520e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262403:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525215 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262409:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525215 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262415:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525215 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262419:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f76400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.262422:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525215 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262428:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525215 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262434:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x77103a66 (ffff90cf22651200)
00010000:00010000:1.0:1789431561.262436:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.262439:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525215 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262445:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525215 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262475:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06a00/0xd8e438fb63525207 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8886 expref: 267 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262489:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352521c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8886 expref: 266 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.262495:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:1.0:1789431561.262498:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431561.262500:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37f77c00, rc 0)
00000100:00100000:1.0:1789431561.262557:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+266:14617:x1876351933436544:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 604us (696us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.262564:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295816
00000100:00100000:3.0:1789431561.262644:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933436416
00000100:00100000:3.0:1789431561.262649:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933436416
00000100:00100000:3.0:1789431561.262689:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12434
00000100:00100000:3.0:1789431561.262698:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+266:14616:x1876351933436416:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431561.262951:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+267:14616:x1876351933436416:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 253us (1134us total) trans 4295120893 rc 0/0
00000100:00100000:3.0:1789431561.262958:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12434
00000001:00080000:3.0:1789431561.267149:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970001 is committed
00000001:00080000:3.0:1789431561.267216:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970002 is committed
00000001:00080000:3.0:1789431561.267226:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969969 is committed
00000100:00100000:1.0:1789431561.272816:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.272901:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933436800
00000100:00100000:2.0:1789431561.272910:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933436800
00000100:00100000:2.0:1789431561.272969:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295817
00000100:00100000:2.0:1789431561.272978:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+267:14617:x1876351933436800:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.273000:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.273021:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb63525223 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c888d expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.273230:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.273245:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb6350f7b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c1f08 expref: 268 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.273252:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352521c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8886 expref: 268 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.273259:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 5/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.273291:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352521c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8886 expref: 268 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.273303:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352521c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8886 expref: 268 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.273315:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a044a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894212480:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431561.273400:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb6350f7b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c1f08 expref: 268 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.273409:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb6350f7b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c1f08 expref: 268 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.273416:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a045f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894212608:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431561.273436:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1f00 going to sleep for 11 seconds
00000100:00100000:1.0:1789431561.273646:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.273722:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933436928
00000100:00100000:2.0:1789431561.273727:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933436928
00010000:00010000:2.0:1789431561.273756:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352521c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8886 expref: 269 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.273784:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16460
00000100:00100000:2.0:1789431561.273791:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+269:2347:x1876351933436928:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.273800:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.273807:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352521c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8886 expref: 269 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.273817:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352521c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8886 expref: 269 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.273834:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:2.0:1789431561.273839:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.273845:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.273851:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.273916:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+269:2347:x1876351933436928:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 125us (270us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.273923:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16460
00010000:00010000:2.0:1789431561.278965:0:12181:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@0000000052df1e1a x1876351894212480) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352521c lrc: 1/0,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8886 expref: 268 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.278997:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb6352521c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8886 expref: 268 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.279014:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a044a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894212480:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431561.279028:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a045f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894212608:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431561.279221:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:2.0:1789431561.279228:0:12181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.279237:0:12181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.279248:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.280396:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.280538:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.280877:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933437184
00000100:00100000:2.0:1789431561.280887:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933437184
00000100:00100000:2.0:1789431561.280950:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295818
00000100:00100000:2.0:1789431561.280961:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+268:14616:x1876351933437184:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431561.281013:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.281037:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e2400/0xd8e438fb635251c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c886a expref: 268 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281094:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa3:0x0].0x0 (ffff90cf18b78200)
00010000:00010000:2.0:1789431561.281104:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431561.281123:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525231 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281135:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525231 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281144:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525231 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281157:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63525238 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281163:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63525238 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281168:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63525238 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281266:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352523f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aa3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281272:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352523f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281278:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352523f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431561.281725:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1216, 64 off86080
00010000:00010000:2.0:1789431561.281793:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525246 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aa3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281801:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281812:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281819:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525246 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281824:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525246 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281830:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525246 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281845:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431561.281861:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352523f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281867:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352523f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aa3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281873:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352523f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281878:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.281882:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352523f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281889:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352523f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aa3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281896:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa3:0x0].0x0 (ffff90cf13195300)
00010000:00010000:2.0:1789431561.281898:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431561.281902:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352523f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aa3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281907:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352523f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aa3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281920:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525231 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281924:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525231 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281929:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525231 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281933:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ae59600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.281935:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525231 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281939:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525231 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281944:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431561.281946:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.281948:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525231 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.281953:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59600/0xd8e438fb63525231 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431561.281963:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000054149aa2 reply state 000000009a81ba59 transno 4295120894 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63525238 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.281974:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431561.282043:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+269:14616:x1876351933437184:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1083us (1505us total) trans 4295120894 rc 0/0
00000100:00100000:2.0:1789431561.282072:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295818
00010000:00010000:0.0:1789431561.282212:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431561.282219:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525246 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.282230:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431561.282234:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525246 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.282241:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525246 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.282255:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa3:0x0].0x0 (ffff90cf13195300)
00010000:00010000:0.0:1789431561.282257:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431561.282260:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525246 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10aa3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.282265:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525246 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aa3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.282279:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.282281:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431561.282283:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431561.282416:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933437312
00000100:00100000:1.0:1789431561.282423:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933437312
00010000:00010000:1.0:1789431561.282452:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb6350f7b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c1f08 expref: 269 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.282483:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16461
00000100:00100000:1.0:1789431561.282491:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+269:2348:x1876351933437312:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431561.282501:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431561.282506:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb6350f7b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c1f08 expref: 269 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.282518:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb6350f7b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c1f08 expref: 269 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.282532:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb6350f7b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c1f08 expref: 269 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.282542:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:1.0:1789431561.282546:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.282555:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.282561:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.282752:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431561.282787:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+268:2348:x1876351933437312:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 297us (2396us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.282795:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16461
00010000:00010000:3.0:1789431561.283424:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.283435:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431561.283453:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bd:0x0]: returning size 260096
00010000:00010000:3.0:1789431561.283645:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58200/0xd8e438fb63525223 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c888d expref: 269 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.283662:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c888d expref: 268 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.283669:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:3.0:1789431561.283671:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431561.283674:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2ae59000, rc 0)
00000100:00100000:3.0:1789431561.283967:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+268:14617:x1876351933436800:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10990us (11160us total) trans 4295120895 rc 0/0
00000100:00100000:3.0:1789431561.283974:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295817
00010000:00010000:2.0:1789431561.284306:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63525238 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.284315:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63525238 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.284321:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63525238 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.284326:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2ae59400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.284329:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63525238 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.284335:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63525238 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.284346:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x18178cb5 (ffff90cf13195a00)
00010000:00010000:2.0:1789431561.284348:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.284351:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63525238 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.284413:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59400/0xd8e438fb63525238 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x18178cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.293230:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.293320:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933437440
00000100:00100000:1.0:1789431561.293330:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933437440
00000100:00100000:1.0:1789431561.293396:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295819
00000100:00100000:1.0:1789431561.293406:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+267:14616:x1876351933437440:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.293428:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.293448:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525254 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8894 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293516:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352525b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293529:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352525b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293539:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352525b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293552:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525262 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293557:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525262 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293563:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525262 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293614:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352525b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293620:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352525b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293626:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352525b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293632:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.293635:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352525b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293645:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352525b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293655:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.293657:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.293661:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352525b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293666:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352525b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293677:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525262 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293682:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525262 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293687:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525262 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293692:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.293694:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525262 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293700:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525262 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293708:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xdaec91b0 (ffff90cf22651200)
00010000:00010000:1.0:1789431561.293710:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.293712:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525262 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293717:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525262 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293759:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525254 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8894 expref: 268 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293770:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.293772:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.293775:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525254 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8894 expref: 268 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.293785:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:1.0:1789431561.293843:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+267:14616:x1876351933437440:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 438us (624us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431561.293849:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295819
00000100:00100000:0.0:1789431561.299152:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.299299:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933437696
00000100:00100000:2.0:1789431561.299309:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933437696
00000100:00100000:2.0:1789431561.299362:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295820
00000100:00100000:2.0:1789431561.299372:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+267:14616:x1876351933437696:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.299411:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.299431:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525269 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c88a2 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.299488:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525270 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.299501:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.299512:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431561.299546:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:2.0:1789431561.299550:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431561.299569:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.299593:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525269 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88a2 expref: 269 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.299609:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525270 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88a2 expref: 268 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.299617:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431561.299620:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:2.0:1789431561.299624:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad000, rc 0)
00000100:00100000:2.0:1789431561.299685:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+268:14616:x1876351933437696:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 313us (541us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.299692:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295820
00000100:00100000:0.0:1789431561.302391:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.302478:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933437568
00000100:00100000:3.0:1789431561.302488:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933437568
00000100:00100000:3.0:1789431561.302539:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295821
00000100:00100000:3.0:1789431561.302549:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+268:14617:x1876351933437568:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431561.302569:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.302587:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525277 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c889b expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.302662:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352527e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.302675:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c888d expref: 269 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.302683:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352527e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.302715:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c888d expref: 269 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.302727:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c888d expref: 269 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.302752:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce029f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894212736:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431561.302829:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf0620a9c0 going to sleep for 11 seconds
00000100:00100000:1.0:1789431561.304305:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.305841:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933437824
00000100:00100000:2.0:1789431561.305853:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933437824
00000100:00100000:2.0:1789431561.305918:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12435
00000100:00100000:2.0:1789431561.305926:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+270:14616:x1876351933437824:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431561.309799:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.310658:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+270:14616:x1876351933437824:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 4727us (6355us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.310668:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12435
00000100:00100000:3.0:1789431561.311228:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce029f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894212736:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431561.311255:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352527e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.311379:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933437952
00000100:00100000:2.0:1789431561.311387:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933437952
00010000:00010000:2.0:1789431561.311419:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c888d expref: 270 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.311456:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16462
00000100:00100000:2.0:1789431561.311465:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+270:2347:x1876351933437952:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.311479:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.311486:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c888d expref: 270 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.311498:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c888d expref: 270 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.311518:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae59000/0xd8e438fb6352522a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c888d expref: 270 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.311536:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:2.0:1789431561.311541:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352527e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.311550:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352527e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.311557:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352527e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.311584:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.311626:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+269:2347:x1876351933437952:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 162us (1836us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.311633:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16462
00010000:00010000:1.0:1789431561.311729:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352527e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.311736:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352527e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431561.311790:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bd:0x0]: returning size 260096
00000004:00200000:1.0:1789431561.311794:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431561.311813:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352527e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.311842:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525277 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100bd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c889b expref: 269 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.311856:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352527e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c889b expref: 268 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.311862:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:1.0:1789431561.311864:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431561.311867:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb600, rc 0)
00000100:00100000:1.0:1789431561.311891:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+268:14617:x1876351933437568:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9344us (9512us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.311897:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295821
00000100:00100000:0.0:1789431561.331077:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.331113:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.331311:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933438208
00000100:00100000:1.0:1789431561.331321:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933438208
00000100:00100000:1.0:1789431561.331388:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295822
00000100:00100000:1.0:1789431561.331399:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+268:14616:x1876351933438208:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.331418:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.331442:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525285 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c88a9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331517:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352528c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331534:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352528c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.331534:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933438464
00000100:00100000:3.0:1789431561.331549:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933438464
00010000:00010000:1.0:1789431561.331560:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352528c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331583:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525293 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331594:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331603:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331749:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352528c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331756:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352528c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331764:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352528c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331770:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.331774:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352528c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331781:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352528c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331793:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.331796:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.331801:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352528c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331808:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352528c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331820:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331827:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525293 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331833:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331838:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.331841:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331847:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525293 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331854:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xdaec91b0 (ffff90cf22651200)
00010000:00010000:1.0:1789431561.331857:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.331860:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525293 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331866:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525293 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xdaec91b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331900:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525285 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88a9 expref: 270 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331917:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.331919:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:1.0:1789431561.331923:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525285 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88a9 expref: 270 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.331933:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:1.0:1789431561.332011:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+269:14616:x1876351933438208:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 614us (963us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431561.332018:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295822
00000100:00100000:1.0:1789431561.336021:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12436
00000100:00100000:1.0:1789431561.336089:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+268:14617:x1876351933438464:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431561.336342:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+269:14617:x1876351933438464:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 307us (5227us total) trans 4295120896 rc 0/0
00000100:00100000:1.0:1789431561.336351:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12436
00000100:00100000:0.0:1789431561.346164:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.346285:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933438592
00000100:00100000:2.0:1789431561.346295:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933438592
00000100:00100000:2.0:1789431561.346351:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295823
00000100:00100000:2.0:1789431561.346361:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+269:14616:x1876351933438592:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.346385:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.346407:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352529a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c88b0 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346470:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346485:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346496:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346510:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346520:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346526:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346578:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346585:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346592:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346597:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ace00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.346601:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346608:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346619:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431561.346623:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.346628:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346633:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346645:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346651:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346656:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346661:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.346664:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346670:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346677:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x8deccae1 (ffff90cf13195a00)
00010000:00010000:2.0:1789431561.346680:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.346683:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346688:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346725:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352529a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88b0 expref: 270 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346736:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431561.346751:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.346755:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352529a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88b0 expref: 270 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.346769:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7acc00, rc 0)
00000100:00100000:2.0:1789431561.346824:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+269:14616:x1876351933438592:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 465us (669us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431561.346832:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295823
00000100:00100000:3.0:1789431561.347034:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.347113:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933438720
00000100:00100000:0.0:1789431561.347120:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933438720
00000100:00100000:0.0:1789431561.347154:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295824
00000100:00100000:0.0:1789431561.347165:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+269:14617:x1876351933438720:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431561.347175:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431561.347188:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb635252af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c88b7 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347222:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635252b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347236:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635252b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347244:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635252b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347254:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635252bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347261:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635252bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347268:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635252bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347334:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635252c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347341:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635252c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347348:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635252c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431561.347378:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bd:0x0]: returning size 260096
00000004:00200000:0.0:1789431561.347383:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431561.347400:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635252c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347411:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635252c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347422:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635252b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347428:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635252b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347434:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635252b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347439:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.347442:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635252b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347448:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635252b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347456:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431561.347458:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.347461:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635252b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347467:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635252b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347477:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635252bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347482:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635252bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347487:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635252bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347492:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.347495:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635252bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347500:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635252bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347506:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x77103a66 (ffff90ce07190e00)
00010000:00010000:0.0:1789431561.347507:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.347510:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635252bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347514:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635252bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347536:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4a00/0xd8e438fb635252af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88b7 expref: 271 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347546:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635252c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88b7 expref: 270 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.347551:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:0.0:1789431561.347553:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431561.347556:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4e00, rc 0)
00000100:00100000:0.0:1789431561.347596:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+270:14617:x1876351933438720:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 436us (571us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.347602:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295824
00000100:00100000:3.0:1789431561.355610:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.355675:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.355759:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933439104
00000100:00100000:2.0:1789431561.355774:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933439104
00000100:00100000:2.0:1789431561.355850:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295825
00000100:00100000:2.0:1789431561.355861:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+270:14616:x1876351933439104:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.355880:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.355883:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:2.0:1789431561.355906:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525270 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88a2 expref: 270 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.355925:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431561.355930:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431561.355943:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635252cb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c88be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.356104:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.356119:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.356129:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.356147:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.356154:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.356160:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:2.0:1789431561.356617:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x514:0x0], index 0: 0
00010000:00010000:2.0:1789431561.356771:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635252e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.356781:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635252e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.356791:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635252e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.356824:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.356831:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252d2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.356839:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.356845:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.356850:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.356863:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.356874:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431561.356877:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.356882:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.356889:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635252d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431561.356901:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007d09daa4 reply state 000000000f6a2746 transno 4295120897 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.356910:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431561.356938:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431561.356942:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635252cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88be expref: 272 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.356961:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635252e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88be expref: 271 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.356970:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa4:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431561.356973:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431561.356976:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ac400, rc 0)
00000100:00100000:2.0:1789431561.357079:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+272:14616:x1876351933439104:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1190us (1375us total) trans 4295120897 rc 0/0
00000100:00100000:2.0:1789431561.357089:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295825
00000100:00100000:2.0:1789431561.357114:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933439360
00000100:00100000:2.0:1789431561.357121:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933439360
00000100:00100000:2.0:1789431561.357163:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295826
00000100:00100000:2.0:1789431561.357173:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+272:14617:x1876351933439360:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.357185:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.357197:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e3400/0xd8e438fb635252ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c88c5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.357257:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.357268:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352527e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c889b expref: 273 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.357276:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635252c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88b7 expref: 273 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.357285:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.357312:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635252c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88b7 expref: 273 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.357326:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635252c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88b7 expref: 273 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.357339:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a045f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894212864:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431561.357411:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352527e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c889b expref: 273 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.357426:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352527e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c889b expref: 273 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.357436:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a044a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894212992:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431561.357466:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1180 going to sleep for 11 seconds
00000100:00100000:0.0:1789431561.359417:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933438848
00000100:00100000:0.0:1789431561.359429:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933438848
00010000:00010000:2.0:1789431561.359546:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635252c4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88b7 expref: 274 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.359623:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16463
00000100:00100000:2.0:1789431561.359633:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+274:2350:x1876351933438848:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.359647:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.359654:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635252c4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88b7 expref: 274 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.359668:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635252c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88b7 expref: 274 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.359686:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:2.0:1789431561.359691:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.359699:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.359706:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.359809:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+274:2350:x1876351933438848:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 176us (4213us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.359816:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16463
00010000:00010000:1.0:1789431561.365004:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.365026:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.365034:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.365041:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ace00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.365085:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.365099:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.365121:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x8deccae1 (ffff90cf13195a00)
00010000:00010000:1.0:1789431561.365124:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.365130:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.365137:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635252d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.372959:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.373120:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933439488
00000100:00100000:0.0:1789431561.373137:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933439488
00010000:00010000:2.0:1789431561.373161:0:5849:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@000000007cb2fd91 x1876351894212864) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635252c4 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88b7 expref: 272 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.373185:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635252c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88b7 expref: 272 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.373198:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8265
00000100:00100000:2.0:1789431561.373207:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a045f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894212864:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431561.373213:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+112:2347:x1876351933439488:12345-192.168.203.4@tcp:101:dbench.0
00000100:00100000:2.0:1789431561.373228:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a044a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894212992:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431561.373232:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.373250:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:0.0:1789431561.373254:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb635252fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c88cc expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.373258:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.373277:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.373286:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789431561.373291:0:8217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x514:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431561.373318:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x514:0x0].0x0 since=3019s v=(0 0)
00010000:00010000:0.0:1789431561.373323:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x514:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431561.373332:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb635252fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88cc expref: 113 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.373349:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb635252fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88cc expref: 113 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.373362:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4a00, rc 0)
00000100:00100000:0.0:1789431561.373422:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+113:2347:x1876351933439488:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 214us (479us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.373429:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8265
00000100:00100000:3.0:1789431561.374126:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.374253:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933439616
00000100:00100000:2.0:1789431561.374263:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933439616
00010000:00010000:2.0:1789431561.374294:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352527e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c889b expref: 272 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.374334:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16464
00000100:00100000:2.0:1789431561.374343:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e957850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+272:2350:x1876351933439616:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.374366:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.374372:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352527e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c889b expref: 272 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.374384:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352527e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c889b expref: 272 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.374402:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352527e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c889b expref: 272 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.374422:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:2.0:1789431561.374427:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.374436:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.374443:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.374474:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.374524:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e957850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+271:2350:x1876351933439616:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 182us (404us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.374530:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16464
00010000:00010000:3.0:1789431561.374682:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.374697:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431561.374726:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bd:0x0]: returning size 260096
00010000:00010000:3.0:1789431561.375354:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e3400/0xd8e438fb635252ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88c5 expref: 272 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.375380:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88c5 expref: 271 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.375389:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:3.0:1789431561.375393:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431561.375396:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce249e2c00, rc 0)
00000100:00100000:3.0:1789431561.375466:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+271:14617:x1876351933439360:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 18292us (18535us total) trans 4295120898 rc 0/0
00000100:00100000:3.0:1789431561.375476:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295826
00000100:00100000:3.0:1789431561.378043:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.378171:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933439872
00000100:00100000:0.0:1789431561.378185:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933439872
00000100:00100000:0.0:1789431561.378302:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12437
00000100:00100000:0.0:1789431561.378315:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+271:14616:x1876351933439872:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431561.378887:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+272:14616:x1876351933439872:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 572us (854us total) trans 4295120899 rc 0/0
00000100:00100000:0.0:1789431561.378898:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12437
00000100:00100000:2.0:1789431561.385141:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.385310:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933440000
00000100:00100000:1.0:1789431561.385329:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933440000
00000100:00100000:1.0:1789431561.385420:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295827
00000100:00100000:1.0:1789431561.385434:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+272:14617:x1876351933440000:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.385482:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.385511:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352530a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c88d3 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.385791:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525311 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.385811:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88c5 expref: 273 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.385821:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525311 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.385864:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88c5 expref: 273 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.385882:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88c5 expref: 273 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.385899:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894213120:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431561.386008:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e180 going to sleep for 11 seconds
00000100:00100000:3.0:1789431561.389346:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.389560:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894213120:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431561.389869:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525311 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.390244:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933440128
00000100:00100000:2.0:1789431561.390257:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933440128
00010000:00010000:2.0:1789431561.390373:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88c5 expref: 274 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.390474:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16465
00000100:00100000:2.0:1789431561.390485:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+274:2348:x1876351933440128:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.390503:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.390512:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88c5 expref: 274 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.390526:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88c5 expref: 274 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.390552:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e2c00/0xd8e438fb635252f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88c5 expref: 274 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.390571:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:2.0:1789431561.390589:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525311 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.390601:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.390611:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525311 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.390645:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.390726:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+273:2348:x1876351933440128:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 242us (1399us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.390734:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16465
00010000:00010000:1.0:1789431561.391599:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.391616:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431561.391670:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bd:0x0]: returning size 260096
00000004:00200000:1.0:1789431561.391674:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431561.391708:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.391760:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352530a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100bd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88d3 expref: 273 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.391782:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525311 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88d3 expref: 272 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.391790:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:1.0:1789431561.391793:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431561.391797:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:1.0:1789431561.391881:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+272:14617:x1876351933440000:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6449us (6750us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.391890:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295827
00000100:00100000:0.0:1789431561.401034:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.401237:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.401470:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933440640
00000100:00100000:3.0:1789431561.401483:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933440640
00000100:00100000:3.0:1789431561.401555:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12438
00000100:00100000:3.0:1789431561.401566:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+272:14617:x1876351933440640:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431561.401907:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+273:14617:x1876351933440640:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 342us (668us total) trans 4295120900 rc 0/0
00000100:00100000:3.0:1789431561.401916:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12438
00000100:00100000:2.0:1789431561.406691:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933440384
00000100:00100000:2.0:1789431561.406714:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933440384
00000100:00100000:2.0:1789431561.406941:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295828
00000100:00100000:2.0:1789431561.406953:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+273:14616:x1876351933440384:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431561.407030:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.407095:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635252e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88be expref: 273 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.407119:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa4:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431561.407132:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431561.407162:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525318 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.407178:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525318 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.407192:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525318 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.407208:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352531f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.407215:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352531f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.407223:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352531f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.407385:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525326 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aa4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.407398:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.407405:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.407935:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000040:00080000:2.0:1789431561.408630:0:12775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1215, 64 off85952
00000004:00080000:2.0:1789431561.408640:0:12775:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3019439590292ns, next at 3020439587419ns, rc = 0
00010000:00010000:2.0:1789431561.408718:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352532d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aa4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408734:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352532d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408764:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352532d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408775:0:12775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352532d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408782:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352532d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408788:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352532d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408820:0:12775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431561.408847:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408854:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525326 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aa4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408860:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525326 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408867:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.408872:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525326 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408880:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525326 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aa4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408891:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa4:0x0].0x0 (ffff90cf13195600)
00010000:00010000:2.0:1789431561.408895:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431561.408900:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525326 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aa4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408906:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525326 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aa4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408929:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525318 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408934:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525318 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408940:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525318 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408944:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.408947:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525318 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408958:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525318 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408965:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431561.408967:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.408969:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525318 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.408975:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525318 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431561.408985:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000769f499c reply state 00000000dcc6744e transno 4295120901 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352531f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.408994:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431561.409139:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+274:14616:x1876351933440384:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2185us (8116us total) trans 4295120901 rc 0/0
00000100:00100000:2.0:1789431561.409149:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295828
00010000:00010000:1.0:1789431561.409227:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431561.409235:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352532d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.409242:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ace00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431561.409245:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352532d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.409252:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352532d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.409262:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa4:0x0].0x0 (ffff90cf13195600)
00010000:00010000:1.0:1789431561.409264:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431561.409267:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352532d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10aa4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.409288:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352532d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aa4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.409306:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.409308:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.409310:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431561.416468:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933440768
00000100:00100000:2.0:1789431561.416493:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933440768
00000100:00100000:2.0:1789431561.416589:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295829
00000100:00100000:2.0:1789431561.416603:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+274:14617:x1876351933440768:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.416633:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.416667:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525334 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c88da expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.416777:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb6352533b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.416802:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb6352533b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.416816:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb6352533b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.416834:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525342 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.416843:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.416850:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417003:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525349 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417014:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417021:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431561.417100:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bd:0x0]: returning size 260096
00000004:00200000:2.0:1789431561.417107:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431561.417133:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417149:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417164:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb6352533b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417171:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb6352533b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417179:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb6352533b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417185:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.417191:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb6352533b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417201:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb6352533b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417216:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431561.417220:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.417226:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb6352533b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417233:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb6352533b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417249:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417255:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525342 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417261:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525342 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417266:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.417269:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525342 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417275:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525342 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417298:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x77103a66 (ffff90cf13195200)
00010000:00010000:2.0:1789431561.417301:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.417304:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525342 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417311:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525342 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417351:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525334 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88da expref: 276 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417368:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88da expref: 275 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.417375:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:2.0:1789431561.417377:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431561.417379:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce249e1a00, rc 0)
00000100:00100000:2.0:1789431561.418574:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+275:14617:x1876351933440768:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1964us (10632us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.418585:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295829
00000100:00100000:0.0:1789431561.426808:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.426847:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.426881:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431561.426926:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352531f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.426928:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933440896
00010000:00010000:2.0:1789431561.426944:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352531f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.426945:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933440896
00010000:00010000:2.0:1789431561.426956:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352531f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.426963:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.426969:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352531f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.426978:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352531f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.427000:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x8deccae1 (ffff90cf13195900)
00010000:00010000:2.0:1789431561.427004:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.427011:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352531f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.427018:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352531f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x8deccae1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.427021:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933441152
00000100:00100000:3.0:1789431561.427027:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933441152
00000100:00100000:3.0:1789431561.427081:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295830
00000100:00100000:3.0:1789431561.427095:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+275:14616:x1876351933440896:12345-192.168.203.4@tcp:101:dbench.0
00000100:00100000:2.0:1789431561.427118:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295831
00000100:00100000:2.0:1789431561.427131:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+275:14617:x1876351933441152:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431561.427131:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.427143:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.427156:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525350 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c88e1 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.427157:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb63525357 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c88e8 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427249:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352535e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427267:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352535e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.427295:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63525365 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427300:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352535e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.427312:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525311 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88d3 expref: 277 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.427325:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525349 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88da expref: 277 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427326:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352536c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.427343:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63525365 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427345:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352536c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427359:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352536c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.427391:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88da expref: 277 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427427:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352535e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427435:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352535e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427442:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352535e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427448:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.427451:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352535e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427458:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352535e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427467:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431561.427469:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.427473:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352535e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427479:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352535e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427489:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352536c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427496:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352536c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427501:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352536c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427506:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.427509:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352536c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427515:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352536c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427522:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x148c06c6 (ffff90cf18b78800)
00010000:00010000:3.0:1789431561.427524:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.427527:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352536c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427532:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352536c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.427542:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525349 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88da expref: 277 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.427561:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a045f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894213248:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431561.427567:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525350 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88e1 expref: 277 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427578:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431561.427580:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.427584:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525350 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88e1 expref: 277 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.427598:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cba00, rc 0)
00010000:00010000:2.0:1789431561.427674:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525311 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88d3 expref: 276 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.427683:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525311 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88d3 expref: 276 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.427692:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a047800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894213376:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431561.427805:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+276:14616:x1876351933440896:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 712us (1009us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431561.427815:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295830
00000100:00100000:2.0:1789431561.431234:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1480 going to sleep for 11 seconds
00000100:00100000:0.0:1789431561.432618:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933441280
00000100:00100000:0.0:1789431561.432640:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933441280
00010000:00010000:0.0:1789431561.432730:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525349 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88da expref: 276 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.432802:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16466
00000100:00100000:0.0:1789431561.432814:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+276:2347:x1876351933441280:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431561.432833:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431561.432842:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525349 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88da expref: 276 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.432858:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525349 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88da expref: 276 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.432886:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:0.0:1789431561.432893:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63525365 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.432903:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63525365 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.432915:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431561.432985:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+276:2347:x1876351933441280:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 173us (6103us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.432992:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16466
00000100:00100000:3.0:1789431561.440300:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.440484:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933441408
00000100:00100000:2.0:1789431561.440495:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933441408
00010000:00010000:0.0:1789431561.440514:0:12775:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@000000007cb2fd91 x1876351894213248) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525349 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88da expref: 276 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.440543:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525349 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88da expref: 276 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.440565:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a045f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894213248:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431561.440573:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295832
00000100:00100000:2.0:1789431561.440585:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+275:14616:x1876351933441408:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.440626:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.440652:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525373 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c88ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.440737:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb6352537a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.440770:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb6352537a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.440785:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb6352537a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431561.440831:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:2.0:1789431561.440835:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431561.440859:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb6352537a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.440889:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525373 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88ef expref: 277 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.440905:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb6352537a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88ef expref: 276 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.440914:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431561.440917:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:2.0:1789431561.440921:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf421ef000, rc 0)
00000100:00100000:2.0:1789431561.440998:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+276:14616:x1876351933441408:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 415us (727us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.441006:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295832
00000100:00100000:0.0:1789431561.451574:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.451633:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.451714:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933441536
00000100:00100000:3.0:1789431561.451727:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933441536
00000100:00100000:1.0:1789431561.451747:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933441664
00000100:00100000:1.0:1789431561.451763:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933441664
00010000:00010000:3.0:1789431561.451797:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525311 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88d3 expref: 277 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.451840:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12439
00000100:00100000:3.0:1789431561.451849:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16467
00000100:00100000:1.0:1789431561.451862:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+277:14616:x1876351933441664:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431561.451867:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+277:2348:x1876351933441536:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431561.451892:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431561.451901:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525311 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88d3 expref: 277 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.451918:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525311 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88d3 expref: 277 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.451947:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:3.0:1789431561.451954:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63525365 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.451966:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63525365 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.451978:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63525365 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.452003:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431561.452107:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+277:2348:x1876351933441536:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 247us (549us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431561.452115:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16467
00010000:00010000:2.0:1789431561.452343:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525311 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88d3 expref: 276 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.452363:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a047800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894213376:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431561.452386:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:2.0:1789431561.452394:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63525365 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.452403:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63525365 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.452410:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63525365 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431561.452434:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bd:0x0]: returning size 260096
00010000:00010000:2.0:1789431561.452631:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb63525357 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88e8 expref: 277 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.452650:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63525365 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88e8 expref: 276 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.452658:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:2.0:1789431561.452661:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431561.452664:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb2e000, rc 0)
00000100:00100000:2.0:1789431561.452720:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+276:14617:x1876351933441152:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 25593us (25872us total) trans 4295120902 rc 0/0
00000100:00100000:2.0:1789431561.452731:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295831
00000100:00100000:3.0:1789431561.460985:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.461175:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933441792
00000100:00100000:1.0:1789431561.461191:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933441792
00000100:00100000:1.0:1789431561.461272:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295833
00000100:00100000:1.0:1789431561.461284:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+276:14617:x1876351933441792:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.461309:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.461333:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525388 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c88f6 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.461831:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352538f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.461848:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63525365 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88e8 expref: 277 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.461857:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352538f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.461895:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63525365 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88e8 expref: 277 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.461912:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63525365 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88e8 expref: 277 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.461926:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894213504:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431561.462006:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e180 going to sleep for 11 seconds
00000100:00100000:3.0:1789431561.465994:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+277:14616:x1876351933441664:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 14120us (14341us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431561.466012:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12439
00000100:00100000:0.0:1789431561.466669:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.466877:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933441920
00000100:00100000:3.0:1789431561.466888:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933441920
00000100:00100000:2.0:1789431561.466937:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894213504:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431561.466938:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63525365 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88e8 expref: 277 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.466974:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352538f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.466990:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16468
00000100:00100000:3.0:1789431561.467002:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+277:2347:x1876351933441920:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431561.467020:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431561.467029:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63525365 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88e8 expref: 277 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.467044:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63525365 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88e8 expref: 277 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.467108:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb63525365 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88e8 expref: 277 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.467126:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:3.0:1789431561.467132:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352538f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.467143:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352538f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.467164:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352538f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.467192:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431561.467230:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+276:2347:x1876351933441920:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 231us (567us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431561.467245:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16468
00010000:00010000:2.0:1789431561.467417:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352538f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.467428:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352538f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431561.467497:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bd:0x0]: returning size 260096
00000004:00200000:2.0:1789431561.467503:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431561.467526:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352538f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.467569:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525388 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100bd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88f6 expref: 276 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.467588:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352538f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88f6 expref: 275 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.467597:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:2.0:1789431561.467600:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431561.467603:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309200, rc 0)
00000100:00100000:2.0:1789431561.467689:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+275:14617:x1876351933441792:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6407us (6720us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.467697:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295833
00000100:00100000:1.0:1789431561.478420:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.478818:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933442176
00000100:00100000:0.0:1789431561.478833:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933442176
00000100:00100000:0.0:1789431561.479084:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295834
00000100:00100000:0.0:1789431561.479098:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+275:14616:x1876351933442176:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431561.479130:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431561.479134:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431561.479182:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb6352537a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88ef expref: 275 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.479206:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431561.479212:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431561.479232:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63525396 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c88fd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.479383:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb6352539d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.479401:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb6352539d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.479413:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb6352539d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.479432:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635253a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.479440:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635253a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.479446:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635253a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431561.480815:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x514:0x0], index 1: 0
00010000:00010000:0.0:1789431561.481359:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635253ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.481381:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635253ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.481394:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635253ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.481439:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb6352539d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.481448:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb6352539d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.481456:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb6352539d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.481462:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.481467:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb6352539d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.481475:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb6352539d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.481490:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431561.481493:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.481499:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb6352539d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.481506:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb6352539d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431561.481521:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006381ed77 reply state 00000000bfb30b08 transno 4295120903 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635253a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.481532:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431561.481573:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb63525396 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88fd expref: 277 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.481590:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635253ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88fd expref: 276 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.482281:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa5:0x0].0x0 (ffff90ce07190100)
00010000:00010000:0.0:1789431561.482288:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431561.482294:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4000, rc 0)
00000100:00100000:0.0:1789431561.482466:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+277:14616:x1876351933442176:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3369us (4060us total) trans 4295120903 rc 0/0
00000100:00100000:0.0:1789431561.482477:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295834
00000100:00100000:3.0:1789431561.490216:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.491118:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.491425:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933442432
00000100:00100000:0.0:1789431561.491440:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933442432
00000100:00100000:0.0:1789431561.491524:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12440
00000100:00100000:0.0:1789431561.491537:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+277:14617:x1876351933442432:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431561.491998:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+278:14617:x1876351933442432:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 462us (1796us total) trans 4295120904 rc 0/0
00000100:00100000:0.0:1789431561.492008:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12440
00000100:00100000:2.0:1789431561.492371:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933442560
00000100:00100000:2.0:1789431561.492381:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933442560
00010000:00010000:1.0:1789431561.494844:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635253a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.494868:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635253a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.494889:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635253a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.494895:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.494902:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635253a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.494911:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635253a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.494933:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x148c06c6 (ffff90ce07190200)
00010000:00010000:1.0:1789431561.495364:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.495374:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635253a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.495381:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635253a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.496385:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8266
00000100:00100000:1.0:1789431561.496417:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+94:2350:x1876351933442560:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.496441:0:14471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.496470:0:14471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb635253b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8904 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789431561.496508:0:14471:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x514:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:1.0:1789431561.496536:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x514:0x0].0x0 since=3019s v=(0 0)
00010000:00010000:1.0:1789431561.496542:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x514:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431561.496554:0:14471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb635253b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8904 expref: 95 pid: 14471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.496573:0:14471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb635253b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8904 expref: 95 pid: 14471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.496601:0:14471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309c00, rc 0)
00000100:00100000:1.0:1789431561.496866:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+95:2350:x1876351933442560:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 466us (5752us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.496885:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8266
00000100:00100000:3.0:1789431561.502551:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.502651:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933442688
00000100:00100000:2.0:1789431561.502666:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933442688
00000100:00100000:2.0:1789431561.502764:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295835
00000100:00100000:2.0:1789431561.502776:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+277:14617:x1876351933442688:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.502811:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.502840:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb635253c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c890b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503252:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503274:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503290:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503313:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503321:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503328:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503453:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb635253d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503463:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb635253d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503470:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb635253d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431561.503516:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bd:0x0]: returning size 260096
00000004:00200000:2.0:1789431561.503521:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431561.503544:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb635253d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503558:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb635253d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503567:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503574:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503582:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503589:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb2e000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.503594:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503672:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503690:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431561.503693:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.503701:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503713:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503727:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503733:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503748:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503809:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb2f800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.503814:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503821:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503830:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x77103a66 (ffff90cf13195900)
00010000:00010000:2.0:1789431561.503833:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.503837:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.503843:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.504196:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb635253c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c890b expref: 279 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.504222:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb635253d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c890b expref: 278 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.504231:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:2.0:1789431561.504233:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431561.504236:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb2f600, rc 0)
00000100:00100000:2.0:1789431561.504313:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+278:14617:x1876351933442688:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1538us (1777us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.504322:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295835
00000100:00100000:3.0:1789431561.515350:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.515412:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.515462:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.515573:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933442944
00000100:00100000:0.0:1789431561.515586:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933442944
00000100:00100000:0.0:1789431561.515659:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12441
00000100:00100000:0.0:1789431561.515671:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+278:14616:x1876351933442944:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431561.515724:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933443328
00000100:00100000:1.0:1789431561.515730:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933443328
00000100:00100000:1.0:1789431561.515784:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295836
00000100:00100000:1.0:1789431561.515792:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+279:14617:x1876351933443328:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.515805:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.515832:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635253dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8912 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.516168:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+281:14616:x1876351933442944:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 497us (830us total) trans 4295120905 rc 0/0
00000100:00100000:0.0:1789431561.516176:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12441
00010000:00010000:1.0:1789431561.516515:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.516534:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352538f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88f6 expref: 280 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.516544:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb635253d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c890b expref: 280 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.516555:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.516597:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb635253d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c890b expref: 280 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.516726:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933443072
00000100:00100000:2.0:1789431561.516735:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933443072
00010000:00010000:2.0:1789431561.516774:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb635253d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c890b expref: 281 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.516810:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16469
00000100:00100000:2.0:1789431561.516819:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+281:2350:x1876351933443072:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.516831:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431561.516935:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb635253d5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c890b expref: 281 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.516960:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894213632:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431561.517235:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb635253d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c890b expref: 281 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.517264:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:2.0:1789431561.517270:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.517279:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.517287:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431561.517375:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352538f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88f6 expref: 281 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.517389:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352538f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88f6 expref: 281 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.517399:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894213760:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431561.517434:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e180 going to sleep for 11 seconds
00010000:00010000:2.0:1789431561.520264:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431561.522560:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+281:2350:x1876351933443072:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 5723us (7128us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.522581:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16469
00010000:00010000:1.0:1789431561.528130:0:6797:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@00000000c85470fe x1876351894213632) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb635253d5 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c890b expref: 280 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.528162:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb635253d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c890b expref: 280 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.528183:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894213632:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431561.528201:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894213760:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431561.528235:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:1.0:1789431561.528242:0:6797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.528252:0:6797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.528263:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.529838:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.529991:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.530200:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933443712
00000100:00100000:2.0:1789431561.530213:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933443712
00010000:00010000:2.0:1789431561.530278:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352538f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88f6 expref: 280 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.530332:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16470
00000100:00100000:2.0:1789431561.530344:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+280:2347:x1876351933443712:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.530362:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.530369:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352538f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88f6 expref: 280 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.530383:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352538f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88f6 expref: 280 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.530411:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352538f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88f6 expref: 280 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.530430:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:2.0:1789431561.530436:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.530451:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.530459:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.530491:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.530555:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+279:2347:x1876351933443712:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 214us (564us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.530564:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16470
00010000:00010000:1.0:1789431561.531024:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.531036:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431561.531104:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bd:0x0]: returning size 260096
00010000:00010000:1.0:1789431561.531331:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635253dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8912 expref: 280 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.531355:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8912 expref: 279 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.531364:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:1.0:1789431561.531366:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431561.531370:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:1.0:1789431561.531636:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+279:14617:x1876351933443328:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 15624us (15953us total) trans 4295120906 rc 0/0
00000100:00100000:1.0:1789431561.531648:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295836
00000100:00100000:1.0:1789431561.531678:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933443584
00000100:00100000:1.0:1789431561.531685:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933443584
00000100:00100000:3.0:1789431561.533227:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295837
00000100:00100000:2.0:1789431561.533860:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+279:14616:x1876351933443584:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431561.533950:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.533988:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635253ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88fd expref: 279 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.534012:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa5:0x0].0x0 (ffff90ce07190100)
00010000:00010000:2.0:1789431561.534027:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431561.534183:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.534203:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.534215:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.534233:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.534247:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.534255:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.534549:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb635253ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aa5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.534558:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb635253ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.534567:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb635253ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.535863:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.536008:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933443840
00000100:00100000:1.0:1789431561.536022:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933443840
00000100:00100000:1.0:1789431561.536134:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295838
00000100:00100000:1.0:1789431561.536147:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+279:14617:x1876351933443840:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.536180:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.536204:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525406 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8919 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.536324:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352540d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.536341:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8912 expref: 280 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.536350:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352540d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.536393:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8912 expref: 280 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.536409:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8912 expref: 280 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.536425:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3621bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894213888:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431561.536526:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e180 going to sleep for 11 seconds
00000040:00080000:2.0:1789431561.538100:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1217, 64 off86144
00010000:00010000:2.0:1789431561.538198:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525414 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aa5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538219:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525414 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538233:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525414 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538244:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525414 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538251:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525414 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538257:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525414 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538284:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431561.538312:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb635253ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538319:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb635253ff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538325:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb635253ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538331:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf421ef000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.538337:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb635253ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538345:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb635253ff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538360:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa5:0x0].0x0 (ffff90cf13195200)
00010000:00010000:2.0:1789431561.538363:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431561.538369:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb635253ff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538376:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb635253ff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538402:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538409:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253f1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538420:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538425:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb2f800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.538428:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538435:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538443:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431561.538446:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.538449:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.538455:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635253f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431561.538465:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002dba2167 reply state 0000000044ec599e transno 4295120907 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.538475:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431561.538584:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14616:x1876351933443584:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 5336us (8752us total) trans 4295120907 rc 0/0
00000100:00100000:2.0:1789431561.538594:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295837
00010000:00010000:1.0:1789431561.538799:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431561.538809:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525414 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.538816:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431561.538819:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525414 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.538826:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525414 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.538835:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa5:0x0].0x0 (ffff90cf13195200)
00010000:00010000:1.0:1789431561.538837:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431561.538840:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525414 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10aa5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.538845:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525414 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aa5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.538861:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.538863:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431561.538864:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431561.543978:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.544001:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.544015:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.544022:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb2e000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.544029:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.544039:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.544089:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x148c06c6 (ffff90cf13195900)
00010000:00010000:2.0:1789431561.544094:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.544100:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.544107:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635253f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x148c06c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.544728:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3621bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894213888:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431561.544836:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352540d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.545766:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.545900:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933444096
00000100:00100000:3.0:1789431561.545911:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933444096
00000100:00100000:3.0:1789431561.545980:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295839
00000100:00100000:3.0:1789431561.545993:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+281:14616:x1876351933444096:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431561.546030:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.546102:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352541b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8920 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546192:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525422 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546210:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525422 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546222:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525422 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546238:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525429 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x69e939dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546246:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x69e939dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546252:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x69e939dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546341:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525422 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546350:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525422 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546358:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525422 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546364:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.546370:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525422 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546382:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525422 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546395:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431561.546398:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.546404:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525422 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546412:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525422 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546428:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x69e939dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546434:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525429 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x69e939dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546440:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525429 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x69e939dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546445:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.546448:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525429 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x69e939dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546454:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525429 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x69e939dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546462:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x69e939dc (ffff90cf18b78800)
00010000:00010000:3.0:1789431561.546465:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.546467:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525429 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x69e939dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546475:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525429 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x69e939dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546511:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352541b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8920 expref: 282 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546522:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431561.546525:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.546528:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352541b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8920 expref: 282 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.546537:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cba00, rc 0)
00000100:00100000:3.0:1789431561.546619:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+281:14616:x1876351933444096:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 629us (878us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431561.546628:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295839
00000100:00100000:3.0:1789431561.554121:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.555162:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933444224
00000100:00100000:0.0:1789431561.555179:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933444224
00000100:00100000:0.0:1789431561.555262:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295840
00000100:00100000:0.0:1789431561.555399:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+281:14616:x1876351933444224:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431561.555428:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431561.555457:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525430 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8927 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.555543:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63525437 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.555562:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63525437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.555576:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63525437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431561.555622:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100b8:0x0]: returning size 16384
00000004:00200000:0.0:1789431561.555626:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431561.555651:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63525437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.555679:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525430 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8927 expref: 283 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.555701:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63525437 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8927 expref: 282 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.555710:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431561.555713:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431561.555718:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62d000, rc 0)
00000100:00100000:0.0:1789431561.555830:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14616:x1876351933444224:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 558us (1724us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.555839:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295840
00000100:00100000:0.0:1789431561.559796:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.560005:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933443968
00000100:00100000:3.0:1789431561.560020:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933443968
00010000:00010000:3.0:1789431561.560116:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8912 expref: 282 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.560162:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16471
00000100:00100000:3.0:1789431561.560173:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e956050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:2348:x1876351933443968:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431561.560193:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431561.560201:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8912 expref: 282 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.560221:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8912 expref: 282 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.560248:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635253e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8912 expref: 282 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.560280:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:3.0:1789431561.560286:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352540d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.560298:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352540d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.560306:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352540d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.560337:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431561.560406:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e956050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+281:2348:x1876351933443968:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 234us (624us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431561.560414:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16471
00010000:00010000:1.0:1789431561.561003:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352540d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.561015:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352540d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431561.561105:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bd:0x0]: returning size 260096
00000004:00200000:1.0:1789431561.561111:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431561.561139:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352540d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.561185:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525406 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100bd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8919 expref: 281 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.561204:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352540d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8919 expref: 280 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.561212:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:1.0:1789431561.561214:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431561.561217:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308e00, rc 0)
00000100:00100000:1.0:1789431561.561268:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+280:14617:x1876351933443840:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 25124us (25419us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.561286:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295838
00000100:00100000:0.0:1789431561.568147:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.568280:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933444480
00000100:00100000:3.0:1789431561.568294:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933444480
00000100:00100000:3.0:1789431561.568367:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12442
00000100:00100000:3.0:1789431561.568380:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+280:14617:x1876351933444480:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431561.568709:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+281:14617:x1876351933444480:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 329us (576us total) trans 4295120908 rc 0/0
00000100:00100000:3.0:1789431561.568717:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12442
00000100:00100000:3.0:1789431561.577478:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.577535:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.577778:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933444736
00000100:00100000:2.0:1789431561.577792:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933444736
00000100:00100000:2.0:1789431561.577872:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295841
00000100:00100000:2.0:1789431561.577885:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+281:14617:x1876351933444736:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.577919:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00000100:00100000:0.0:1789431561.578039:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933444608
00000100:00100000:0.0:1789431561.578045:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933444608
00000100:00100000:0.0:1789431561.578126:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12443
00000100:00100000:0.0:1789431561.578134:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14616:x1876351933444608:12345-192.168.203.4@tcp:37:dbench.0
00010000:00010000:2.0:1789431561.578325:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352543e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c892e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.578408:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525445 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.578430:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525445 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.578454:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525445 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.578470:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352544c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.578477:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352544c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.578483:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352544c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.578938:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525453 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.578949:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.578957:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431561.579003:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bd:0x0]: returning size 260096
00000004:00200000:2.0:1789431561.579009:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431561.579034:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.579078:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.579092:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525445 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.579098:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525445 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.579106:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525445 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.579112:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.579118:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525445 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.579127:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525445 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.579141:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431561.579144:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.579150:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525445 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.579156:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525445 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.579170:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352544c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.579175:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352544c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.579180:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352544c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.579185:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.579188:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352544c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.579193:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352544c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.579199:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x77103a66 (ffff90cf13195900)
00010000:00010000:2.0:1789431561.579202:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.579205:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352544c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.579210:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352544c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.579259:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352543e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c892e expref: 285 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.579276:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525453 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c892e expref: 284 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.579284:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:2.0:1789431561.579286:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431561.579289:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf421ef000, rc 0)
00000100:00100000:2.0:1789431561.579343:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+284:14617:x1876351933444736:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1460us (1804us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.579351:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295841
00000100:00100000:0.0:1789431561.587373:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14616:x1876351933444608:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 9221us (9888us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.587391:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12443
00000100:00100000:1.0:1789431561.599088:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.599143:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.599322:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933445120
00000100:00100000:3.0:1789431561.599335:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933445120
00000100:00100000:3.0:1789431561.599411:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295842
00000100:00100000:3.0:1789431561.599424:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14617:x1876351933445120:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431561.599453:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.599482:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352545a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8935 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.599630:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.599648:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352540d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8919 expref: 283 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.599657:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525453 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c892e expref: 283 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.599667:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.599712:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525453 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c892e expref: 283 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.599728:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525453 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c892e expref: 283 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.599766:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e96300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894214016:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431561.599924:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352540d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8919 expref: 283 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.599934:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352540d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8919 expref: 283 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.599942:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce029f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894214144:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431561.599967:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2d449480 going to sleep for 11 seconds
00000100:00100000:0.0:1789431561.600242:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933444864
00000100:00100000:0.0:1789431561.600249:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933444864
00010000:00010000:0.0:1789431561.600291:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525453 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c892e expref: 284 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.600327:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16472
00000100:00100000:0.0:1789431561.600336:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+284:2347:x1876351933444864:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431561.600347:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431561.600354:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525453 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c892e expref: 284 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.600366:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525453 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c892e expref: 284 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.600388:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:0.0:1789431561.600394:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.600402:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.600409:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431561.600440:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+284:2347:x1876351933444864:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 105us (1296us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.600447:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16472
00010000:00010000:1.0:1789431561.604451:0:6797:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@00000000f038dbd6 x1876351894214016) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525453 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c892e expref: 283 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.604480:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525453 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c892e expref: 283 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.604503:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e96300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894214016:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431561.604520:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce029f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894214144:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431561.604549:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:1.0:1789431561.604556:0:6797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.604566:0:6797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.604576:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.608099:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.608199:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933445248
00000100:00100000:0.0:1789431561.608216:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933445248
00000100:00100000:0.0:1789431561.608332:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295843
00000100:00100000:0.0:1789431561.608343:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:14616:x1876351933445248:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431561.608371:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431561.608401:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525468 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c893c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.608491:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352546f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.608510:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352546f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.608522:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352546f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.608539:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525476 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x2d602a61 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.608548:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x2d602a61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.608556:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x2d602a61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.608914:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352546f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.608923:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352546f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.608931:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352546f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.608938:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.608943:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352546f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.608952:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352546f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.608966:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431561.608970:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.608976:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352546f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.608983:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352546f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.609000:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x2d602a61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.609006:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525476 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x2d602a61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.609013:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x2d602a61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.609018:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.609021:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x2d602a61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.609028:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525476 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x2d602a61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.609035:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x2d602a61 (ffff90ce07190400)
00010000:00010000:0.0:1789431561.609038:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.609040:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525476 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x2d602a61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.609097:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525476 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x2d602a61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.609140:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525468 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c893c expref: 284 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.609150:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431561.609152:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.609156:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525468 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c893c expref: 284 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.609166:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62c200, rc 0)
00000100:00100000:0.0:1789431561.609263:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:14616:x1876351933445248:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 921us (1217us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431561.609273:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295843
00000100:00100000:3.0:1789431561.609688:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.609736:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933445376
00000100:00100000:2.0:1789431561.609755:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933445376
00010000:00010000:2.0:1789431561.609793:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352540d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8919 expref: 283 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.609823:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16473
00000100:00100000:2.0:1789431561.609833:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:2348:x1876351933445376:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.609848:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.609856:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352540d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8919 expref: 283 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.609868:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352540d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8919 expref: 283 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.609887:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352540d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8919 expref: 283 pid: 12775 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.609900:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:2.0:1789431561.609906:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.609918:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.609927:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.609960:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.609990:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:2348:x1876351933445376:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 158us (303us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.610001:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16473
00010000:00010000:1.0:1789431561.612861:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.612884:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431561.612918:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bd:0x0]: returning size 260096
00010000:00010000:1.0:1789431561.616973:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352545a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8935 expref: 283 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.617013:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8935 expref: 282 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.617023:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:1.0:1789431561.617027:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431561.617032:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cac00, rc 0)
00000100:00100000:3.0:1789431561.618426:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.618560:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933445504
00000100:00100000:2.0:1789431561.618572:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933445504
00000100:00100000:2.0:1789431561.618667:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295844
00000100:00100000:2.0:1789431561.618680:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:14616:x1876351933445504:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.618704:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.618731:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525484 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8943 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.618826:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352548b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.618845:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352548b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.618861:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352548b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.618879:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525492 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x1489dbad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.618887:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x1489dbad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.618895:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x1489dbad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.618967:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352548b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.618980:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352548b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.618987:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352548b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.618994:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.618999:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352548b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.619009:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352548b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.619024:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431561.619027:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.619033:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352548b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.619041:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352548b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.619085:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x1489dbad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.619092:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525492 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x1489dbad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.619098:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x1489dbad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.619104:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.619107:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x1489dbad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.619113:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525492 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x1489dbad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.619120:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x1489dbad (ffff90cf13195900)
00010000:00010000:2.0:1789431561.619123:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.619125:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525492 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x1489dbad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.619131:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525492 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x1489dbad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.619170:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525484 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8943 expref: 284 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.619182:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431561.619184:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.619188:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525484 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8943 expref: 284 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.619198:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce249e1000, rc 0)
00000100:00100000:2.0:1789431561.619294:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:14616:x1876351933445504:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 616us (879us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431561.619302:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295844
00000100:00100000:1.0:1789431561.620206:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14617:x1876351933445120:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 20776us (21161us total) trans 4295120909 rc 0/0
00000100:00100000:1.0:1789431561.620219:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295842
00000100:00100000:3.0:1789431561.631549:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.631766:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933445632
00000100:00100000:0.0:1789431561.631780:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933445632
00000100:00100000:0.0:1789431561.631856:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295845
00000100:00100000:0.0:1789431561.631868:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14617:x1876351933445632:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431561.631902:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431561.631930:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525499 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c894a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.632040:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635254a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.632095:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8935 expref: 283 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.632105:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635254a0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.632149:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8935 expref: 283 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.632163:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8935 expref: 283 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.632178:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e91880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894214272:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431561.632415:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ac1f180 going to sleep for 11 seconds
00000100:00100000:3.0:1789431561.633588:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.633689:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933445760
00000100:00100000:2.0:1789431561.633700:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933445760
00000100:00100000:2.0:1789431561.633775:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295846
00000100:00100000:2.0:1789431561.633787:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+284:14616:x1876351933445760:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.633811:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.633834:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635254a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8951 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.633919:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.633937:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.633950:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.633967:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x3eeb752e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.633974:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x3eeb752e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.633980:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x3eeb752e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.634077:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.634085:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.634091:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.634097:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.634102:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.634110:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.634123:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431561.634126:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.634132:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.634139:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.634153:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x3eeb752e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.634159:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x3eeb752e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.634165:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x3eeb752e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.634170:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.634173:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x3eeb752e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.634179:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x3eeb752e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.634187:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x3eeb752e (ffff90cf13195900)
00010000:00010000:2.0:1789431561.634190:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.634193:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x3eeb752e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.634199:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x3eeb752e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.634237:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635254a7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8951 expref: 285 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.634248:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431561.634250:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.634254:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635254a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8951 expref: 285 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.634263:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad800, rc 0)
00000100:00100000:2.0:1789431561.634546:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+284:14616:x1876351933445760:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 759us (965us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431561.634555:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295846
00000100:00100000:0.0:1789431561.647658:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e91880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894214272:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431561.647701:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635254a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.653624:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.653692:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.653955:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933446016
00000100:00100000:2.0:1789431561.653969:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933446016
00000100:00100000:2.0:1789431561.654040:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295847
00000100:00100000:2.0:1789431561.654089:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+284:14616:x1876351933446016:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.654116:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.654149:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635254bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8958 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654237:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654262:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654288:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654306:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xd9c58084 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654314:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd9c58084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654321:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd9c58084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654394:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654403:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654410:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654417:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.654423:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654433:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654452:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431561.654456:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.654463:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654469:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635254c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654487:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd9c58084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654493:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd9c58084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654499:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd9c58084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654504:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.654506:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd9c58084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654512:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd9c58084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654520:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xd9c58084 (ffff90cf13195900)
00010000:00010000:2.0:1789431561.654523:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.654526:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xd9c58084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654531:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635254ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xd9c58084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654570:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635254bc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8958 expref: 285 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654583:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431561.654585:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.654589:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635254bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8958 expref: 285 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.654599:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad800, rc 0)
00000100:00100000:2.0:1789431561.654684:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+284:14616:x1876351933446016:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 634us (991us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431561.654693:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295847
00000100:00100000:1.0:1789431561.654854:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933445888
00000100:00100000:1.0:1789431561.654862:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933445888
00010000:00010000:1.0:1789431561.654894:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8935 expref: 284 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.654931:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16474
00000100:00100000:1.0:1789431561.654940:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+284:2347:x1876351933445888:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431561.654952:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431561.654960:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8935 expref: 284 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.654973:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8935 expref: 284 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.654987:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525461 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100bd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8935 expref: 284 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.654999:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:1.0:1789431561.655004:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635254a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.655013:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635254a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.655020:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635254a0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.655093:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431561.655119:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:2347:x1876351933445888:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 181us (1512us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.655125:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16474
00010000:00010000:1.0:1789431561.655919:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635254a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.655932:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635254a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431561.655995:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bd:0x0]: returning size 260096
00000004:00200000:1.0:1789431561.656001:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431561.656028:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635254a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.656111:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525499 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100bd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c894a expref: 283 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.656130:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4000/0xd8e438fb635254a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c894a expref: 282 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.656139:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bd:0x0].0x0 (ffff90ce2727a400)
00010000:00010000:1.0:1789431561.656141:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431561.656145:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4000, rc 0)
00000100:00100000:1.0:1789431561.656201:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14617:x1876351933445632:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 24336us (24666us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.656209:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295845
00000100:00100000:3.0:1789431561.666112:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.666269:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933446144
00000100:00100000:1.0:1789431561.666294:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933446144
00000100:00100000:1.0:1789431561.666373:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295848
00000100:00100000:1.0:1789431561.666386:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14616:x1876351933446144:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.666415:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.666446:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635254d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c895f expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666537:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635254d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666556:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635254d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666570:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635254d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666588:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635254df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x8982f138 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666596:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635254df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8982f138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666603:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635254df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8982f138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666676:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635254d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666683:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635254d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666691:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635254d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666697:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.666702:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635254d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666710:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635254d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666724:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.666727:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.666732:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635254d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666750:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635254d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666765:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635254df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8982f138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666772:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635254df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8982f138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666778:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635254df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8982f138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666783:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.666786:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635254df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8982f138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666793:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635254df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x8982f138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666805:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x8982f138 (ffff90cf22651800)
00010000:00010000:1.0:1789431561.666808:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.666811:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635254df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x8982f138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.666817:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635254df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x8982f138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.667022:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635254d1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c895f expref: 283 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.667036:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.667038:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.667042:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635254d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c895f expref: 283 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.667145:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:1.0:1789431561.667231:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14616:x1876351933446144:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 847us (1131us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431561.667240:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295848
00000100:00100000:2.0:1789431561.679957:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.680119:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933446272
00000100:00100000:3.0:1789431561.680133:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933446272
00000100:00100000:3.0:1789431561.680208:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295849
00000100:00100000:3.0:1789431561.680221:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14617:x1876351933446272:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431561.680251:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.680291:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635254e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8966 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680378:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635254ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680397:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635254ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680413:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635254ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680430:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635254f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680437:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635254f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680444:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635254f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680513:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635254ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680521:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635254ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680529:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635254ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680535:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.680539:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635254ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680548:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635254ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680560:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431561.680563:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.680569:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635254ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680576:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635254ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680590:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635254f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680596:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635254f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680602:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635254f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680606:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.680609:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635254f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680614:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635254f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680621:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x6ed7d01b (ffff90cf18b78800)
00010000:00010000:3.0:1789431561.680623:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.680626:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635254f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680632:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635254f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680667:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635254e6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8966 expref: 283 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680683:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431561.680685:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.680689:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635254e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8966 expref: 283 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.680698:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb600, rc 0)
00000100:00100000:3.0:1789431561.680786:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14617:x1876351933446272:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 568us (846us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431561.680793:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295849
00000100:00100000:0.0:1789431561.694802:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.695093:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933446400
00000100:00100000:1.0:1789431561.695106:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933446400
00000100:00100000:1.0:1789431561.695184:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295850
00000100:00100000:1.0:1789431561.695197:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14616:x1876351933446400:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.695226:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.695254:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635254fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c896d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695366:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525502 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695384:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525502 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695398:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525502 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695416:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525509 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xfe99ec38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695422:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xfe99ec38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695430:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xfe99ec38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695503:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525502 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695511:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525502 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695518:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525502 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695524:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.695529:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525502 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695542:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525502 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695556:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.695558:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.695565:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525502 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695571:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525502 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695587:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xfe99ec38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695592:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525509 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xfe99ec38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695597:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525509 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xfe99ec38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695603:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.695605:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525509 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xfe99ec38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695611:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525509 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xfe99ec38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695619:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xfe99ec38 (ffff90cf22651800)
00010000:00010000:1.0:1789431561.695621:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.695624:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525509 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xfe99ec38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695630:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525509 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xfe99ec38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695666:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635254fb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c896d expref: 283 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695676:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.695679:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.695682:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635254fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c896d expref: 283 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.695693:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:1.0:1789431561.695785:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14616:x1876351933446400:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 590us (998us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431561.695793:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295850
00000100:00100000:1.0:1789431561.697643:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.697778:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933446528
00000100:00100000:2.0:1789431561.697791:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933446528
00000100:00100000:2.0:1789431561.698005:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295851
00000100:00100000:2.0:1789431561.698018:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14617:x1876351933446528:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.698045:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.698095:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525510 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8974 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698189:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525517 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698208:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525517 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698225:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525517 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698243:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352551e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x27819378 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698251:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352551e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x27819378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698258:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352551e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x27819378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698454:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525517 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698463:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525517 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698471:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525517 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698478:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.698485:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525517 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698495:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525517 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698511:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431561.698515:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.698523:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525517 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698529:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525517 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698545:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352551e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x27819378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698552:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352551e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x27819378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698558:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352551e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x27819378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698563:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.698566:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352551e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x27819378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698572:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352551e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x27819378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698580:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x27819378 (ffff90cf13195900)
00010000:00010000:2.0:1789431561.698583:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.698586:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352551e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x27819378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698592:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352551e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x27819378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698630:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525510 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8974 expref: 283 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698647:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431561.698649:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.698653:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525510 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8974 expref: 283 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.698663:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7acc00, rc 0)
00000100:00100000:2.0:1789431561.698763:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14617:x1876351933446528:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 748us (1133us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431561.698772:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295851
00000100:00100000:2.0:1789431561.710523:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.710580:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.710665:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933446784
00000100:00100000:1.0:1789431561.710679:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933446784
00000100:00100000:1.0:1789431561.710755:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933446656
00000100:00100000:1.0:1789431561.710759:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933446656
00000100:00100000:1.0:1789431561.710794:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295852
00000100:00100000:1.0:1789431561.710807:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:14616:x1876351933446784:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.710834:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.710875:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525525 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8982 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.710962:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352552c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.710982:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352552c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.710997:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352552c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711014:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525533 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa6e377a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711021:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa6e377a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711027:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa6e377a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711123:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352552c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711131:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352552c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711140:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352552c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711146:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.711151:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352552c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711160:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352552c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711178:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.711181:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.711187:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352552c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711194:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352552c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711208:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa6e377a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711215:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525533 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa6e377a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711220:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525533 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa6e377a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711225:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.711229:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525533 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa6e377a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711235:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525533 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa6e377a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711243:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xa6e377a8 (ffff90cf22651800)
00010000:00010000:1.0:1789431561.711246:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.711249:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525533 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa6e377a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711254:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525533 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa6e377a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711294:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525525 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8982 expref: 284 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711305:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.711308:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.711311:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525525 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8982 expref: 284 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711321:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:1.0:1789431561.711399:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:14616:x1876351933446784:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 594us (892us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431561.711406:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295852
00000100:00100000:1.0:1789431561.711432:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295853
00000100:00100000:1.0:1789431561.711441:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14617:x1876351933446656:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.711450:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.711461:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352553a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c897b expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711499:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525541 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711509:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525541 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711517:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525541 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711533:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525548 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x316f5120 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711539:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x316f5120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711545:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x316f5120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711581:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525541 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711589:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525541 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711595:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525541 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711600:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.711603:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525541 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711610:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525541 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711618:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431561.711620:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.711624:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525541 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711630:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525541 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711640:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x316f5120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711646:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525548 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x316f5120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711652:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525548 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x316f5120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711657:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf421ef000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.711660:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525548 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x316f5120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711666:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525548 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x316f5120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711673:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x316f5120 (ffff90cf22651900)
00010000:00010000:1.0:1789431561.711676:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.711678:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525548 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x316f5120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711685:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525548 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x316f5120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711709:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352553a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c897b expref: 283 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711717:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431561.711719:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.711724:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352553a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c897b expref: 283 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.711732:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:0.0:1789431561.713330:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14617:x1876351933446656:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1875us (2734us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431561.713344:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295853
00000100:00100000:0.0:1789431561.716530:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:366be534-ad36-4915-90c5-622719f64be8:3314:1876351894214400:0@lo:400:kworker.0
00000100:00100000:0.0:1789431561.716632:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431561.716771:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894214400
00000100:00100000:2.0:1789431561.716782:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894214400
00000100:00100000:2.0:1789431561.716865:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305
00000100:00100000:2.0:1789431561.716877:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2ad6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:366be534-ad36-4915-90c5-622719f64be8+19:3314:x1876351894214400:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789431561.717073:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876351894214656:0@lo:400:kworker.0
00000100:00100000:1.0:1789431561.717114:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431561.717144:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1789431561.717150:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876351894214528:0@lo:400:kworker.0
00000100:00100000:1.0:1789431561.717172:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431561.717208:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894214656
00000100:00100000:1.0:1789431561.717212:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894214656
00000100:00080000:1.0:1789431561.717239:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:1.0:1789431561.717273:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894214528
00000100:00100000:1.0:1789431561.717276:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894214528
00000100:00100000:1.0:1789431561.717303:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1711
00000100:00100000:1.0:1789431561.717310:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876351894214656:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789431561.717352:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876351894214656:12345-0@lo:400:kworker.0 Request processed in 42us (237us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.717359:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1711
00000100:00100000:1.0:1789431561.717379:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1712
00000100:00100000:1.0:1789431561.717385:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876351894214528:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789431561.717414:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876351894214528:12345-0@lo:400:kworker.0 Request processed in 30us (241us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.717420:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1712
00000100:00100000:1.0:1789431561.717465:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876351894214528:0@lo:400:kworker.0
00000100:00100000:1.0:1789431561.717475:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876351894214656:0@lo:400:kworker.0
00000100:00100000:1.0:1789431561.719762:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876351894214784:0@lo:400:kworker.0
00000100:00100000:1.0:1789431561.719882:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431561.719975:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894214784
00000100:00100000:1.0:1789431561.719985:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894214784
00000100:00080000:1.0:1789431561.720024:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:1.0:1789431561.720096:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1713
00000100:00100000:1.0:1789431561.720106:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876351894214784:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789431561.720169:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876351894214784:12345-0@lo:400:kworker.0 Request processed in 65us (288us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.720176:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1713
00000100:00100000:1.0:1789431561.720222:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876351894214784:0@lo:400:kworker.0
00000100:00100000:2.0:1789431561.721814:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2ad6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:366be534-ad36-4915-90c5-622719f64be8+19:3314:x1876351894214400:12345-0@lo:400:kworker.0 Request processed in 4928us (5171us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.721831:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305
00000100:00100000:0.0:1789431561.721941:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:366be534-ad36-4915-90c5-622719f64be8:3314:1876351894214400:0@lo:400:kworker.0
00000100:00100000:2.0:1789431561.722597:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.722700:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933446912
00000100:00100000:1.0:1789431561.722709:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933446912
00000100:00100000:1.0:1789431561.722910:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295854
00000100:00100000:1.0:1789431561.722923:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14616:x1876351933446912:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.722948:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.722978:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb6352554f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8989 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723088:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb63525556 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723106:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb63525556 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723121:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb63525556 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723143:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb6352555d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xd138b873 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723150:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb6352555d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd138b873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723157:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb6352555d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd138b873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723230:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb63525556 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723251:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb63525556 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723259:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb63525556 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723265:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb2f800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.723271:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb63525556 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723280:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb63525556 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723294:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.723298:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.723304:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb63525556 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723311:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb63525556 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723327:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb6352555d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd138b873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723334:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb6352555d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd138b873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723340:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb6352555d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd138b873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723345:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb2f600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.723348:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb6352555d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd138b873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723354:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb6352555d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xd138b873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723363:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xd138b873 (ffff90cf22651100)
00010000:00010000:1.0:1789431561.723365:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.723368:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb6352555d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xd138b873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723375:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb6352555d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xd138b873 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723418:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb6352554f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8989 expref: 283 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723430:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.723432:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.723437:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb6352554f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8989 expref: 283 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.723449:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb2e000, rc 0)
00000100:00100000:1.0:1789431561.723530:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14616:x1876351933446912:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 610us (937us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431561.723538:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295854
00000100:00100000:0.0:1789431561.724373:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.724766:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933447040
00000100:00100000:1.0:1789431561.725008:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933447040
00000100:00100000:1.0:1789431561.726191:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295855
00000100:00100000:1.0:1789431561.726216:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14617:x1876351933447040:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.726251:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.726282:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63525564 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8990 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726368:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352556b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726386:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352556b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726400:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352556b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726419:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525572 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x5b209d6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726426:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x5b209d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726438:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x5b209d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726514:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352556b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726522:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352556b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726529:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352556b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726535:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f76400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.726540:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352556b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726548:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352556b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726560:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431561.726563:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.726568:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352556b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726574:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb6352556b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726588:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x5b209d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726593:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525572 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x5b209d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726599:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525572 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x5b209d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726604:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f77a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.726606:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525572 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x5b209d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726611:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525572 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x5b209d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726618:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x5b209d6e (ffff90ce03149b00)
00010000:00010000:1.0:1789431561.726621:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.726623:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525572 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x5b209d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726628:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525572 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x5b209d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726665:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63525564 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8990 expref: 283 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726676:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431561.726678:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.726682:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63525564 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8990 expref: 283 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.726697:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37f77c00, rc 0)
00000100:00100000:1.0:1789431561.726799:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14617:x1876351933447040:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 597us (2443us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431561.726808:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295855
00000100:00100000:0.0:1789431561.737824:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.737880:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.737901:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933447168
00000100:00100000:1.0:1789431561.737915:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933447168
00000100:00100000:1.0:1789431561.737995:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933447296
00000100:00100000:1.0:1789431561.737999:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933447296
00000100:00100000:1.0:1789431561.738030:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295856
00000100:00100000:1.0:1789431561.738042:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:14616:x1876351933447168:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.738090:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.738119:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63525579 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8997 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738205:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525580 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738224:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525580 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738237:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525580 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738257:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525587 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738264:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738270:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738394:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb6352558e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738403:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb6352558e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738497:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb6352558e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431561.738544:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bc:0x0]: returning size 260096
00000004:00200000:1.0:1789431561.738550:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431561.738573:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb6352558e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738587:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb6352558e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738596:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525580 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738603:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525580 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738611:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525580 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738618:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f77a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.738623:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525580 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738631:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525580 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738646:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431561.738649:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.738655:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525580 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738661:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb63525580 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738677:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738684:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525587 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738690:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525587 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738696:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f76400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.738699:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525587 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738706:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525587 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738713:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x77103a66 (ffff90ce03149b00)
00010000:00010000:1.0:1789431561.738716:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.738719:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525587 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.738724:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525587 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.738872:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295857
00000100:00100000:3.0:1789431561.738887:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+284:14617:x1876351933447296:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431561.738899:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.738911:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525595 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c899e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.738953:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352559c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.738964:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352559c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.738973:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352559c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.738988:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635255a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xbcba1d9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.738999:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635255a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xbcba1d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.739006:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635255a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xbcba1d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.739042:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352559c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.739073:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352559c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.739079:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352559c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.739084:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.739087:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352559c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.739094:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352559c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.739102:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431561.739105:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.739108:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352559c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.739114:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352559c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.739124:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635255a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xbcba1d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.739130:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635255a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xbcba1d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.739136:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635255a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xbcba1d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.739141:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431561.739144:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635255a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xbcba1d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.739150:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635255a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xbcba1d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.739157:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xbcba1d9d (ffff90cf18b78800)
00010000:00010000:3.0:1789431561.739160:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.739162:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635255a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xbcba1d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.739168:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635255a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xbcba1d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.739197:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525595 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c899e expref: 285 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.739208:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431561.739211:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431561.739214:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525595 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c899e expref: 285 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.739229:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb600, rc 0)
00000100:00100000:3.0:1789431561.739308:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+284:14617:x1876351933447296:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 426us (1426us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431561.739315:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295857
00010000:00010000:1.0:1789431561.739730:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb63525579 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8997 expref: 284 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.739759:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb6352558e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8997 expref: 283 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.739767:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:1.0:1789431561.739770:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431561.739773:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb2e000, rc 0)
00000100:00100000:1.0:1789431561.739803:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:14616:x1876351933447168:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1764us (1994us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.739810:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295856
00000100:00100000:3.0:1789431561.751714:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.751772:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.752844:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933447552
00000100:00100000:1.0:1789431561.752861:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933447552
00000100:00100000:1.0:1789431561.752973:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14331
00000100:00100000:1.0:1789431561.752985:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:2350:x1876351933447552:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431561.753008:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431561.753043:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb6352558e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8997 expref: 283 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.753114:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:1.0:1789431561.753120:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431561.753194:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:2350:x1876351933447552:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 211us (1493us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.753202:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14331
00000100:00100000:0.0:1789431561.753411:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933447424
00000100:00100000:0.0:1789431561.753420:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933447424
00000100:00100000:0.0:1789431561.753466:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295858
00000100:00100000:0.0:1789431561.753474:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14617:x1876351933447424:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431561.753497:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431561.753517:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635255aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c89a5 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.753602:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635255b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.753619:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635255b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.753631:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635255b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.753696:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x87f1f2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.753705:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x87f1f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.753711:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x87f1f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.753807:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635255b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.753815:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635255b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.753822:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635255b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.753828:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.753833:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635255b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.753841:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635255b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.753851:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431561.753854:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.753858:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635255b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.753864:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635255b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.753878:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x87f1f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.753884:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x87f1f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.754303:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x87f1f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.754311:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.754315:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x87f1f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.754321:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x87f1f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.754331:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x87f1f2c1 (ffff90ce07190400)
00010000:00010000:0.0:1789431561.754334:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.754337:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x87f1f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.754345:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x87f1f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.754395:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635255aa lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89a5 expref: 283 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.754406:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431561.754408:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.754414:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635255aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89a5 expref: 283 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.754423:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd5800, rc 0)
00000100:00100000:0.0:1789431561.754581:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14617:x1876351933447424:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1107us (2807us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431561.754589:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295858
00000100:00100000:1.0:1789431561.756027:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.756675:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933447808
00000100:00100000:2.0:1789431561.756689:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933447808
00000100:00100000:2.0:1789431561.756962:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295859
00000100:00100000:2.0:1789431561.756975:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+282:14616:x1876351933447808:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.757001:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.757028:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635255bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c89ac expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.757186:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635255c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.757205:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635101e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c21a8 expref: 283 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.757214:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635255c6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.757258:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635101e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c21a8 expref: 283 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.757472:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635101e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c21a8 expref: 283 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.757490:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a044000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894214912:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431561.757648:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c19c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431561.762609:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a044000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894214912:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431561.762649:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635255c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.765041:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.765601:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933447936
00000100:00100000:3.0:1789431561.765616:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933447936
00010000:00010000:3.0:1789431561.765675:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635101e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c21a8 expref: 284 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.765784:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16475
00000100:00100000:3.0:1789431561.765797:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+284:2348:x1876351933447936:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431561.765815:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431561.765823:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635101e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c21a8 expref: 284 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.765839:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635101e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c21a8 expref: 284 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.765864:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635101e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c21a8 expref: 284 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.765883:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:3.0:1789431561.765890:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635255c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.765901:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635255c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.765910:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635255c6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.765951:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431561.766033:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:2348:x1876351933447936:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 238us (1006us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431561.766041:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16475
00010000:00010000:0.0:1789431561.766145:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635255c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.766154:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635255c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431561.766178:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bc:0x0]: returning size 260096
00010000:00010000:0.0:1789431561.766388:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635255bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89ac expref: 284 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.766407:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635255c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89ac expref: 283 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.766416:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:0.0:1789431561.766419:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431561.766422:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ac400, rc 0)
00000100:00100000:0.0:1789431561.766466:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:14616:x1876351933447808:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9493us (10448us total) trans 4295120910 rc 0/0
00000100:00100000:0.0:1789431561.766474:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295859
00000100:00100000:2.0:1789431561.771189:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.771331:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933448064
00000100:00100000:0.0:1789431561.771345:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933448064
00000100:00100000:0.0:1789431561.771413:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295860
00000100:00100000:0.0:1789431561.771426:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:14617:x1876351933448064:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431561.771455:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431561.771483:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635255d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c89b3 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.771569:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635255db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.771588:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635255db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.771601:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635255db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.771619:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635255e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x5d3530c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.771626:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635255e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x5d3530c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.771632:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635255e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x5d3530c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.771703:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635255db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.771712:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635255db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.771720:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635255db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.771731:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.771747:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635255db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.771982:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635255db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.771998:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431561.772001:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.772008:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635255db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.772015:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635255db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.772032:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635255e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x5d3530c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.772039:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635255e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x5d3530c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.772045:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635255e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x5d3530c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.772079:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.772083:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635255e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x5d3530c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.772090:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635255e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x5d3530c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.772101:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x5d3530c1 (ffff90ce07190400)
00010000:00010000:0.0:1789431561.772104:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.772106:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635255e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x5d3530c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.772112:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635255e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x5d3530c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.772152:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635255d4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89b3 expref: 284 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.772163:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431561.772165:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.772170:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635255d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89b3 expref: 284 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.772180:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62c200, rc 0)
00000100:00100000:0.0:1789431561.772262:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:14617:x1876351933448064:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 838us (1088us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431561.772328:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295860
00000100:00100000:1.0:1789431561.779796:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.779906:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933448192
00000100:00100000:0.0:1789431561.779920:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933448192
00000100:00100000:0.0:1789431561.779991:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295861
00000100:00100000:0.0:1789431561.780003:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:14616:x1876351933448192:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431561.780037:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431561.780104:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635255e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c89ba expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.780223:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.780241:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635255c6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89ac expref: 284 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.780250:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255f0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.780305:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635255c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89ac expref: 284 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.780322:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635255c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89ac expref: 284 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.780337:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e91500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894215040:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431561.780440:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ac1f180 going to sleep for 11 seconds
00000100:00100000:0.0:1789431561.783862:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e91500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894215040:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431561.783904:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.786173:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.786300:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933448320
00000100:00100000:2.0:1789431561.786314:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933448320
00010000:00010000:2.0:1789431561.786378:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635255c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89ac expref: 285 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.786430:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16476
00000100:00100000:2.0:1789431561.786441:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+285:2347:x1876351933448320:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.786464:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.786472:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635255c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89ac expref: 285 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.786487:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635255c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89ac expref: 285 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.786516:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635255c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89ac expref: 285 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.786537:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:2.0:1789431561.786543:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.786556:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.786564:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255f0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.786597:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.786669:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+284:2347:x1876351933448320:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 229us (511us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.786677:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16476
00010000:00010000:0.0:1789431561.786782:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.786791:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431561.786856:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bc:0x0]: returning size 260096
00000004:00200000:0.0:1789431561.786864:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431561.786894:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.786937:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635255e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100bc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89ba expref: 284 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.786957:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89ba expref: 283 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.786965:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:0.0:1789431561.786968:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431561.786971:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4e00, rc 0)
00000100:00100000:0.0:1789431561.787004:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:14616:x1876351933448192:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7004us (7223us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.787012:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295861
00000100:00100000:3.0:1789431561.790044:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.790526:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933448448
00000100:00100000:1.0:1789431561.790538:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933448448
00000100:00100000:1.0:1789431561.790652:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295862
00000100:00100000:1.0:1789431561.790665:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:14617:x1876351933448448:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.790695:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.790725:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635255f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c89c1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.790833:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635255fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.790853:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635255fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.790867:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635255fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.790885:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525605 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x2ff11805 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.790892:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x2ff11805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.790899:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x2ff11805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.790971:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635255fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.790980:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635255fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.790992:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635255fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.790999:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb2e000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.791005:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635255fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.791015:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635255fe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.791028:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431561.791032:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.791039:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635255fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.791183:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635255fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.791202:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x2ff11805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.791208:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525605 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x2ff11805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.791215:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525605 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x2ff11805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.791220:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb2f600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431561.791224:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525605 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x2ff11805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.791235:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525605 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0x2ff11805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.791243:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x2ff11805 (ffff90ce03149b00)
00010000:00010000:1.0:1789431561.791246:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.791249:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525605 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x2ff11805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.791255:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525605 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x2ff11805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.791302:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635255f7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89c1 expref: 284 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.791368:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431561.791371:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431561.791375:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635255f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89c1 expref: 284 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.791386:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb2f800, rc 0)
00000100:00100000:1.0:1789431561.791511:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:14617:x1876351933448448:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 849us (1480us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431561.791519:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295862
00000100:00100000:3.0:1789431561.794959:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.795101:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933448704
00000100:00100000:1.0:1789431561.795115:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933448704
00000100:00100000:1.0:1789431561.795178:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12444
00000100:00100000:1.0:1789431561.795191:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+283:14616:x1876351933448704:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431561.795543:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+284:14616:x1876351933448704:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 354us (597us total) trans 4295120911 rc 0/0
00000100:00100000:1.0:1789431561.795552:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12444
00000100:00100000:2.0:1789431561.801915:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.802016:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933448832
00000100:00100000:0.0:1789431561.802030:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933448832
00000100:00100000:0.0:1789431561.802127:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295863
00000100:00100000:0.0:1789431561.802145:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+284:14616:x1876351933448832:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431561.802178:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431561.802206:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352560c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c89c8 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802301:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63525613 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802319:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63525613 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802339:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63525613 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802356:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352561a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802364:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352561a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802372:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352561a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802503:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525621 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802512:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802519:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431561.802566:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bc:0x0]: returning size 260096
00000004:00200000:0.0:1789431561.802572:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431561.802594:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802607:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802617:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63525613 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802628:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63525613 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802636:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63525613 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802642:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.802647:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63525613 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802655:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63525613 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802668:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431561.802671:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.802677:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63525613 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802683:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb63525613 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802697:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352561a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802703:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352561a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802709:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352561a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802714:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.802718:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352561a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802724:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352561a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802731:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x77103a66 (ffff90ce07190400)
00010000:00010000:0.0:1789431561.802734:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.802748:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352561a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802755:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352561a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802791:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352560c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89c8 expref: 286 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802806:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525621 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89c8 expref: 285 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.802815:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:0.0:1789431561.802817:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431561.802819:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62d200, rc 0)
00000100:00100000:0.0:1789431561.802904:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+285:14616:x1876351933448832:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 767us (1004us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.802912:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295863
00000100:00100000:2.0:1789431561.804439:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.804573:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933448960
00000100:00100000:3.0:1789431561.804586:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933448960
00000100:00100000:3.0:1789431561.804650:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295864
00000100:00100000:3.0:1789431561.804662:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+285:14617:x1876351933448960:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431561.804687:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.804711:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525628 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c89cf expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.804811:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352562f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.804831:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352562f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.804845:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352562f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.804864:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525636 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.804872:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.804879:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.805017:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352563d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.805027:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352563d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.805035:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352563d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431561.807464:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bf:0x0]: returning size 260096
00000004:00200000:0.0:1789431561.807476:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431561.807514:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352563d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.807542:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352563d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.807554:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352562f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.807562:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352562f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.807570:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352562f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.807577:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.807581:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352562f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.807590:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352562f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.807606:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431561.807609:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.807614:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352562f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.807619:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352562f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.807641:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.807648:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525636 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.807654:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525636 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.807659:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.807662:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525636 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.807668:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525636 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.807676:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xc4fc354d (ffff90cf18b78800)
00010000:00010000:0.0:1789431561.807679:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.807682:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525636 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.807688:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525636 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.807765:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525628 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89cf expref: 287 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.807781:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352563d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89cf expref: 286 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.807790:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:0.0:1789431561.807792:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431561.807795:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cac00, rc 0)
00000100:00100000:0.0:1789431561.807974:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+286:14617:x1876351933448960:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3311us (3545us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.807985:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295864
00000100:00100000:1.0:1789431561.811149:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.815545:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933449088
00000100:00100000:2.0:1789431561.815570:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933449088
00000100:00100000:2.0:1789431561.815679:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14332
00000100:00100000:2.0:1789431561.815693:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e954c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+286:2349:x1876351933449088:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.815715:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.815768:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525621 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89c8 expref: 286 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.815796:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:2.0:1789431561.815803:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.815880:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e954c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+285:2349:x1876351933449088:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 190us (4747us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.815889:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14332
00000100:00100000:2.0:1789431561.834264:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.834319:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.834387:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.834421:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933449472
00000100:00100000:2.0:1789431561.834434:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933449472
00000100:00100000:2.0:1789431561.834496:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933449728
00000100:00100000:2.0:1789431561.834499:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933449728
00000100:00100000:1.0:1789431561.834504:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295865
00000100:00100000:1.0:1789431561.834519:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+286:14616:x1876351933449472:12345-192.168.203.4@tcp:101:dbench.0
00000100:00100000:2.0:1789431561.834521:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295866
00000100:00100000:2.0:1789431561.834528:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+286:14617:x1876351933449728:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.834552:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.834552:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.834579:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb6352564b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c89d6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.834579:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525644 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c89dd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.834706:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525659 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.834706:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525652 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.834724:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89ba expref: 288 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.834724:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb6350fb77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c202e expref: 288 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.834735:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352563d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89cf expref: 288 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.834745:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525659 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.834791:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89ba expref: 288 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.834807:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89ba expref: 288 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.834823:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894215168:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431561.834854:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933449216
00000100:00100000:3.0:1789431561.834859:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933449216
00000100:00100000:3.0:1789431561.834902:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14333
00000100:00100000:3.0:1789431561.834909:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+289:2348:x1876351933449216:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431561.834919:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1789431561.834936:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e180 going to sleep for 11 seconds
00010000:00010000:2.0:1789431561.834948:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525652 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.838254:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:3.0:1789431561.838657:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525652 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.838676:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525652 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.838684:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431561.838886:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+289:2348:x1876351933449216:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 3969us (4629us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.838899:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14333
00000100:00100000:1.0:1789431561.838985:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894215168:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431561.839016:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525659 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.840509:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.840639:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933449856
00000100:00100000:1.0:1789431561.840650:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933449856
00010000:00010000:1.0:1789431561.840701:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89ba expref: 289 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.840767:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16477
00000100:00100000:1.0:1789431561.840778:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+289:2347:x1876351933449856:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431561.840798:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431561.840806:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89ba expref: 289 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.840818:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89ba expref: 289 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.840844:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635255f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89ba expref: 289 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.840864:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:1.0:1789431561.840870:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525659 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.840887:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525659 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.840895:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525659 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.840932:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431561.840997:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+288:2347:x1876351933449856:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 221us (499us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.841005:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16477
00010000:00010000:0.0:1789431561.841982:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525659 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.841998:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525659 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431561.842027:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bc:0x0]: returning size 260096
00010000:00010000:0.0:1789431561.842261:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb6352564b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89d6 expref: 289 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.842295:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525659 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89d6 expref: 288 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.842303:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:0.0:1789431561.842306:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431561.842310:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb2f600, rc 0)
00000100:00100000:0.0:1789431561.842377:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+288:14616:x1876351933449472:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7863us (8056us total) trans 4295120912 rc 0/0
00000100:00100000:0.0:1789431561.842385:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295865
00010000:00010000:2.0:1789431561.844440:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352563d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89cf expref: 287 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.844487:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb6350fb77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c202e expref: 286 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.844503:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb6350fb77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c202e expref: 286 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.844521:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e828000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894215424:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431561.844662:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c13c0 going to sleep for 11 seconds
00000100:00100000:2.0:1789431561.848360:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e828000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894215424:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431561.848400:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525652 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.849648:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.849724:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933449984
00000100:00100000:0.0:1789431561.849745:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933449984
00000100:00100000:0.0:1789431561.849836:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295867
00000100:00100000:0.0:1789431561.849848:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+287:14616:x1876351933449984:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431561.849883:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431561.849913:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525667 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c89e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.850031:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352566e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.850085:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525659 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89d6 expref: 288 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.850097:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352566e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.850142:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525659 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89d6 expref: 288 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.850155:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525659 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89d6 expref: 288 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.850170:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e91180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894215552:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431561.850394:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ac1f300 going to sleep for 11 seconds
00000100:00100000:1.0:1789431561.852186:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.852336:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933450112
00000100:00100000:0.0:1789431561.852348:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933450112
00010000:00010000:0.0:1789431561.852397:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb6350fb77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c202e expref: 289 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.852449:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16478
00000100:00100000:0.0:1789431561.852462:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+289:2347:x1876351933450112:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431561.852482:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431561.852491:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb6350fb77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c202e expref: 289 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.852507:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb6350fb77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c202e expref: 289 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.852537:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb6350fb77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c202e expref: 289 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.852558:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:0.0:1789431561.852564:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525652 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.852575:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525652 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.852584:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525652 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.852626:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431561.852752:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+288:2347:x1876351933450112:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 291us (577us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.852769:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16478
00010000:00010000:1.0:1789431561.852875:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525652 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.852885:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525652 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431561.852910:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bf:0x0]: returning size 260096
00010000:00010000:1.0:1789431561.853152:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525644 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89dd expref: 289 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.853172:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525652 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89dd expref: 288 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.853180:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:1.0:1789431561.853182:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431561.853185:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ace00, rc 0)
00000100:00100000:1.0:1789431561.853221:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+288:14617:x1876351933449728:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 18693us (18833us total) trans 4295120913 rc 0/0
00000100:00100000:1.0:1789431561.853228:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295866
00000100:00100000:1.0:1789431561.860413:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.860579:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933450240
00000100:00100000:2.0:1789431561.860592:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933450240
00010000:00010000:2.0:1789431561.860652:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525659 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89d6 expref: 288 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.860713:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16479
00000100:00100000:2.0:1789431561.860724:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+288:2347:x1876351933450240:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.860761:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.860770:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525659 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89d6 expref: 288 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.860784:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525659 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89d6 expref: 288 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.860814:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:2.0:1789431561.860822:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352566e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.860832:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352566e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.860842:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352566e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.860870:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.860945:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+288:2347:x1876351933450240:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 223us (547us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.860952:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16479
00010000:00010000:0.0:1789431561.861121:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f600/0xd8e438fb63525659 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89d6 expref: 287 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.861143:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e91180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894215552:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431561.861170:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352566e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.861187:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352566e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.861194:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352566e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431561.861262:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bc:0x0]: returning size 260096
00000004:00200000:0.0:1789431561.861277:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431561.861313:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352566e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.861363:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525667 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100bc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89e4 expref: 287 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.861381:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352566e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89e4 expref: 286 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.861388:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:0.0:1789431561.861391:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431561.861394:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62de00, rc 0)
00000100:00100000:0.0:1789431561.861427:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+286:14616:x1876351933449984:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11583us (11791us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.861435:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295867
00000100:00100000:3.0:1789431561.868856:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.868962:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933450368
00000100:00100000:1.0:1789431561.868977:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933450368
00000100:00100000:1.0:1789431561.869091:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295868
00000100:00100000:1.0:1789431561.869105:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+286:14617:x1876351933450368:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.869144:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.869171:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352567c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c89eb expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.869303:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525683 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.869321:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525652 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89dd expref: 287 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.869331:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525683 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.869375:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525652 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89dd expref: 287 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.869390:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525652 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89dd expref: 287 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.869407:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce279f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894215680:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431561.869513:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e180 going to sleep for 11 seconds
00000100:00100000:1.0:1789431561.871894:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.872002:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933450624
00000100:00100000:3.0:1789431561.872015:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933450624
00000100:00100000:3.0:1789431561.872247:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12445
00000100:00100000:3.0:1789431561.872260:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+288:14616:x1876351933450624:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431561.873581:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+289:14616:x1876351933450624:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 1316us (1693us total) trans 4295120914 rc 0/0
00000100:00100000:3.0:1789431561.873592:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12445
00000100:00100000:0.0:1789431561.874172:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce279f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894215680:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431561.874216:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525683 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.877838:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.877938:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.878033:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933450880
00000100:00100000:2.0:1789431561.878110:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933450880
00000100:00100000:2.0:1789431561.878226:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295869
00000100:00100000:2.0:1789431561.878240:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+289:14616:x1876351933450880:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.878286:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.878317:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352568a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c89f2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878410:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525691 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878432:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525691 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878446:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525691 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878464:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525698 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878472:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878479:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878611:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352569f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878620:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352569f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878628:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352569f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431561.878672:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bc:0x0]: returning size 260096
00000004:00200000:2.0:1789431561.878679:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431561.878703:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352569f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878718:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352569f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878727:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525691 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878734:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525691 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878759:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525691 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878767:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.878772:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525691 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878781:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525691 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878796:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431561.878800:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.878805:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525691 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878812:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525691 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878829:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878840:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525698 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878847:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525698 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878852:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.878855:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525698 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878861:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525698 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878869:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x77103a66 (ffff90cf13195900)
00010000:00010000:2.0:1789431561.878872:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.878875:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525698 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878880:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525698 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878916:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352568a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f2 expref: 291 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878931:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352569f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f2 expref: 290 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.878939:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:2.0:1789431561.878942:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431561.878944:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ac400, rc 0)
00000100:00100000:2.0:1789431561.879347:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+290:14616:x1876351933450880:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1107us (1405us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.879355:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295869
00000100:00100000:0.0:1789431561.879433:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933450752
00000100:00100000:0.0:1789431561.879442:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933450752
00010000:00010000:0.0:1789431561.879476:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525652 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89dd expref: 290 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.879505:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16480
00000100:00100000:0.0:1789431561.879514:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce279f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+290:2347:x1876351933450752:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431561.879529:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431561.879536:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525652 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89dd expref: 290 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.879548:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525652 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89dd expref: 290 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.879566:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525652 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89dd expref: 290 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.879579:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:0.0:1789431561.879584:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525683 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.879593:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525683 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.879600:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525683 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.879624:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431561.879655:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce279f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+289:2347:x1876351933450752:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 142us (1835us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.879665:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16480
00010000:00010000:0.0:1789431561.879696:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525683 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.879704:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525683 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431561.879752:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bf:0x0]: returning size 260096
00000004:00200000:0.0:1789431561.879756:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431561.879772:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525683 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.879803:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb6352567c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100bf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89eb expref: 289 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.879817:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525683 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89eb expref: 288 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.879824:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:0.0:1789431561.879827:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431561.879829:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37f76400, rc 0)
00000100:00100000:0.0:1789431561.879853:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+288:14617:x1876351933450368:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10753us (11014us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.879859:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295868
00000100:00100000:1.0:1789431561.885485:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.885534:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.885569:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933451392
00000100:00100000:1.0:1789431561.885583:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933451392
00000100:00100000:1.0:1789431561.885659:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295870
00000100:00100000:1.0:1789431561.885671:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+288:14616:x1876351933451392:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.885707:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.885746:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635256a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c89f9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.885894:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.885912:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352566e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89e4 expref: 289 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.885920:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352569f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f2 expref: 289 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.885929:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 5/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.885964:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352569f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f2 expref: 289 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.885979:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352569f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f2 expref: 289 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.885991:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1a568380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894215808:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431561.886093:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352566e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89e4 expref: 289 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.886099:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352566e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89e4 expref: 289 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.886105:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1a568e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894215936:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431561.886120:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065ec00 going to sleep for 11 seconds
00000100:00100000:1.0:1789431561.886155:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.887990:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933451136
00000100:00100000:3.0:1789431561.888008:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933451136
00000100:00100000:3.0:1789431561.888105:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12446
00000100:00100000:3.0:1789431561.888117:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+290:14617:x1876351933451136:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431561.888422:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+291:14617:x1876351933451136:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 307us (2953us total) trans 4295120915 rc 0/0
00000100:00100000:3.0:1789431561.888431:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12446
00000100:00100000:3.0:1789431561.888462:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933451520
00000100:00100000:3.0:1789431561.888468:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933451520
00010000:00010000:3.0:1789431561.888489:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352569f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f2 expref: 291 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.888518:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16481
00000100:00100000:3.0:1789431561.888525:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+291:2350:x1876351933451520:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431561.888538:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431561.888545:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352569f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f2 expref: 291 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.888557:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352569f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f2 expref: 291 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.888584:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:3.0:1789431561.888590:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.888602:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.888609:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431561.888641:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+291:2350:x1876351933451520:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 116us (2484us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431561.888647:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16481
00010000:00010000:2.0:1789431561.890401:0:5847:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@000000003383a53e x1876351894215808) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352569f lrc: 1/0,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f2 expref: 290 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.890431:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352569f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f2 expref: 290 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.890453:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1a568380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894215808:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431561.890469:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1a568e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894215936:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431561.890501:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:2.0:1789431561.890509:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.890520:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.890531:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.894686:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.895148:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933451648
00000100:00100000:2.0:1789431561.895163:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933451648
00010000:00010000:2.0:1789431561.895219:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352566e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89e4 expref: 290 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.895282:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16482
00000100:00100000:2.0:1789431561.895294:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e957450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+290:2347:x1876351933451648:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.895315:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.895324:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352566e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89e4 expref: 290 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.895340:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352566e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89e4 expref: 290 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.895369:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352566e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89e4 expref: 290 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.895390:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:2.0:1789431561.895398:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.895409:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.895420:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.895456:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.895537:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e957450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+289:2347:x1876351933451648:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 245us (866us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.895545:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16482
00010000:00010000:1.0:1789431561.897012:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.897033:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431561.897162:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bc:0x0]: returning size 260096
00010000:00010000:1.0:1789431561.897496:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77c00/0xd8e438fb635256a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f9 expref: 290 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.897524:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f9 expref: 289 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.897540:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:1.0:1789431561.897543:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431561.897547:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37f76200, rc 0)
00000100:00100000:1.0:1789431561.897622:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+289:14616:x1876351933451392:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11952us (12085us total) trans 4295120916 rc 0/0
00000100:00100000:1.0:1789431561.897631:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295870
00000100:00100000:1.0:1789431561.901912:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.903489:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.904622:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933451776
00000100:00100000:0.0:1789431561.904641:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933451776
00000100:00100000:1.0:1789431561.904795:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933451904
00000100:00100000:1.0:1789431561.904800:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933451904
00000100:00100000:1.0:1789431561.904841:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295871
00000100:00100000:1.0:1789431561.904853:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+290:14616:x1876351933451776:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.904888:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.904920:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635256bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a00 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.905089:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635256c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.905111:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f9 expref: 291 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.905122:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635256c2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.905167:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f9 expref: 291 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.905187:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f9 expref: 291 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.905202:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1e91bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894216064:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431561.905677:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065ec00 going to sleep for 11 seconds
00000100:00100000:0.0:1789431561.905787:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295872
00000100:00100000:0.0:1789431561.905801:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+291:14617:x1876351933451904:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431561.905814:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431561.905829:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635256c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a07 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.905877:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635256d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.905892:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635256d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.905905:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635256d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.905923:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635256d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.905931:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635256d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.905937:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635256d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906105:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635256de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906115:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635256de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906123:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635256de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431561.906162:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bf:0x0]: returning size 260096
00000004:00200000:0.0:1789431561.906168:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431561.906193:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635256de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906209:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635256de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906218:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635256d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906225:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635256d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906232:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635256d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906239:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.906244:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635256d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906252:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635256d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906276:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:0.0:1789431561.906591:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.906599:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635256d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906607:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635256d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906624:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635256d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906634:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635256d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906641:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635256d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906646:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37f77a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.906650:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635256d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906655:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635256d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906664:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xc4fc354d (ffff90ce07190400)
00010000:00010000:0.0:1789431561.906667:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.906670:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635256d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906675:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77a00/0xd8e438fb635256d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906719:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635256c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a07 expref: 293 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.906745:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635256de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a07 expref: 292 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.910906:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:0.0:1789431561.910912:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431561.910919:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd4e00, rc 0)
00000100:00100000:2.0:1789431561.910938:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf1e91bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894216064:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431561.910981:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635256c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.911932:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+292:14617:x1876351933451904:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6129us (8448us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.911945:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295872
00000100:00100000:1.0:1789431561.912038:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.912121:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933452032
00000100:00100000:3.0:1789431561.912132:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933452032
00010000:00010000:3.0:1789431561.912178:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f9 expref: 292 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.912422:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16483
00000100:00100000:3.0:1789431561.912433:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+292:2348:x1876351933452032:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431561.912452:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431561.912462:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f9 expref: 292 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.912477:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f9 expref: 292 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.912505:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb635256ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89f9 expref: 292 pid: 5847 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.912523:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:3.0:1789431561.912530:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635256c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.912542:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635256c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.912551:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635256c2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.912586:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431561.912635:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+291:2348:x1876351933452032:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 203us (599us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431561.912643:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16483
00010000:00010000:2.0:1789431561.912748:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635256c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.912759:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635256c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431561.912819:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bc:0x0]: returning size 260096
00000004:00200000:2.0:1789431561.912826:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431561.912854:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635256c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.912896:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f800/0xd8e438fb635256bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100bc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a00 expref: 291 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.912914:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635256c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a00 expref: 290 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.912923:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:2.0:1789431561.912926:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431561.912928:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb2e000, rc 0)
00000100:00100000:2.0:1789431561.913020:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+290:14616:x1876351933451776:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8169us (11124us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.913027:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295871
00000100:00100000:2.0:1789431561.923986:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.924174:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933452288
00000100:00100000:0.0:1789431561.924191:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933452288
00000100:00100000:0.0:1789431561.924299:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12447
00000100:00100000:0.0:1789431561.924312:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+290:14616:x1876351933452288:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431561.924338:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.924546:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933452416
00000100:00100000:1.0:1789431561.924552:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933452416
00000100:00100000:1.0:1789431561.924646:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14334
00000100:00100000:1.0:1789431561.924656:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+292:2349:x1876351933452416:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431561.924670:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431561.924703:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb635256de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a07 expref: 292 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.924725:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+291:14616:x1876351933452288:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 414us (753us total) trans 4295120917 rc 0/0
00010000:00010000:1.0:1789431561.924727:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:1.0:1789431561.924748:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431561.924760:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12447
00000100:00100000:1.0:1789431561.924775:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+291:2349:x1876351933452416:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 119us (436us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.924785:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14334
00000100:00100000:1.0:1789431561.928275:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.928465:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933452544
00000100:00100000:0.0:1789431561.928481:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933452544
00000100:00100000:0.0:1789431561.928577:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295873
00000100:00100000:0.0:1789431561.928589:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+290:14616:x1876351933452544:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431561.928621:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431561.928650:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635256e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a0e expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.928746:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635256ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.929392:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635256ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.929407:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635256ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.929433:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635256f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.929442:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635256f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.929448:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635256f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.929588:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635256fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.929597:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635256fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.929605:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635256fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431561.929650:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bc:0x0]: returning size 260096
00000004:00200000:0.0:1789431561.929655:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431561.929680:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635256fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.929694:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635256fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.929702:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635256ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.929709:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635256ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.929716:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635256ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.929729:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd5400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.929734:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635256ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.930861:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635256ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.930893:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431561.930896:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.930904:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635256ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.930912:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635256ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.930935:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635256f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.930942:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635256f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.930948:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635256f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.930954:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431561.930958:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635256f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.930964:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635256f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.930976:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x77103a66 (ffff90ce07190400)
00010000:00010000:0.0:1789431561.930978:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431561.930981:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635256f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.930987:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635256f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.931069:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635256e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a0e expref: 292 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.931089:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635256fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a0e expref: 291 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.931097:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:0.0:1789431561.931099:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431561.931103:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b000, rc 0)
00000100:00100000:0.0:1789431561.931300:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+291:14616:x1876351933452544:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2711us (3038us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.931310:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295873
00000100:00100000:2.0:1789431561.934781:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.934937:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933452800
00000100:00100000:3.0:1789431561.934951:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933452800
00000100:00100000:3.0:1789431561.935023:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295874
00000100:00100000:3.0:1789431561.935035:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+291:14617:x1876351933452800:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431561.935111:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431561.935140:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525701 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a15 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.935293:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525708 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.935313:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525683 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89eb expref: 292 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.935323:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525708 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.935368:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525683 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89eb expref: 292 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.935384:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525683 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89eb expref: 292 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.935400:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894216192:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431561.935501:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2d449780 going to sleep for 11 seconds
00000100:00100000:3.0:1789431561.936831:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431561.936987:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933452928
00000100:00100000:0.0:1789431561.936999:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933452928
00000100:00100000:0.0:1789431561.937106:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14335
00000100:00100000:0.0:1789431561.937120:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+293:2350:x1876351933452928:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431561.937140:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431561.937171:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635256fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a0e expref: 293 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.937200:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:0.0:1789431561.937207:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431561.937289:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+292:2350:x1876351933452928:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 172us (471us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.937298:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14335
00000100:00100000:0.0:1789431561.940171:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894216192:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431561.940214:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525708 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.941429:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.941531:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933453056
00000100:00100000:2.0:1789431561.941544:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933453056
00010000:00010000:2.0:1789431561.941610:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525683 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89eb expref: 292 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.941669:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16484
00000100:00100000:2.0:1789431561.941681:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+292:2350:x1876351933453056:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.941699:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.941707:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525683 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89eb expref: 292 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.941721:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525683 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89eb expref: 292 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.941759:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76400/0xd8e438fb63525683 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c89eb expref: 292 pid: 6797 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.941793:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:2.0:1789431561.941799:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525708 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.941811:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525708 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.941821:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525708 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.941857:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.941931:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+291:2350:x1876351933453056:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 251us (509us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.941940:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16484
00010000:00010000:3.0:1789431561.943102:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525708 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.943118:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525708 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431561.943147:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bf:0x0]: returning size 260096
00010000:00010000:0.0:1789431561.943452:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525701 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a15 expref: 292 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.943479:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525708 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a15 expref: 291 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.943488:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:0.0:1789431561.943492:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431561.943495:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb600, rc 0)
00000100:00100000:0.0:1789431561.943572:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+291:14617:x1876351933452800:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8538us (8806us total) trans 4295120918 rc 0/0
00000100:00100000:0.0:1789431561.943580:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295874
00000100:00100000:2.0:1789431561.945313:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.945417:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933453312
00000100:00100000:1.0:1789431561.945430:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933453312
00000100:00100000:1.0:1789431561.945503:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295875
00000100:00100000:1.0:1789431561.945516:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+291:14616:x1876351933453312:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431561.945546:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431561.945584:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb63525716 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a1c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.946132:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352571d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.946152:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635256c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a00 expref: 292 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.946162:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352571d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.946206:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635256c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a00 expref: 292 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.946222:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635256c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a00 expref: 292 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.946237:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1e91bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894216320:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431561.946350:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e180 going to sleep for 11 seconds
00000100:00100000:1.0:1789431561.951215:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.951279:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933453440
00000100:00100000:2.0:1789431561.951295:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933453440
00000100:00100000:2.0:1789431561.951377:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295876
00000100:00100000:2.0:1789431561.951390:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+293:14617:x1876351933453440:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.951428:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.951458:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525724 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a23 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.951587:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352572b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.951604:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525708 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a15 expref: 294 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.951614:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352572b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.951669:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525708 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a15 expref: 294 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.951682:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525708 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a15 expref: 294 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.951697:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e829180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894216448:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431561.951818:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1840 going to sleep for 11 seconds
00000100:00100000:3.0:1789431561.954552:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.954744:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf1e91bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894216320:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431561.954791:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352571d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.958279:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933453568
00000100:00100000:2.0:1789431561.958300:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933453568
00010000:00010000:2.0:1789431561.958363:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635256c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a00 expref: 295 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.958410:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16485
00000100:00100000:1.0:1789431561.958411:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.958422:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+295:2347:x1876351933453568:12345-192.168.203.4@tcp:103:ldlm_bl.0
00000100:00100000:1.0:1789431561.958436:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933453696
00000100:00100000:1.0:1789431561.958440:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933453696
00010000:00010000:2.0:1789431561.958444:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.958453:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635256c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a00 expref: 296 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.958462:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525708 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a15 expref: 296 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.958468:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635256c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a00 expref: 296 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.958484:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16486
00000100:00100000:1.0:1789431561.958490:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+296:2348:x1876351933453696:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.958494:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e000/0xd8e438fb635256c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a00 expref: 296 pid: 12181 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.958497:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431561.958501:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525708 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a15 expref: 296 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.958509:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525708 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a15 expref: 295 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.958515:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:1.0:1789431561.958520:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:2.0:1789431561.958520:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352571d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.958526:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352572b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.958531:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352571d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.958533:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352572b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.958541:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352572b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.958541:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352571d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431561.958565:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431561.958629:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+295:2348:x1876351933453696:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 139us (347us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431561.958637:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16486
00010000:00010000:2.0:1789431561.958699:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.958721:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+294:2347:x1876351933453568:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 302us (4185us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.958728:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16485
00010000:00010000:2.0:1789431561.958769:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352571d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.958779:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352571d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431561.958807:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bc:0x0]: returning size 260096
00010000:00010000:2.0:1789431561.959029:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76200/0xd8e438fb63525716 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a1c expref: 295 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.959951:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525708 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a15 expref: 294 pid: 5849 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431561.959974:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e829180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894216448:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431561.960003:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352572b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.960014:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352572b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.960020:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352572b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.960025:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352571d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a1c expref: 293 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.960036:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:2.0:1789431561.960038:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431561.960043:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd5800, rc 0)
00000004:00200000:3.0:1789431561.960080:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bf:0x0]: returning size 260096
00000004:00200000:3.0:1789431561.960084:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431561.960104:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352572b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.960130:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+294:14616:x1876351933453312:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 14617us (14829us total) trans 4295120919 rc 0/0
00010000:00010000:3.0:1789431561.960137:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525724 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100bf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a23 expref: 294 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.960139:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295875
00010000:00010000:3.0:1789431561.960151:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352572b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a23 expref: 293 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431561.960157:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:3.0:1789431561.960159:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431561.960162:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad000, rc 0)
00000100:00100000:3.0:1789431561.960184:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+292:14617:x1876351933453440:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8798us (8986us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431561.960190:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295876
00000100:00100000:1.0:1789431561.968203:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.968266:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.968361:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933453824
00000100:00100000:3.0:1789431561.968361:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933454080
00000100:00100000:2.0:1789431561.968376:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933453824
00000100:00100000:3.0:1789431561.968376:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933454080
00000100:00100000:2.0:1789431561.968438:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295877
00000100:00100000:3.0:1789431561.968438:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12448
00000100:00100000:2.0:1789431561.968450:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+293:14616:x1876351933453824:12345-192.168.203.4@tcp:101:dbench.0
00000100:00100000:3.0:1789431561.968450:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+293:14617:x1876351933454080:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431561.968851:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+294:14617:x1876351933454080:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 401us (581us total) trans 4295120920 rc 0/0
00000100:00100000:3.0:1789431561.968860:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12448
00010000:00010000:2.0:1789431561.968876:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.968906:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525739 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a2a expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.968991:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525740 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.969009:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352571d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a1c expref: 294 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.969019:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525740 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.969090:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352571d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a1c expref: 294 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.969105:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352571d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a1c expref: 294 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.969122:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894216576:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431561.969190:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1900 going to sleep for 11 seconds
00000100:00100000:2.0:1789431561.973959:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894216576:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431561.974003:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525740 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431561.974125:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.974202:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933454208
00000100:00100000:2.0:1789431561.974212:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933454208
00010000:00010000:2.0:1789431561.974268:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352571d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a1c expref: 295 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.974308:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16487
00000100:00100000:2.0:1789431561.974320:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e955450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+295:2347:x1876351933454208:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431561.974341:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431561.974350:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352571d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a1c expref: 295 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.974362:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352571d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a1c expref: 295 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.974391:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb6352571d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a1c expref: 295 pid: 5848 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.974411:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:2.0:1789431561.974417:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525740 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.974429:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.974439:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525740 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.974472:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431561.974537:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e955450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+294:2347:x1876351933454208:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 219us (414us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.974546:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16487
00010000:00010000:0.0:1789431561.974914:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.974926:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431561.974997:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bc:0x0]: returning size 260096
00000004:00200000:0.0:1789431561.975003:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431561.975032:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.975114:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525739 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100bc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a2a expref: 294 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.975133:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a2a expref: 293 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.975142:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:0.0:1789431561.975144:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431561.975147:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ac400, rc 0)
00000100:00100000:0.0:1789431561.975185:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+293:14616:x1876351933453824:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6738us (7001us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.975192:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295877
00000100:00100000:1.0:1789431561.978457:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.978866:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933454336
00000100:00100000:2.0:1789431561.978879:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933454336
00000100:00100000:2.0:1789431561.978950:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295878
00000100:00100000:2.0:1789431561.978961:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+293:14617:x1876351933454336:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.978988:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.979015:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525747 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a31 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.979122:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352574e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.979147:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352574e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.979162:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352574e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.979183:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525755 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.979191:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.979198:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980233:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352575c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980252:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352575c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980263:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352575c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431561.980329:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bf:0x0]: returning size 260096
00000004:00200000:2.0:1789431561.980335:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431561.980360:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352575c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980378:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352575c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980388:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352574e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980396:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352574e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980404:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352574e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980410:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.980415:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352574e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980426:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352574e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980442:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431561.980445:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.980451:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352574e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980458:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352574e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980472:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980479:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525755 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980486:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525755 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980492:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431561.980494:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525755 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980501:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525755 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980509:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xc4fc354d (ffff90cf13195900)
00010000:00010000:2.0:1789431561.980511:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431561.980514:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525755 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980520:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525755 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980568:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525747 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a31 expref: 295 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980586:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352575c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a31 expref: 294 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.980594:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:2.0:1789431561.980596:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431561.980600:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62d200, rc 0)
00000100:00100000:2.0:1789431561.980683:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+294:14617:x1876351933454336:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1722us (2238us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431561.980693:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295878
00000100:00100000:1.0:1789431561.985937:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431561.986108:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933454592
00000100:00100000:2.0:1789431561.986121:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933454592
00000100:00100000:2.0:1789431561.986191:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295879
00000100:00100000:2.0:1789431561.986201:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+294:14617:x1876351933454592:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431561.986229:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431561.986258:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525763 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a38 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.986416:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.986433:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352572b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a23 expref: 295 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.986442:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352575c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a31 expref: 295 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.986451:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 5/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.986490:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352575c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a31 expref: 295 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.986503:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352575c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a31 expref: 295 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.986518:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894216704:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431561.986635:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352572b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a23 expref: 295 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.986644:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352572b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a23 expref: 295 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.986653:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894216832:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431561.986677:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1f00 going to sleep for 11 seconds
00000100:00100000:1.0:1789431561.998151:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431561.998224:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431561.998349:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933454976
00000100:00100000:3.0:1789431561.998362:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933454976
00000100:00100000:3.0:1789431561.998437:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12449
00000100:00100000:3.0:1789431561.998450:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+296:14616:x1876351933454976:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431561.998790:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+297:14616:x1876351933454976:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 342us (564us total) trans 4295120921 rc 0/0
00000100:00100000:3.0:1789431561.998798:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12449
00000100:00100000:0.0:1789431561.999004:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933454720
00000100:00100000:0.0:1789431561.999011:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933454720
00010000:00010000:0.0:1789431561.999045:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352575c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a31 expref: 297 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431561.999110:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16488
00000100:00100000:0.0:1789431561.999118:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+297:2350:x1876351933454720:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431561.999131:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431561.999139:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352575c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a31 expref: 297 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.999154:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352575c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a31 expref: 297 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.999181:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:0.0:1789431561.999188:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.999198:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431561.999206:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431561.999231:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+297:2350:x1876351933454720:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 114us (1095us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431561.999238:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16488
00010000:00010000:2.0:1789431561.999927:0:5848:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@000000004de1596f x1876351894216704) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352575c lrc: 1/0,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a31 expref: 296 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431561.999945:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352575c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a31 expref: 296 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431561.999963:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894216704:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431561.999977:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894216832:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431562.000000:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:2.0:1789431562.000004:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.000012:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.000023:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.003694:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.003862:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933455104
00000100:00100000:0.0:1789431562.003876:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933455104
00000100:00100000:0.0:1789431562.003970:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295880
00000100:00100000:0.0:1789431562.003982:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+296:14616:x1876351933455104:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431562.004011:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431562.004040:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63525771 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a3f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004171:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63525778 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004191:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63525778 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004209:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63525778 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004224:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb6352577f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004232:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb6352577f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004238:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb6352577f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00080000:1.0:1789431562.004488:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00010000:00010000:0.0:1789431562.004672:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63525786 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004683:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63525786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004691:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63525786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431562.004749:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bc:0x0]: returning size 260096
00000004:00200000:0.0:1789431562.004818:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431562.004845:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63525786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004859:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63525786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004867:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63525778 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004877:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63525778 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004884:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63525778 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004890:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.004895:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63525778 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004904:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63525778 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004918:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431562.004921:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.004927:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63525778 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004934:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63525778 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004951:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb6352577f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004957:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb6352577f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004963:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb6352577f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004968:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.004971:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb6352577f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004977:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb6352577f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004984:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x77103a66 (ffff90ce07190400)
00010000:00010000:0.0:1789431562.004987:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.004990:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb6352577f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.004995:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb6352577f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.005035:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63525771 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a3f expref: 298 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.005375:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63525786 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a3f expref: 297 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.005384:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:0.0:1789431562.005386:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431562.005389:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a000, rc 0)
00000100:00100000:0.0:1789431562.005477:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+297:14616:x1876351933455104:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1496us (1796us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.005487:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295880
00000100:00100000:1.0:1789431562.006493:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.006656:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933455232
00000100:00100000:0.0:1789431562.006665:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933455232
00010000:00010000:0.0:1789431562.006705:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352572b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a23 expref: 297 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.006914:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16489
00000100:00100000:0.0:1789431562.006924:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+297:2348:x1876351933455232:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431562.006945:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431562.006952:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352572b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a23 expref: 297 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.006965:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352572b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a23 expref: 297 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.006985:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352572b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a23 expref: 297 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.007000:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:0.0:1789431562.007005:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.007015:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.007022:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.007087:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431562.007143:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+296:2348:x1876351933455232:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 221us (654us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.007152:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16489
00010000:00010000:1.0:1789431562.007215:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.007224:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431562.007249:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bf:0x0]: returning size 260096
00010000:00010000:1.0:1789431562.007454:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525763 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a38 expref: 297 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.007473:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a38 expref: 296 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.007480:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:1.0:1789431562.007484:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431562.007486:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce249e1000, rc 0)
00000100:00100000:1.0:1789431562.007514:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+296:14617:x1876351933454592:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 21313us (21590us total) trans 4295120922 rc 0/0
00000100:00100000:1.0:1789431562.007521:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295879
00000100:00100000:1.0:1789431562.013652:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.013779:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933455360
00000100:00100000:2.0:1789431562.013794:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933455360
00000100:00100000:2.0:1789431562.013886:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14336
00000100:00100000:2.0:1789431562.013899:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+296:2350:x1876351933455360:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431562.013922:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431562.013955:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63525786 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a3f expref: 296 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.013982:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:2.0:1789431562.013989:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431562.014099:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+295:2350:x1876351933455360:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 201us (467us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.014107:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14336
00000100:00100000:1.0:1789431562.020146:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.020455:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933455488
00000100:00100000:0.0:1789431562.020471:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933455488
00000100:00100000:0.0:1789431562.020593:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295881
00000100:00100000:0.0:1789431562.020617:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+295:14617:x1876351933455488:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431562.020655:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431562.020684:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63525794 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a46 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.020814:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352579b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.020832:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a38 expref: 296 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.020841:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352579b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.020885:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a38 expref: 296 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.020902:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a38 expref: 296 pid: 5848 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.020919:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e91180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894216960:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431562.021029:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ac1f300 going to sleep for 11 seconds
00000100:00100000:0.0:1789431562.023899:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e91180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894216960:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431562.023942:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352579b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.025645:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.025767:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.025868:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933455872
00000100:00100000:2.0:1789431562.025880:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933455872
00010000:00010000:2.0:1789431562.025933:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a38 expref: 297 pid: 5848 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.025983:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16490
00000100:00100000:2.0:1789431562.025994:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+297:2347:x1876351933455872:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431562.026013:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431562.026021:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a38 expref: 297 pid: 5848 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.026036:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a38 expref: 297 pid: 5848 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.026102:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb6352576a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a38 expref: 297 pid: 5848 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.026123:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:2.0:1789431562.026130:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352579b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.026140:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352579b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.026148:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352579b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.026180:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431562.026246:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+296:2347:x1876351933455872:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 254us (478us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.026255:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16490
00010000:00010000:1.0:1789431562.026647:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352579b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.026658:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352579b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431562.026718:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bf:0x0]: returning size 260096
00000004:00200000:1.0:1789431562.026724:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431562.027287:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352579b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.027339:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63525794 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100bf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a46 expref: 296 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.027360:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352579b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a46 expref: 295 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.027369:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:1.0:1789431562.027372:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431562.027375:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a000, rc 0)
00000100:00100000:3.0:1789431562.027572:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933455744
00000100:00100000:3.0:1789431562.027581:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933455744
00000100:00100000:3.0:1789431562.027637:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295882
00000100:00100000:3.0:1789431562.027648:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+296:14616:x1876351933455744:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431562.027670:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431562.027692:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635257a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a4d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.027820:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635257a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.027835:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525740 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a2a expref: 297 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.027848:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635257a9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.027891:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a2a expref: 297 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.027908:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525740 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a2a expref: 297 pid: 12775 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.027925:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894217088:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431562.028395:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+297:14617:x1876351933455488:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7788us (8260us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431562.028404:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295881
00000100:00100000:3.0:1789431562.029553:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2d449780 going to sleep for 11 seconds
00000100:00100000:1.0:1789431562.033636:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.033694:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.033781:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933456256
00000100:00100000:2.0:1789431562.033795:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933456256
00000100:00100000:2.0:1789431562.033877:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12450
00000100:00100000:2.0:1789431562.033889:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+297:14617:x1876351933456256:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431562.034418:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894217088:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431562.034449:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635257a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.034616:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933456000
00000100:00100000:0.0:1789431562.034623:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933456000
00010000:00010000:0.0:1789431562.034655:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525740 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a2a expref: 299 pid: 12775 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.034688:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16491
00000100:00100000:0.0:1789431562.034697:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+299:2347:x1876351933456000:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431562.034711:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431562.034718:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525740 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a2a expref: 299 pid: 12775 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.034732:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a2a expref: 299 pid: 12775 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.034771:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525740 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a2a expref: 299 pid: 12775 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.034790:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:0.0:1789431562.034797:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635257a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.034809:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635257a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.034819:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635257a9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.034853:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431562.034961:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+298:14617:x1876351933456256:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 1073us (1264us total) trans 4295120923 rc 0/0
00000100:00100000:2.0:1789431562.034970:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12450
00000100:00100000:0.0:1789431562.035421:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+297:2347:x1876351933456000:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 722us (1799us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.035430:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16491
00010000:00010000:0.0:1789431562.036178:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635257a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.036191:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635257a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431562.036218:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bc:0x0]: returning size 260096
00010000:00010000:0.0:1789431562.036422:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635257a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a4d expref: 298 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.036446:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635257a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a4d expref: 297 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.036455:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:0.0:1789431562.036458:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431562.036462:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cac00, rc 0)
00000100:00100000:0.0:1789431562.036511:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+297:14616:x1876351933455744:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8866us (10881us total) trans 4295120924 rc 0/0
00000100:00100000:0.0:1789431562.036517:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295882
00000100:00100000:0.0:1789431562.047107:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.047213:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933456384
00000100:00100000:1.0:1789431562.047226:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933456384
00000100:00100000:1.0:1789431562.047304:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295883
00000100:00100000:1.0:1789431562.047318:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+297:14616:x1876351933456384:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431562.047353:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431562.047381:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635257b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a54 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.047498:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635257be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.047517:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635257a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a4d expref: 298 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.047528:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635257be lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.047722:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635257a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a4d expref: 298 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.047747:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635257a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a4d expref: 298 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.047765:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894217216:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431562.047927:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065ec00 going to sleep for 11 seconds
00000100:00100000:3.0:1789431562.050622:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.050916:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933456512
00000100:00100000:2.0:1789431562.050930:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933456512
00000100:00100000:2.0:1789431562.051004:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295884
00000100:00100000:2.0:1789431562.051016:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+299:14617:x1876351933456512:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.051043:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.051117:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635257c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a5b expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051222:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb635257cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051256:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb635257cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051271:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb635257cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051290:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635257d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051297:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635257d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051303:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635257d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051441:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635257da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051451:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635257da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051459:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635257da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431562.051508:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bf:0x0]: returning size 260096
00000004:00200000:2.0:1789431562.051514:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431562.051537:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635257da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051563:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635257da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051572:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb635257cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051579:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb635257cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051585:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb635257cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051592:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.051596:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb635257cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051604:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb635257cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051617:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431562.051620:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.051626:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb635257cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051641:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb635257cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051656:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635257d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051662:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635257d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051668:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635257d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051673:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.051675:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635257d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051680:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635257d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051687:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xc4fc354d (ffff90cf13195900)
00010000:00010000:2.0:1789431562.051690:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.051692:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635257d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051699:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635257d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051731:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635257c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a5b expref: 301 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051757:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635257da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a5b expref: 300 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.051766:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:2.0:1789431562.051769:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431562.051772:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62de00, rc 0)
00000100:00100000:2.0:1789431562.051855:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+300:14617:x1876351933456512:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 840us (1247us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.051865:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295884
00000100:00100000:1.0:1789431562.052299:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894217216:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431562.052334:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635257be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.054829:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.057116:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933456640
00000100:00100000:0.0:1789431562.057138:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933456640
00010000:00010000:0.0:1789431562.057211:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635257a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a4d expref: 300 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.057274:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16492
00000100:00100000:0.0:1789431562.057286:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+300:2348:x1876351933456640:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431562.057308:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431562.057317:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635257a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a4d expref: 300 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.057333:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635257a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a4d expref: 300 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.057364:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635257a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a4d expref: 300 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.057385:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:0.0:1789431562.057392:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635257be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.057403:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635257be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.057412:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635257be lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.057442:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431562.057526:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+299:2348:x1876351933456640:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 240us (2710us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.057535:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16492
00010000:00010000:1.0:1789431562.058160:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635257be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.058178:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635257be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431562.058249:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bc:0x0]: returning size 260096
00000004:00200000:1.0:1789431562.058255:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431562.058282:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635257be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.058328:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb635257b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100bc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a54 expref: 299 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.058347:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5800/0xd8e438fb635257be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a54 expref: 298 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.058356:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bc:0x0].0x0 (ffff90ce2727a300)
00010000:00010000:1.0:1789431562.058359:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431562.058362:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd5800, rc 0)
00000100:00100000:1.0:1789431562.058421:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+298:14616:x1876351933456384:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11105us (11370us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431562.058430:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295883
00000100:00100000:3.0:1789431562.059434:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.059564:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933456896
00000100:00100000:1.0:1789431562.059576:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933456896
00000100:00100000:0.0:1789431562.059780:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295885
00000100:00100000:0.0:1789431562.059796:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+298:14617:x1876351933456896:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431562.059823:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431562.059850:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635257e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a62 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.059974:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635257e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.059992:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352579b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a46 expref: 299 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.060000:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635257da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a5b expref: 299 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.060009:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635257e8 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.060096:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635257da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a5b expref: 299 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.060113:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635257da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a5b expref: 299 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.060131:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e91500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894217344:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431562.060242:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352579b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a46 expref: 299 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.060258:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352579b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a46 expref: 299 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.060267:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e93100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894217472:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431562.060292:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ac1f300 going to sleep for 11 seconds
00000100:00100000:0.0:1789431562.066988:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e91500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894217344:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431562.067008:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e93100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894217472:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431562.067041:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635257e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.070337:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.070410:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933457024
00000100:00100000:1.0:1789431562.070434:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933457024
00010000:00010000:1.0:1789431562.070494:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635257da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a5b expref: 300 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.070547:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16493
00000100:00100000:1.0:1789431562.070568:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e954850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+300:2347:x1876351933457024:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431562.070586:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431562.070595:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635257da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a5b expref: 300 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.070610:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635257da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a5b expref: 300 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.070645:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635257da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a5b expref: 300 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.070666:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:1.0:1789431562.070672:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635257e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.070683:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635257e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.070690:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431562.070773:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e954850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+299:2347:x1876351933457024:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 208us (450us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431562.070781:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16493
00000100:00100000:3.0:1789431562.072475:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.073869:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.074424:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933457152
00000100:00100000:0.0:1789431562.074438:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933457152
00010000:00010000:0.0:1789431562.074494:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352579b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a46 expref: 299 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.074536:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16494
00000100:00100000:0.0:1789431562.074547:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+299:2347:x1876351933457152:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431562.074566:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431562.074573:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352579b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a46 expref: 299 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.074588:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352579b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a46 expref: 299 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.074615:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352579b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a46 expref: 299 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.074706:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:0.0:1789431562.074713:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635257e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.074725:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635257e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.074743:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635257e8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.074888:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933457280
00010000:00010000:0.0:1789431562.074892:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431562.074894:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933457280
00000100:00100000:2.0:1789431562.074932:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295886
00000100:00100000:2.0:1789431562.074939:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+299:14616:x1876351933457280:12345-192.168.203.4@tcp:101:dbench.0
00000100:00100000:0.0:1789431562.074958:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+299:2347:x1876351933457152:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 414us (2494us total) trans 0 rc 0/0
00010000:00010000:2.0:1789431562.074960:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00000100:00100000:0.0:1789431562.074967:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16494
00010000:00010000:2.0:1789431562.074980:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635257ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a69 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075079:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635257f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075093:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635257f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075102:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635257f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075121:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635257fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075128:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635257fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075133:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635257fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075203:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635257f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075215:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635257f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075222:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635257f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075240:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.075246:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635257f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075254:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635257f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075263:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431562.075266:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.075271:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635257f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075277:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635257f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075288:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635257fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075294:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635257fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075300:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635257fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075305:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.075308:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635257fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075315:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635257fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075322:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x6ed7d01b (ffff90cf13195900)
00010000:00010000:2.0:1789431562.075324:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.075327:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635257fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075333:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb635257fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x6ed7d01b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075367:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635257ef lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a69 expref: 299 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075376:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431562.075379:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.075382:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635257ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a69 expref: 299 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.075393:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62d200, rc 0)
00000100:00100000:2.0:1789431562.075422:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+298:14616:x1876351933457280:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 484us (1563us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431562.075429:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295886
00010000:00010000:3.0:1789431562.081250:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635257e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.081432:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635257e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431562.081474:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bf:0x0]: returning size 260096
00000100:00100000:0.0:1789431562.081969:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431562.082020:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635257e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a62 expref: 299 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.082079:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635257e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a62 expref: 298 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.082090:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:2.0:1789431562.082094:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431562.082099:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b400, rc 0)
00000100:00100000:2.0:1789431562.082183:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+298:14617:x1876351933456896:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 22391us (22757us total) trans 4295120925 rc 0/0
00000100:00100000:1.0:1789431562.082189:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933457408
00000100:00100000:2.0:1789431562.082193:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295885
00000100:00100000:1.0:1789431562.082200:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933457408
00000100:00100000:1.0:1789431562.082299:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295887
00000100:00100000:1.0:1789431562.082311:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+298:14616:x1876351933457408:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431562.082333:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431562.082357:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb6352580b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a70 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.082427:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525812 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.082443:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525812 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.082457:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525812 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.082473:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525819 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x27819378 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.082480:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x27819378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.082487:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x27819378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.082543:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525812 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.082551:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525812 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.082559:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525812 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.082565:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd4e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.082569:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525812 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.082578:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525812 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.082588:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431562.082590:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.082595:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525812 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.082600:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4e00/0xd8e438fb63525812 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.082611:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x27819378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.082618:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525819 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x27819378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.082624:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525819 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x27819378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.082629:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf421ef000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.085522:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525819 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x27819378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.085553:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525819 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x27819378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.085578:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x27819378 (ffff90ce03149b00)
00010000:00010000:1.0:1789431562.085582:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.085589:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525819 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x27819378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.085599:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421ef000/0xd8e438fb63525819 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x27819378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.085887:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb6352580b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a70 expref: 299 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.085900:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431562.085903:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.085907:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5400/0xd8e438fb6352580b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a70 expref: 299 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.085917:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd5400, rc 0)
00000100:00100000:1.0:1789431562.086028:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+298:14616:x1876351933457408:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3717us (4064us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431562.086038:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295887
00000100:00100000:0.0:1789431562.089441:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.089520:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933457536
00000100:00100000:1.0:1789431562.089534:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933457536
00000100:00100000:1.0:1789431562.089616:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295888
00000100:00100000:1.0:1789431562.089637:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+298:14617:x1876351933457536:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431562.089675:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431562.089709:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525820 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a77 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.089840:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525827 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.089857:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635257e8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a62 expref: 299 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.089868:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525827 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.089913:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635257e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a62 expref: 299 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.089929:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635257e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a62 expref: 299 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.089945:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894217600:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431562.090089:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e180 going to sleep for 11 seconds
00000100:00100000:3.0:1789431562.096803:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.096924:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933457664
00000100:00100000:2.0:1789431562.096938:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933457664
00000100:00100000:2.0:1789431562.097019:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295889
00000100:00100000:2.0:1789431562.097033:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+300:14616:x1876351933457664:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.097096:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.097127:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb6352582e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a7e expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097211:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525835 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097239:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525835 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097256:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525835 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097282:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352583c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x316f5120 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097291:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352583c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x316f5120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097298:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352583c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x316f5120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097368:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525835 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097377:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525835 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097384:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525835 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097390:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.097395:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525835 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097405:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525835 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097419:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431562.097422:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.097428:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525835 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097435:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525835 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097451:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352583c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x316f5120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097458:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352583c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x316f5120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097465:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352583c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x316f5120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097470:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.097473:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352583c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x316f5120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097479:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352583c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x316f5120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097486:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x316f5120 (ffff90cf13195900)
00010000:00010000:2.0:1789431562.097489:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.097492:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352583c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x316f5120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097497:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352583c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x316f5120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097534:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb6352582e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a7e expref: 301 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097557:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431562.097560:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.097564:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb6352582e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a7e expref: 301 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.097580:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce249e1200, rc 0)
00000100:00100000:2.0:1789431562.097788:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+300:14616:x1876351933457664:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 758us (998us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431562.097798:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295889
00000100:00100000:3.0:1789431562.101105:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.101208:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933457792
00000100:00100000:0.0:1789431562.101223:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933457792
00010000:00010000:0.0:1789431562.101279:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635257e8 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a62 expref: 300 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.101335:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16495
00000100:00100000:0.0:1789431562.101348:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+300:2348:x1876351933457792:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431562.101368:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431562.101378:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635257e8 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a62 expref: 300 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.101397:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635257e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a62 expref: 300 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.101424:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:0.0:1789431562.101431:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525827 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.101442:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.101451:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525827 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.101474:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431562.101545:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+300:2348:x1876351933457792:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 199us (498us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.101552:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16495
00010000:00010000:1.0:1789431562.101694:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635257e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a62 expref: 299 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.101717:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894217600:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431562.101761:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.101773:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.101779:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431562.101840:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bf:0x0]: returning size 260096
00000004:00200000:1.0:1789431562.101846:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431562.101874:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.101919:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525820 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100bf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a77 expref: 299 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.101935:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525827 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a77 expref: 298 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.101942:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:1.0:1789431562.101945:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431562.101948:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:1.0:1789431562.101984:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+298:14617:x1876351933457536:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12358us (12557us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431562.101992:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295888
00000100:00100000:0.0:1789431562.106970:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.107095:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933457920
00000100:00100000:1.0:1789431562.107110:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933457920
00000100:00100000:1.0:1789431562.107177:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295890
00000100:00100000:1.0:1789431562.107189:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+298:14616:x1876351933457920:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431562.107218:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431562.107246:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525843 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a85 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107333:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352584a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107353:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352584a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107367:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352584a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107386:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525851 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x5b209d6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107394:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x5b209d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107401:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x5b209d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107472:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352584a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107480:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352584a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107486:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352584a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107492:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.107496:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352584a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107505:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352584a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107518:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431562.107521:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.107527:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352584a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107533:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352584a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107549:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x5b209d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107556:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525851 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x5b209d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107562:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x5b209d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107566:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.107570:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x5b209d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107575:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525851 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x5b209d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107583:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x5b209d6e (ffff90ce03149b00)
00010000:00010000:1.0:1789431562.107586:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.107589:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525851 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x5b209d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107595:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525851 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x5b209d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107643:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525843 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a85 expref: 299 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107655:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431562.107657:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.107662:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525843 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a85 expref: 299 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.107672:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308e00, rc 0)
00000100:00100000:1.0:1789431562.107764:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+298:14616:x1876351933457920:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 578us (809us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431562.107773:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295890
00000100:00100000:3.0:1789431562.112932:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.113107:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933458048
00000100:00100000:2.0:1789431562.113121:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933458048
00000100:00100000:2.0:1789431562.113200:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295891
00000100:00100000:2.0:1789431562.113213:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+298:14616:x1876351933458048:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.113241:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.113270:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525858 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a8c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113356:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352585f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113375:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352585f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113388:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352585f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113405:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525866 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xbcba1d9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113412:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xbcba1d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113420:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xbcba1d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113489:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352585f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113497:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352585f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113504:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352585f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113511:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.113516:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352585f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113525:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352585f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113540:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431562.113543:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.113549:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352585f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113556:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352585f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113570:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xbcba1d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113577:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525866 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xbcba1d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113582:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xbcba1d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113588:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.113591:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xbcba1d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113596:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525866 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xbcba1d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113603:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xbcba1d9d (ffff90cf13195900)
00010000:00010000:2.0:1789431562.113605:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.113608:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525866 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xbcba1d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113614:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525866 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xbcba1d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113658:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525858 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a8c expref: 299 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113669:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431562.113671:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.113675:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525858 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a8c expref: 299 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.113685:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce249e1200, rc 0)
00000100:00100000:2.0:1789431562.113783:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+298:14616:x1876351933458048:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 571us (867us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431562.113791:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295891
00000100:00100000:3.0:1789431562.119154:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.119228:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933458304
00000100:00100000:1.0:1789431562.119242:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933458304
00000100:00100000:1.0:1789431562.119324:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12451
00000100:00100000:1.0:1789431562.119337:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+298:14617:x1876351933458304:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431562.119678:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+299:14617:x1876351933458304:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 342us (537us total) trans 4295120926 rc 0/0
00000100:00100000:1.0:1789431562.119687:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12451
00000100:00100000:3.0:1789431562.124430:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.124483:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.124565:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933458432
00000100:00100000:1.0:1789431562.124579:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933458432
00000100:00100000:1.0:1789431562.124659:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933458560
00000100:00100000:1.0:1789431562.124663:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933458560
00000100:00100000:1.0:1789431562.124698:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295892
00000100:00100000:1.0:1789431562.124710:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+300:14616:x1876351933458432:12345-192.168.203.4@tcp:101:dbench.0
00000100:00100000:2.0:1789431562.124778:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295893
00000100:00100000:2.0:1789431562.124789:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+300:14617:x1876351933458560:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.124800:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.124828:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb6352586d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a9a expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.124912:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525874 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.124927:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.124930:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525874 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.124939:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352587b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8a93 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.124944:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525874 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.124960:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525882 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.124968:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.124971:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525889 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.124974:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.124980:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525889 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.124987:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525889 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.124998:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525890 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x87f1f2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125003:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x87f1f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125009:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x87f1f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125042:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525889 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125084:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525889 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125091:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525889 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125097:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.125102:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525889 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125110:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525889 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.125117:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525897 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125123:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431562.125125:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125126:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.125131:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125132:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525889 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125140:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525889 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125153:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x87f1f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125158:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525890 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x87f1f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125164:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525890 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x87f1f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125168:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.125171:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525890 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x87f1f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431562.125174:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bf:0x0]: returning size 260096
00010000:00010000:1.0:1789431562.125177:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525890 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x87f1f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431562.125179:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00010000:00010000:1.0:1789431562.125183:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x87f1f2c1 (ffff90ce03149b00)
00010000:00010000:1.0:1789431562.125185:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.125187:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525890 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x87f1f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125192:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525890 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x87f1f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431562.125201:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.125214:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.125220:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525874 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125223:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352587b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a93 expref: 302 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.125239:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525874 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125240:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431562.125242:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.125247:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb6352587b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a93 expref: 302 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.125247:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525874 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.125253:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.125256:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525874 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.125257:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308e00, rc 0)
00010000:00010000:2.0:1789431562.125262:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525874 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.125340:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+301:14616:x1876351933458432:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 632us (924us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431562.125348:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295892
00010000:00010000:2.0:1789431562.125379:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:2.0:1789431562.125381:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.125385:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525874 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.125391:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525874 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.125407:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.125412:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525882 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.125417:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525882 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.125422:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.125425:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525882 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.125430:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525882 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.125437:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xc4fc354d (ffff90cf13195900)
00010000:00010000:2.0:1789431562.125439:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.125442:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525882 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.125446:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525882 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.125470:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb6352586d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a9a expref: 301 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.125482:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525897 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a9a expref: 300 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.125494:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:2.0:1789431562.125496:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431562.125498:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62de00, rc 0)
00000100:00100000:2.0:1789431562.125522:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+300:14617:x1876351933458560:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 736us (1038us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.125528:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295893
00000100:00100000:3.0:1789431562.134134:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.134184:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.134197:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933458688
00000100:00100000:2.0:1789431562.134210:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933458688
00000100:00100000:0.0:1789431562.134277:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933458816
00000100:00100000:0.0:1789431562.134294:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933458816
00000100:00100000:2.0:1789431562.134316:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14337
00000100:00100000:2.0:1789431562.134333:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+301:2350:x1876351933458688:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431562.134356:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:0.0:1789431562.134386:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295894
00010000:00010000:2.0:1789431562.134394:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525897 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a9a expref: 301 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.134418:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+300:14616:x1876351933458816:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.134422:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:2.0:1789431562.134432:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431562.134443:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431562.134478:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352589e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8aa1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.134507:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+301:2350:x1876351933458688:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 177us (386us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.134518:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14337
00010000:00010000:0.0:1789431562.134555:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134578:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134591:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134608:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x5d3530c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134616:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x5d3530c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134623:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x5d3530c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134683:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134690:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134697:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134705:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.134710:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134718:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134747:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431562.134751:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.134756:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134763:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134777:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x5d3530c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134794:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x5d3530c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134801:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x5d3530c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134806:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.134809:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x5d3530c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134816:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x5d3530c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134824:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x5d3530c1 (ffff90ce07190400)
00010000:00010000:0.0:1789431562.134827:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.134830:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x5d3530c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134836:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x5d3530c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134871:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352589e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aa1 expref: 300 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134882:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431562.134884:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.134888:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352589e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aa1 expref: 300 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.134898:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a000, rc 0)
00000100:00100000:0.0:1789431562.134976:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+299:14616:x1876351933458816:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 576us (790us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431562.134984:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295894
00000100:00100000:3.0:1789431562.140205:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.140354:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933459072
00000100:00100000:0.0:1789431562.140368:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933459072
00000100:00100000:2.0:1789431562.142995:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295895
00000100:00100000:2.0:1789431562.143027:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+299:14617:x1876351933459072:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.143089:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.143120:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635258b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8aa8 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.143273:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635258ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.143291:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525827 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a77 expref: 300 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.143305:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635258ba lrc: 4/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.143357:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525827 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a77 expref: 300 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.143377:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525827 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a77 expref: 300 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.143392:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894217728:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431562.143538:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1f00 going to sleep for 11 seconds
00000100:00100000:3.0:1789431562.147134:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.147360:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933459200
00000100:00100000:0.0:1789431562.147387:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933459200
00000100:00100000:0.0:1789431562.147462:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295896
00000100:00100000:0.0:1789431562.147477:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+301:14616:x1876351933459200:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431562.147498:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431562.147520:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635258c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8aaf expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147588:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147604:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147620:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147637:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x2ff11805 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147644:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x2ff11805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147651:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x2ff11805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147705:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147713:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147719:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147726:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.147732:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147751:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147763:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431562.147766:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.147771:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147777:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635258c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147790:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x2ff11805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147798:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x2ff11805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147804:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x2ff11805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147814:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ac00 already unused, calling callback (ffffffffc211f4f0)
00000100:00100000:2.0:1789431562.147815:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894217728:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431562.147821:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x2ff11805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147832:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0x2ff11805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147841:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x2ff11805 (ffff90ce07190400)
00010000:00010000:0.0:1789431562.147844:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.147847:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x2ff11805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.147853:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635258ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147854:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb635258cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x2ff11805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147939:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635258c1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aaf expref: 302 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147953:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431562.147956:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.147959:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635258c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aaf expref: 302 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.147969:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a000, rc 0)
00000100:00100000:0.0:1789431562.148039:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+301:14616:x1876351933459200:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 566us (921us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431562.148091:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295896
00000100:00100000:3.0:1789431562.149092:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.149193:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933459328
00000100:00100000:2.0:1789431562.149203:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933459328
00010000:00010000:2.0:1789431562.149254:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525827 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a77 expref: 301 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.149312:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16496
00000100:00100000:2.0:1789431562.149323:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+301:2347:x1876351933459328:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431562.149339:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431562.149347:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525827 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a77 expref: 301 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.149361:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525827 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a77 expref: 301 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.149384:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525827 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8a77 expref: 301 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.149403:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:2.0:1789431562.149409:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635258ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.149419:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635258ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.149427:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635258ba lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.149529:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431562.149591:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+300:2347:x1876351933459328:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 270us (508us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.149600:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16496
00010000:00010000:1.0:1789431562.151417:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635258ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.151443:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635258ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431562.151476:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bf:0x0]: returning size 260096
00010000:00010000:1.0:1789431562.151705:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635258b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aa8 expref: 301 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.151731:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635258ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aa8 expref: 300 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.151811:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:1.0:1789431562.151815:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431562.151819:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62c200, rc 0)
00000100:00100000:1.0:1789431562.151970:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+300:14617:x1876351933459072:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8959us (11778us total) trans 4295120927 rc 0/0
00000100:00100000:1.0:1789431562.151981:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295895
00000100:00100000:0.0:1789431562.153212:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.153439:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933459456
00000100:00100000:3.0:1789431562.153455:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933459456
00000100:00100000:3.0:1789431562.153531:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295897
00000100:00100000:3.0:1789431562.153544:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+300:14616:x1876351933459456:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431562.153571:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431562.153595:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635258dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ab6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.153679:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635258e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.153698:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635258e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.153711:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635258e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.153730:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635258eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.153748:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635258eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.153762:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635258eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.153903:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635258f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.153912:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635258f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.153919:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635258f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431562.153961:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100be:0x0]: returning size 260096
00000004:00200000:3.0:1789431562.153967:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431562.153988:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635258f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.154000:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635258f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.154010:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635258e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.154015:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635258e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.154026:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635258e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.154033:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.154038:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635258e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.155235:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635258e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.155369:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431562.155374:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.155382:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635258e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.155390:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb635258e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.155414:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635258eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.155421:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635258eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.155429:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635258eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.155436:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.155440:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635258eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.155453:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635258eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.155462:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xc4fc354d (ffff90cf18b78500)
00010000:00010000:3.0:1789431562.155464:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.155467:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635258eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.155474:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635258eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.155530:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635258dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ab6 expref: 302 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.155545:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635258f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ab6 expref: 301 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.155553:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:3.0:1789431562.155556:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431562.155559:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb600, rc 0)
00000100:00100000:3.0:1789431562.155709:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+301:14616:x1876351933459456:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2166us (2505us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431562.155719:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295897
00000100:00100000:3.0:1789431562.158299:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.158401:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933459584
00000100:00100000:0.0:1789431562.158414:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933459584
00000100:00100000:0.0:1789431562.158488:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295898
00000100:00100000:0.0:1789431562.158500:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+301:14617:x1876351933459584:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431562.158536:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431562.158565:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635258f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8abd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.158680:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb63525900 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.158698:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635258ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aa8 expref: 302 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.158709:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb63525900 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.158776:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635258ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aa8 expref: 302 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.158792:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635258ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aa8 expref: 302 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.158809:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894217856:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431562.158923:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ac1f300 going to sleep for 11 seconds
00000100:00100000:0.0:1789431562.162716:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894217856:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431562.162788:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb63525900 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.166239:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.166344:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.168045:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933459712
00000100:00100000:1.0:1789431562.168079:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933459712
00010000:00010000:1.0:1789431562.168155:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635258ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aa8 expref: 303 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.168201:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933459840
00000100:00100000:1.0:1789431562.168205:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933459840
00000100:00100000:1.0:1789431562.168244:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16497
00000100:00100000:1.0:1789431562.168256:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+304:2348:x1876351933459712:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431562.168275:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:3.0:1789431562.168359:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14338
00000100:00100000:3.0:1789431562.168395:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+304:2348:x1876351933459840:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431562.168418:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431562.168448:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635258f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ab6 expref: 304 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.168469:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:3.0:1789431562.168474:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431562.168547:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+303:2348:x1876351933459840:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 175us (2203us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431562.168556:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14338
00010000:00010000:1.0:1789431562.168611:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635258ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aa8 expref: 302 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.168630:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635258ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aa8 expref: 302 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.168655:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635258ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aa8 expref: 302 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.168673:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:1.0:1789431562.168680:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb63525900 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.168691:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb63525900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.168700:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb63525900 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.168801:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431562.168855:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+301:2348:x1876351933459712:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 601us (2626us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431562.168864:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16497
00000100:00100000:3.0:1789431562.169535:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431562.170548:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb63525900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.170567:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb63525900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431562.170633:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100bf:0x0]: returning size 260096
00000004:00200000:2.0:1789431562.170638:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431562.170668:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb63525900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.170719:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635258f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100bf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8abd expref: 301 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.170811:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ac00/0xd8e438fb63525900 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8abd expref: 300 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.170821:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100bf:0x0].0x0 (ffff90ce2727a700)
00010000:00010000:2.0:1789431562.170825:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431562.170829:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7ac00, rc 0)
00000100:00100000:1.0:1789431562.170924:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933460096
00000100:00100000:1.0:1789431562.170939:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933460096
00000100:00100000:1.0:1789431562.171020:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295899
00000100:00100000:1.0:1789431562.171034:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+301:14616:x1876351933460096:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431562.171198:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431562.171224:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525907 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ac4 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.171330:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352590e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.171357:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+302:14617:x1876351933459584:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12491us (12715us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.171369:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295898
00010000:00010000:1.0:1789431562.172182:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635105e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2281 expref: 301 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.172197:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352590e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.172239:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635105e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2281 expref: 301 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.172255:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635105e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2281 expref: 301 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.172333:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac77480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894217984:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431562.172990:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf02e88c00 going to sleep for 11 seconds
00000100:00100000:0.0:1789431562.177133:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.179348:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933460224
00000100:00100000:3.0:1789431562.179370:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933460224
00000100:00100000:3.0:1789431562.179455:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295900
00000100:00100000:3.0:1789431562.179469:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+302:14617:x1876351933460224:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431562.179497:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431562.179528:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525915 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8acb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.179616:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352591c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.179635:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352591c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.179649:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352591c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.179666:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525923 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1007e:0x0].0xa12f67b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.179674:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.179681:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.179768:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac77480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894217984:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431562.179797:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352590e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.180125:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352591c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.180136:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352591c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.180143:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352591c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.180150:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.180155:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352591c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.180164:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352591c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.180179:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007e:0x0].0x0 (ffff90ce2725d400)
00010000:00010000:3.0:1789431562.180182:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.180189:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352591c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.180196:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352591c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.180210:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.180217:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525923 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.180222:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.180226:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.180229:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.180235:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525923 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.180242:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007e:0x0].0xa12f67b5 (ffff90cf18b78500)
00010000:00010000:3.0:1789431562.180244:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.180247:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525923 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1007e:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.180253:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525923 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1007e:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.180294:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525915 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8acb expref: 303 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.180305:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007e:0x0].0x0 (ffff90ce2725d400)
00010000:00010000:3.0:1789431562.180308:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.180311:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525915 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8acb expref: 303 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.180327:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035ca200, rc 0)
00000100:00100000:3.0:1789431562.180410:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+302:14617:x1876351933460224:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 945us (3285us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431562.180419:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295900
00000100:00100000:0.0:1789431562.182514:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.182601:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933460352
00000100:00100000:2.0:1789431562.182613:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933460352
00010000:00010000:2.0:1789431562.182665:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635105e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2281 expref: 302 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.182713:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16498
00000100:00100000:2.0:1789431562.182723:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e954450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+302:2348:x1876351933460352:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431562.182754:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431562.182762:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635105e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2281 expref: 302 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.182777:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635105e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2281 expref: 302 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.182802:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635105e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2281 expref: 302 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.182819:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:2.0:1789431562.182825:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352590e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.182836:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352590e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.182844:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352590e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.182880:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431562.182949:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e954450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+301:2348:x1876351933460352:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 226us (447us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.182957:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16498
00010000:00010000:1.0:1789431562.182962:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352590e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.182980:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352590e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431562.183007:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100be:0x0]: returning size 260096
00010000:00010000:1.0:1789431562.183243:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525907 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ac4 expref: 302 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.183267:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352590e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ac4 expref: 301 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.183276:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:1.0:1789431562.183279:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431562.183283:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309200, rc 0)
00000100:00100000:1.0:1789431562.183361:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+301:14616:x1876351933460096:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12320us (13817us total) trans 4295120928 rc 0/0
00000100:00100000:1.0:1789431562.183369:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295899
00000100:00100000:0.0:1789431562.190895:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.190942:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.191024:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933460480
00000100:00100000:1.0:1789431562.191040:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933460480
00000100:00100000:1.0:1789431562.191145:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933460608
00000100:00100000:1.0:1789431562.191149:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933460608
00000100:00100000:1.0:1789431562.191181:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295901
00000100:00100000:1.0:1789431562.191192:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+302:14616:x1876351933460480:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431562.191219:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431562.191242:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525931 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ad2 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.191252:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295902
00000100:00100000:2.0:1789431562.191294:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+303:14617:x1876351933460608:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.191316:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431562.191334:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525938 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.191340:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352593f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ad9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.191353:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352590e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ac4 expref: 303 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.191364:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525938 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.191412:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352590e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ac4 expref: 304 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.191416:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525946 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1007e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.191459:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.191461:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352590e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ac4 expref: 304 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.191491:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.191497:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac77480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894218112:192.168.203.4@tcp:104:
00000004:00200000:2.0:1789431562.191551:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1007e:0x0]: returning size 16384
00000004:00200000:2.0:1789431562.191557:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431562.191580:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.191610:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352593f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ad9 expref: 305 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.191630:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525946 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ad9 expref: 304 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.191640:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007e:0x0].0x0 (ffff90ce2725d400)
00010000:00010000:2.0:1789431562.191643:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:2.0:1789431562.191648:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62d200, rc 0)
00000100:00100000:1.0:1789431562.192338:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05eadd80 going to sleep for 11 seconds
00000100:00100000:2.0:1789431562.192439:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+304:14617:x1876351933460608:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1168us (1490us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.192448:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295902
00000100:00100000:2.0:1789431562.204714:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.204801:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933460736
00000100:00100000:1.0:1789431562.204817:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933460736
00000100:00100000:1.0:1789431562.204907:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12452
00000100:00100000:1.0:1789431562.204923:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+304:14617:x1876351933460736:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431562.204982:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac77480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894218112:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431562.205023:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525938 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.206951:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.207970:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933460864
00000100:00100000:1.0:1789431562.207981:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933460864
00010000:00010000:1.0:1789431562.208026:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352590e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ac4 expref: 306 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.208110:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16499
00000100:00100000:1.0:1789431562.208125:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33175880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:2348:x1876351933460864:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431562.208139:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431562.208147:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352590e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ac4 expref: 306 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.208161:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352590e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ac4 expref: 306 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.208183:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352590e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ac4 expref: 306 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.208198:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:1.0:1789431562.208203:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525938 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.208212:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.208219:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525938 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.208245:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431562.208300:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33175880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+305:2348:x1876351933460864:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 180us (1357us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431562.208307:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16499
00010000:00010000:0.0:1789431562.208382:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.208391:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431562.208439:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100be:0x0]: returning size 260096
00000004:00200000:0.0:1789431562.208444:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431562.208466:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.208502:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525931 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100be:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ad2 expref: 305 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.208518:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525938 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ad2 expref: 304 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.208525:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:0.0:1789431562.208528:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431562.208531:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308e00, rc 0)
00000100:00100000:0.0:1789431562.208639:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+304:14616:x1876351933460480:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 17449us (17759us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.208647:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295901
00000100:00100000:2.0:1789431562.221214:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+302:14617:x1876351933460736:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 16281us (16501us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.221228:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12452
00000100:00100000:3.0:1789431562.223193:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.223309:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933461120
00000100:00100000:1.0:1789431562.223324:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933461120
00000100:00100000:1.0:1789431562.223398:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12453
00000100:00100000:1.0:1789431562.223411:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+302:14616:x1876351933461120:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431562.223728:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+303:14616:x1876351933461120:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 320us (549us total) trans 4295120929 rc 0/0
00000100:00100000:1.0:1789431562.223745:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12453
00000004:00080000:2.0:1789431562.225178:0:8065:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3020256126525ns, next at 3021256123277ns, rc = 0
00000100:00100000:1.0:1789431562.228545:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894218240:0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1789431562.228630:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431562.231279:0:12256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894218240
00000100:00100000:1.0:1789431562.231293:0:12256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894218240
00000100:00100000:1.0:1789431562.231378:0:12256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133
00000100:00100000:1.0:1789431562.231392:0:12256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876351894218240:12345-0@lo:13:osp-pre-1-0.0
00000100:00080000:3.0:1789431562.231398:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00002000:00000024:1.0:1789431562.231417:0:12256:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 51118080 granted 523960320 pending 0 free 3807379456 avail 3802136576
00000100:00100000:3.0:1789431562.232328:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.232392:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933461248
00000100:00100000:3.0:1789431562.232402:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933461248
00000100:00100000:3.0:1789431562.232468:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295903
00000100:00100000:3.0:1789431562.232480:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+303:14616:x1876351933461248:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431562.232506:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431562.232538:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352594d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ae0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.232630:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525954 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.232649:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525954 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.232663:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525954 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.232680:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352595b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.232687:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352595b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.232695:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352595b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233440:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525962 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233452:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525962 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233462:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525962 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431562.233507:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100be:0x0]: returning size 260096
00000004:00200000:3.0:1789431562.233512:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431562.233537:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525962 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233551:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525962 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233560:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525954 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233567:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525954 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233574:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525954 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233581:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.233586:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525954 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233595:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525954 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233607:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431562.233610:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.233616:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525954 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233622:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525954 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233637:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352595b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233643:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352595b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233648:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352595b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233653:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.233656:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352595b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233662:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352595b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233669:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xc4fc354d (ffff90cf18b78500)
00010000:00010000:3.0:1789431562.233672:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.233675:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352595b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233682:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352595b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.233727:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352594d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ae0 expref: 305 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.235259:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525962 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ae0 expref: 304 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.236123:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:3.0:1789431562.236126:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431562.236182:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb600, rc 0)
00000100:00100000:1.0:1789431562.238193:0:12256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876351894218240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6797us (9554us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431562.238209:0:12256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133
00000100:00100000:1.0:1789431562.238283:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294970002 gen 2
00000004:00080000:1.0:1789431562.238300:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2e828a80, transno 4294969970
00000004:00080000:1.0:1789431562.238315:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2e82bb80, transno 4294969971
00000004:00080000:1.0:1789431562.238318:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2e829880, transno 4294969972
00000004:00080000:1.0:1789431562.238322:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2e82b480, transno 4294969973
00000004:00080000:1.0:1789431562.238324:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2e829c00, transno 4294969974
00000004:00080000:1.0:1789431562.238328:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1c3e5f80, transno 4294969975
00000004:00080000:1.0:1789431562.238331:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2e828700, transno 4294969976
00000004:00080000:1.0:1789431562.238334:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2e82aa00, transno 4294969977
00000004:00080000:1.0:1789431562.238336:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2e82ad80, transno 4294969978
00000004:00080000:1.0:1789431562.238338:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce3a045880, transno 4294969979
00000004:00080000:1.0:1789431562.238341:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1c3e6300, transno 4294969980
00000004:00080000:1.0:1789431562.238344:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2d509f80, transno 4294969981
00000004:00080000:1.0:1789431562.238347:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1c3e7100, transno 4294969982
00000004:00080000:1.0:1789431562.238349:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3b3b0e00, transno 4294969983
00000004:00080000:1.0:1789431562.238352:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3b3b1880, transno 4294969984
00000004:00080000:1.0:1789431562.238354:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3b3b1180, transno 4294969985
00000004:00080000:1.0:1789431562.238357:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3b3b0700, transno 4294969986
00000004:00080000:1.0:1789431562.238359:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3b3b2a00, transno 4294969987
00000004:00080000:1.0:1789431562.238362:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2d508e00, transno 4294969988
00000004:00080000:1.0:1789431562.238364:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3b3b3800, transno 4294969989
00000004:00080000:1.0:1789431562.238367:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3b3b0000, transno 4294969990
00000004:00080000:1.0:1789431562.238370:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2d50a300, transno 4294969991
00000004:00080000:1.0:1789431562.238372:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3bbf7b80, transno 4294969992
00000004:00080000:1.0:1789431562.238382:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce387b3b80, transno 4294969994
00000004:00080000:1.0:1789431562.238385:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce387b0380, transno 4294969995
00000004:00080000:1.0:1789431562.238387:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3bbf5f80, transno 4294969996
00000004:00080000:1.0:1789431562.238389:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3bbf7800, transno 4294969997
00000004:00080000:1.0:1789431562.238392:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce3a046680, transno 4294969998
00000004:00080000:1.0:1789431562.238395:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3bbf5c00, transno 4294969999
00000004:00080000:1.0:1789431562.238397:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3bbf4e00, transno 4294970000
00000004:00080000:1.0:1789431562.238399:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce387b0a80, transno 4294970001
00000004:00080000:1.0:1789431562.238402:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf37e97480, transno 4294970002
00000100:00100000:1.0:1789431562.238417:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894218240:0@lo:13:osp-pre-1-0.0
00000004:00080000:1.0:1789431562.240908:0:8062:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 4 changes, 0 in progress, 0 in flight, 32 done
00000100:00100000:3.0:1789431562.241635:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+304:14616:x1876351933461248:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9142us (9300us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431562.241653:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295903
00000100:00100000:0.0:1789431562.266043:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.266110:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.266131:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.266598:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933461760
00000100:00100000:1.0:1789431562.266608:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933461760
00000100:00100000:1.0:1789431562.266667:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14339
00000100:00100000:1.0:1789431562.266678:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33175500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+304:2347:x1876351933461760:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431562.266705:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431562.266728:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525962 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ae0 expref: 304 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.266755:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:1.0:1789431562.266759:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431562.266808:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33175500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+303:2347:x1876351933461760:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 132us (675us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431562.266814:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14339
00000100:00100000:2.0:1789431562.267939:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933461376
00000100:00100000:2.0:1789431562.267948:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933461376
00000100:00100000:2.0:1789431562.267999:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933461632
00000100:00100000:2.0:1789431562.268003:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933461632
00000100:00100000:2.0:1789431562.268108:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295904
00000100:00100000:2.0:1789431562.268118:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+304:14617:x1876351933461376:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.268139:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.268715:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525969 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ae7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.268794:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525970 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.268808:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525970 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.268821:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525970 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.268890:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295905
00010000:00010000:2.0:1789431562.268918:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525977 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.268928:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.268935:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.268991:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+305:14616:x1876351933461632:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431562.269004:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431562.269017:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352597e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8aee expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.269115:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525985 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.269128:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525938 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ad2 expref: 306 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.269143:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525985 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.269177:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525938 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ad2 expref: 306 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.269191:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525938 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ad2 expref: 306 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.269205:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d509f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894218368:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431562.269231:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352598c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x109c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269246:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352598c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109c9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269254:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352598c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109c9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431562.269277:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x109c9:0x0]: returning size 19054
00000004:00200000:2.0:1789431562.269281:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431562.269298:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352598c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109c9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269307:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352598c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109c9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269442:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525970 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269449:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525970 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269456:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525970 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269462:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.269466:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525970 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269474:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525970 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269485:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007e:0x0].0x0 (ffff90ce2725d400)
00010000:00010000:2.0:1789431562.269489:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.269493:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525970 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269500:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525970 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269511:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269518:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525977 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269523:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525977 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269529:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.269532:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525977 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269537:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525977 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269543:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007e:0x0].0x17610ee3 (ffff90cf13195700)
00010000:00010000:2.0:1789431562.269546:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.269549:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525977 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269554:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525977 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269583:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525969 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ae7 expref: 307 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269596:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352598c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x109c9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ae7 expref: 306 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.269604:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109c9:0x0].0x0 (ffff90ce032a1c00)
00010000:00010000:2.0:1789431562.269606:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431562.269608:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce249e1a00, rc 0)
00000100:00100000:2.0:1789431562.269640:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933461376:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1526us (3607us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.269647:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295904
00000100:00100000:3.0:1789431562.269819:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2d449000 going to sleep for 11 seconds
00000100:00100000:3.0:1789431562.289863:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.289906:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.290894:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d509f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894218368:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431562.290923:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525985 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.291109:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933462016
00000100:00100000:1.0:1789431562.291117:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933462016
00010000:00010000:1.0:1789431562.291154:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525938 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ad2 expref: 306 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.291198:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16500
00000100:00100000:1.0:1789431562.291208:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:2348:x1876351933462016:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431562.291224:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431562.291233:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525938 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ad2 expref: 306 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.291244:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525938 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ad2 expref: 306 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.291281:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525938 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ad2 expref: 306 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.291297:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:1.0:1789431562.291303:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525985 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.291313:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525985 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.291321:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525985 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.291343:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431562.291395:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+305:2348:x1876351933462016:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 188us (1542us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431562.291402:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16500
00010000:00010000:1.0:1789431562.291430:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525985 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.291438:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525985 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431562.291457:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100be:0x0]: returning size 260096
00000100:00100000:2.0:1789431562.291799:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933462144
00000100:00100000:2.0:1789431562.291806:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933462144
00000100:00100000:2.0:1789431562.291841:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12454
00000100:00100000:2.0:1789431562.291850:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933462144:12345-192.168.203.4@tcp:35:dbench.0
00010000:00010000:1.0:1789431562.292091:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352597e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aee expref: 308 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.292109:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525985 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aee expref: 307 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.292117:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:1.0:1789431562.292120:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431562.292123:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cac00, rc 0)
00000100:00100000:1.0:1789431562.292158:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933461632:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 23259us (26046us total) trans 4295120930 rc 0/0
00000100:00100000:1.0:1789431562.292165:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295905
00000100:00100000:2.0:1789431562.292909:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933462144:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 1056us (2998us total) trans 4295120931 rc 0/0
00000100:00100000:2.0:1789431562.292918:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12454
00000100:00100000:3.0:1789431562.301869:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.301914:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.302077:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933462400
00000100:00100000:1.0:1789431562.302087:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933462400
00000100:00100000:1.0:1789431562.302135:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12455
00000100:00100000:1.0:1789431562.302146:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933462400:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431562.302366:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933462400:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 222us (507us total) trans 4295120932 rc 0/0
00000100:00100000:1.0:1789431562.302374:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12455
00000100:00100000:2.0:1789431562.302618:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933462528
00000100:00100000:2.0:1789431562.302623:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933462528
00000100:00100000:2.0:1789431562.302659:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295906
00000100:00100000:2.0:1789431562.302667:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933462528:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.302677:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.302707:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb6352599a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8af5 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.302781:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635259a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.302796:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525985 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aee expref: 308 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.302805:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635259a1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.302837:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525985 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aee expref: 308 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.302850:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525985 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aee expref: 308 pid: 12775 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.302862:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e828a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894218496:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431562.302924:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1840 going to sleep for 11 seconds
00000100:00100000:2.0:1789431562.314941:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e828a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894218496:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431562.314983:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635259a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.315792:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.315996:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933462656
00000100:00100000:3.0:1789431562.316005:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933462656
00010000:00010000:3.0:1789431562.316044:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525985 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aee expref: 309 pid: 12775 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.316096:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16501
00000100:00100000:3.0:1789431562.316105:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:2347:x1876351933462656:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431562.316120:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431562.316127:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525985 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aee expref: 309 pid: 12775 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.316143:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525985 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aee expref: 309 pid: 12775 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.316167:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525985 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8aee expref: 309 pid: 12775 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.316179:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:3.0:1789431562.316183:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635259a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.316190:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635259a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.316195:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635259a1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.316218:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431562.316236:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635259a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.316245:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635259a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.316275:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:2347:x1876351933462656:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 171us (485us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431562.316282:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16501
00000004:00200000:2.0:1789431562.316286:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100be:0x0]: returning size 260096
00000004:00200000:2.0:1789431562.316290:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431562.316311:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635259a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.316343:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb6352599a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100be:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8af5 expref: 308 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.316358:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635259a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8af5 expref: 307 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.316365:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:2.0:1789431562.316367:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431562.316369:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce249e1000, rc 0)
00000100:00100000:2.0:1789431562.316869:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933462528:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 13740us (14492us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.316877:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295906
00000100:00100000:1.0:1789431562.321361:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.321540:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933462912
00000100:00100000:2.0:1789431562.321550:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933462912
00000100:00100000:2.0:1789431562.321611:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295907
00000100:00100000:2.0:1789431562.321621:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933462912:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431562.321676:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0
00010000:00010000:2.0:1789431562.324552:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb6352598c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ae7 expref: 307 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.324582:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f200/0xd8e438fb63514169 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x109c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3352 expref: 306 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.324594:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109c9:0x0].0x0 (ffff90ce032a1c00)
00010000:00010000:2.0:1789431562.324610:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525946 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1007e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ad9 expref: 305 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.324619:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007e:0x0].0x0 (ffff90ce2725d400)
00010000:00010000:2.0:1789431562.324623:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431562.324647:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635259a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.324660:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635259a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.324670:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635259a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.324699:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635259af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.324706:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635259af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.324712:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635259af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.324938:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb635259b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x109c9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.324946:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb635259b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.324953:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb635259b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431562.325583:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1218, 64 off86208
00010000:00010000:2.0:1789431562.325647:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb635259bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x109c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325657:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb635259bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325666:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb635259bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325674:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb635259bd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325680:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb635259bd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325685:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb635259bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325698:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431562.325717:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb635259b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109c9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325723:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb635259b6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x109c9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325729:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb635259b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109c9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325749:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bad0400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.325754:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb635259b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109c9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325761:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb635259b6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x109c9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325770:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109c9:0x0].0x0 (ffff90cf13195400)
00010000:00010000:2.0:1789431562.325773:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431562.325777:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb635259b6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x109c9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325783:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb635259b6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x109c9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325800:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635259a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325806:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635259a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325812:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635259a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325817:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.325820:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635259a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325826:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635259a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325833:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007e:0x0].0x0 (ffff90ce2725d400)
00010000:00010000:2.0:1789431562.325835:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.325838:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635259a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.325843:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635259a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431562.325856:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001b62cad7 reply state 00000000db1788bb transno 4295120933 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635259af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.325865:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431562.325952:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933462912:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 4331us (4599us total) trans 4295120933 rc 0/0
00000100:00100000:2.0:1789431562.325962:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295907
00010000:00010000:0.0:1789431562.326346:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431562.326354:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb635259bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109c9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.326361:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431562.326364:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb635259bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109c9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.326374:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb635259bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109c9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.326383:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109c9:0x0].0x0 (ffff90cf13195400)
00010000:00010000:0.0:1789431562.326385:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431562.326388:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb635259bd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x109c9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.326393:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb635259bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x109c9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.326408:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.326410:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.326411:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431562.332244:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431562.332822:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635259af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.332835:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635259af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.332843:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635259af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.332853:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.332857:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635259af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.332865:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635259af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.332890:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007e:0x0].0x17610ee3 (ffff90cf13195700)
00010000:00010000:3.0:1789431562.332894:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.332899:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635259af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.332906:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635259af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1007e:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.332989:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.333208:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933463168
00000100:00100000:2.0:1789431562.333218:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933463168
00000100:00100000:2.0:1789431562.333263:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12456
00000100:00100000:2.0:1789431562.333272:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+305:14616:x1876351933463168:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431562.333498:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14616:x1876351933463168:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 226us (508us total) trans 4295120934 rc 0/0
00000100:00100000:2.0:1789431562.333506:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12456
00000100:00100000:0.0:1789431562.333896:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933463296
00000100:00100000:0.0:1789431562.333902:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933463296
00000100:00100000:0.0:1789431562.333941:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295908
00000100:00100000:0.0:1789431562.333949:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933463296:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431562.333960:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431562.333979:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635259c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8afc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334032:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635259cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334045:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635259cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334084:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635259cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334100:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635259d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334107:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635259d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334114:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635259d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334202:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635259d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x109d1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334211:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635259d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109d1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334218:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635259d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109d1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431562.334246:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x109d1:0x0]: returning size 14984
00000004:00200000:0.0:1789431562.334250:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431562.334265:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635259d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109d1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334276:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635259d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109d1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334283:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635259cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334290:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635259cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334302:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635259cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334308:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.334311:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635259cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334319:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635259cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334329:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007e:0x0].0x0 (ffff90ce2725d400)
00010000:00010000:0.0:1789431562.334332:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.334336:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635259cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334342:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb635259cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334353:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635259d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334359:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635259d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334365:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635259d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334369:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.334372:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635259d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334382:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635259d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334389:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007e:0x0].0x220bffe4 (ffff90ce07190100)
00010000:00010000:0.0:1789431562.334391:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.334394:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635259d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334399:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635259d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334425:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635259c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8afc expref: 308 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334437:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635259d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x109d1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8afc expref: 307 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.334445:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109d1:0x0].0x0 (ffff90ce032a1f00)
00010000:00010000:0.0:1789431562.334447:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431562.334450:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7bc00, rc 0)
00000100:00100000:0.0:1789431562.334490:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933463296:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 541us (2254us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.334497:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295908
00000001:00080000:0.0:1789431562.340987:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969615 is committed
00000001:00080000:0.0:1789431562.341081:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969577 is committed
00000001:00080000:0.0:1789431562.341098:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969582 is committed
00000100:00100000:0.0:1789431562.345463:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.345550:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933463424
00000100:00100000:3.0:1789431562.345560:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933463424
00000100:00100000:3.0:1789431562.345653:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295909
00000100:00100000:3.0:1789431562.345663:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933463424:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431562.345687:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431562.345708:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635259e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b03 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.345778:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635259e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.345792:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635259e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.345808:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635259e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.345820:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635259ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.345827:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635259ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.345833:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635259ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.345935:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635259f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.345944:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635259f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.345951:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635259f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431562.345985:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100be:0x0]: returning size 260096
00000004:00200000:3.0:1789431562.345988:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431562.346006:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635259f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.346018:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635259f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.346025:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635259e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.346035:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635259e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.346042:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635259e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.346172:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.346176:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635259e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.346183:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635259e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.346195:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431562.346198:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.346203:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635259e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.346209:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635259e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.346222:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635259ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.346227:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635259ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.346232:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635259ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.346237:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.346240:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635259ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.346246:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635259ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.346253:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xc4fc354d (ffff90cf18b78100)
00010000:00010000:3.0:1789431562.346255:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.346259:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635259ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.346332:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635259ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.346366:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635259e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b03 expref: 309 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.346379:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635259f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b03 expref: 308 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.346387:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:3.0:1789431562.346389:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431562.346392:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cba00, rc 0)
00000100:00100000:3.0:1789431562.346489:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933463424:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 827us (1034us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431562.346497:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295909
00000100:00100000:3.0:1789431562.356927:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.357030:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933463680
00000100:00100000:2.0:1789431562.357040:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933463680
00000100:00100000:2.0:1789431562.357133:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295910
00000100:00100000:2.0:1789431562.357145:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933463680:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431562.357197:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431562.357223:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635259d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109d1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8afc expref: 308 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.357245:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63514db7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x109d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3726 expref: 307 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.357255:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109d1:0x0].0x0 (ffff90ce032a1f00)
00010000:00010000:2.0:1789431562.357266:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431562.357299:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb635259fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.357312:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb635259fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.357321:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb635259fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.357334:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525a03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.357340:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525a03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.357346:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525a03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.357444:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x109d1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.357452:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.357458:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431562.357955:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1219, 64 off86272
00010000:00010000:2.0:1789431562.358017:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x109d1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358027:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109d1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358036:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109d1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358044:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a11 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109d1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358102:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a11 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109d1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358108:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109d1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358122:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431562.358140:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109d1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358145:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a0a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x109d1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358151:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109d1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358157:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb18800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.358161:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109d1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358168:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a0a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x109d1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358177:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109d1:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:2.0:1789431562.358179:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431562.358184:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a0a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x109d1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358190:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a0a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x109d1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358203:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb635259fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358209:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb635259fc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358214:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb635259fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358217:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb18600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.358220:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb635259fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358225:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb635259fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358232:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007e:0x0].0x0 (ffff90ce2725d400)
00010000:00010000:2.0:1789431562.358234:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.358237:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb635259fc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.358242:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb635259fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1007e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431562.358251:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a3d5d94d reply state 00000000a8abaeb6 transno 4295120935 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525a03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.358264:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431562.358339:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933463680:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1195us (1420us total) trans 4295120935 rc 0/0
00000100:00100000:2.0:1789431562.358346:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295910
00010000:00010000:1.0:1789431562.358644:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431562.358652:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109d1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.358659:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431562.358663:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109d1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.358669:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109d1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.358678:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109d1:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:1.0:1789431562.358681:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431562.358685:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a11 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x109d1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.358691:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x109d1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.358706:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431562.358708:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431562.358710:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431562.362036:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.362197:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933463808
00000100:00100000:1.0:1789431562.362208:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933463808
00000100:00100000:1.0:1789431562.362282:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14340
00000100:00100000:1.0:1789431562.362292:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33176680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:2348:x1876351933463808:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431562.362308:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431562.362333:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635259f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b03 expref: 308 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.362352:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:1.0:1789431562.362357:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431562.362416:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33176680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:2348:x1876351933463808:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 125us (388us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431562.362423:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14340
00010000:00010000:2.0:1789431562.362500:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525a03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.362509:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525a03 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.362517:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525a03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.362523:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.362527:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525a03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.362534:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525a03 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.362544:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007e:0x0].0x220bffe4 (ffff90cf13195900)
00010000:00010000:2.0:1789431562.362547:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.362551:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525a03 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.362556:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525a03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1007e:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.367136:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.367483:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933463936
00000100:00100000:0.0:1789431562.367496:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933463936
00000100:00100000:0.0:1789431562.367557:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295911
00000100:00100000:0.0:1789431562.367567:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933463936:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431562.367593:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431562.367614:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525a18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b0a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.367677:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525a1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.367691:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525a1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.367701:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525a1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.367714:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525a26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10087:0x0].0xa12f67b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.367722:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10087:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.367728:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10087:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.367928:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525a1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.367937:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525a1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.367959:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525a1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.367965:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ace00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.367969:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525a1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.367977:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525a1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.367988:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0x0 (ffff90ce27a54700)
00010000:00010000:0.0:1789431562.367991:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.367997:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525a1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.368002:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525a1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.368013:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10087:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.368019:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525a26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10087:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.368025:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525a26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10087:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.368030:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.368033:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525a26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10087:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.368044:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525a26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10087:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.368399:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0xa12f67b5 (ffff90ce07190100)
00010000:00010000:0.0:1789431562.368402:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.368406:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525a26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10087:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.368412:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525a26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10087:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.368447:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525a18 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b0a expref: 307 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.368458:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0x0 (ffff90ce27a54700)
00010000:00010000:0.0:1789431562.368461:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.368464:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525a18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b0a expref: 307 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.368473:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad000, rc 0)
00000100:00100000:0.0:1789431562.368544:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933463936:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 978us (1418us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431562.368552:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295911
00000100:00100000:2.0:1789431562.368994:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.369222:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933464192
00000100:00100000:3.0:1789431562.369239:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933464192
00000100:00100000:3.0:1789431562.369334:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295912
00000100:00100000:3.0:1789431562.369348:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14616:x1876351933464192:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431562.369376:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431562.369401:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525a2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b11 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.369542:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525a34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.369560:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635259a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8af5 expref: 307 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.369569:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525a34 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.369609:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635259a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8af5 expref: 307 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.369624:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635259a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8af5 expref: 307 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.369640:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894218624:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431562.369766:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf377c6f00 going to sleep for 11 seconds
00000100:00100000:2.0:1789431562.374678:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.374770:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933464320
00000100:00100000:0.0:1789431562.374788:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933464320
00000100:00100000:3.0:1789431562.374830:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894218624:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431562.374854:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635259a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8af5 expref: 308 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.374873:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525a34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.374919:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16502
00000100:00100000:0.0:1789431562.374931:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:2348:x1876351933464320:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431562.374946:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431562.374963:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635259a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8af5 expref: 308 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.374976:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635259a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8af5 expref: 308 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.374999:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb635259a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8af5 expref: 308 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.375016:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:0.0:1789431562.375021:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525a34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.375031:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525a34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.375039:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525a34 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.375107:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431562.375157:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525a34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.375171:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525a34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.375186:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:2348:x1876351933464320:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 252us (517us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.375198:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16502
00000004:00200000:3.0:1789431562.375214:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100be:0x0]: returning size 260096
00010000:00010000:3.0:1789431562.375438:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525a2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b11 expref: 308 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.375461:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525a34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b11 expref: 307 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.375469:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:3.0:1789431562.375472:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431562.375475:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb800, rc 0)
00000100:00100000:3.0:1789431562.375523:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933464192:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6178us (6531us total) trans 4295120936 rc 0/0
00000100:00100000:3.0:1789431562.375532:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295912
00000100:00100000:2.0:1789431562.379237:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.379890:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933464448
00000100:00100000:3.0:1789431562.379905:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933464448
00000100:00100000:3.0:1789431562.379987:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295913
00000100:00100000:3.0:1789431562.380000:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933464448:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431562.380028:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431562.380100:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525a42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b18 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.380218:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525a49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.380240:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525a34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b11 expref: 308 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.380250:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525a49 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.380313:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525a34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b11 expref: 308 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.380329:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525a34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b11 expref: 308 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.380346:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894218752:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431562.380463:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf377c6f00 going to sleep for 11 seconds
00000100:00100000:2.0:1789431562.386163:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.386345:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894218752:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431562.386384:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525a49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.388521:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933464576
00000100:00100000:0.0:1789431562.388535:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933464576
00000100:00100000:0.0:1789431562.388609:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295914
00000100:00100000:0.0:1789431562.388620:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933464576:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431562.388650:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431562.388678:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525a50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b1f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.388763:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525a57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10087:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.388778:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525a57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10087:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.388790:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525a57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10087:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431562.388826:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10087:0x0]: returning size 16384
00000004:00200000:0.0:1789431562.388830:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431562.388850:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525a57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10087:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.388877:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525a50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b1f expref: 311 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.388896:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525a57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10087:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b1f expref: 310 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.388905:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0x0 (ffff90ce27a54700)
00010000:00010000:0.0:1789431562.388908:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431562.388912:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ace00, rc 0)
00000100:00100000:0.0:1789431562.388992:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933464576:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 373us (2844us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.389000:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295914
00000100:00100000:3.0:1789431562.389201:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.389678:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933464704
00000100:00100000:0.0:1789431562.389686:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933464704
00010000:00010000:0.0:1789431562.389718:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525a34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b11 expref: 310 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.389760:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16503
00000100:00100000:0.0:1789431562.389768:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e955850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:2348:x1876351933464704:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431562.389780:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431562.389787:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525a34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b11 expref: 310 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.389799:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525a34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b11 expref: 310 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.389818:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525a34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b11 expref: 310 pid: 12181 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.389830:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:0.0:1789431562.389834:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525a49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.389843:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.389854:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525a49 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.389887:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431562.389938:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e955850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:2348:x1876351933464704:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 170us (746us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.389948:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16503
00010000:00010000:3.0:1789431562.389951:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.389965:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431562.390022:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100be:0x0]: returning size 260096
00000004:00200000:3.0:1789431562.390028:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431562.390071:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.390114:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525a42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100be:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b18 expref: 309 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.390133:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525a49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b18 expref: 308 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.390142:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:3.0:1789431562.390144:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431562.390148:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cba00, rc 0)
00000100:00100000:3.0:1789431562.390194:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933464448:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10198us (10972us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431562.390202:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295913
00000100:00100000:3.0:1789431562.393409:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.393498:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933464832
00000100:00100000:1.0:1789431562.393513:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933464832
00000100:00100000:1.0:1789431562.393600:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12457
00000100:00100000:1.0:1789431562.393611:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933464832:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431562.395902:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.395989:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933465088
00000100:00100000:0.0:1789431562.396003:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933465088
00000100:00100000:0.0:1789431562.396115:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12458
00000100:00100000:0.0:1789431562.396125:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933465088:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431562.396749:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933465088:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 623us (858us total) trans 4295120937 rc 0/0
00000100:00100000:0.0:1789431562.396758:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12458
00000100:00100000:0.0:1789431562.399635:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933464832:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 6009us (6224us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.399653:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12457
00000100:00100000:2.0:1789431562.404691:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.404832:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933465216
00000100:00100000:3.0:1789431562.404846:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933465216
00000100:00100000:3.0:1789431562.404922:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295915
00000100:00100000:3.0:1789431562.404934:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933465216:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431562.404960:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431562.404987:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525a5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b26 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405112:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525a65 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405131:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525a65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405145:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525a65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405162:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525a6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405168:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405175:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405319:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525a73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405328:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405335:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431562.405380:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100be:0x0]: returning size 260096
00000004:00200000:3.0:1789431562.405386:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431562.405410:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405424:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405432:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525a65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405444:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525a65 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405452:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525a65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405459:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cbc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.405464:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525a65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405472:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525a65 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405486:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:3.0:1789431562.405489:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.405494:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525a65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405502:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525a65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405518:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405524:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525a6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405530:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525a6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405535:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.405538:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525a6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405544:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525a6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405551:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xc4fc354d (ffff90cf18b78100)
00010000:00010000:3.0:1789431562.405553:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.405556:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525a6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405562:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525a6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405597:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525a5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b26 expref: 311 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405612:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525a73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b26 expref: 310 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.405619:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:3.0:1789431562.405621:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431562.405624:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb600, rc 0)
00000100:00100000:3.0:1789431562.405699:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933465216:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 767us (1023us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431562.405706:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295915
00000100:00100000:1.0:1789431562.414562:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.414893:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933465472
00000100:00100000:3.0:1789431562.414908:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933465472
00000100:00100000:2.0:1789431562.415170:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295916
00000100:00100000:2.0:1789431562.415184:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933465472:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.415220:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.415247:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525a7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b2d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.415402:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.415420:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525a49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b18 expref: 311 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.415429:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525a73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b26 expref: 311 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.415438:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a81 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.415485:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525a73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b26 expref: 311 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.415500:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525a73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b26 expref: 311 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.415521:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894218880:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431562.415878:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525a49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b18 expref: 311 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.415889:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525a49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b18 expref: 311 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.415900:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894219008:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431562.415929:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1840 going to sleep for 11 seconds
00000100:00100000:3.0:1789431562.416295:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.416371:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933465600
00000100:00100000:2.0:1789431562.416378:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933465600
00000100:00100000:2.0:1789431562.416428:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295917
00000100:00100000:2.0:1789431562.416437:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+312:14617:x1876351933465600:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.416452:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.416468:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525a88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b34 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.416532:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a8f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.416547:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.416561:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.416583:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525a96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.416596:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.416604:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.416918:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525a9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a0a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.416927:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525a9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a0a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.416932:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525a9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a0a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431562.416966:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10a0a:0x0]: returning size 88384
00000004:00200000:2.0:1789431562.416971:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431562.416988:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525a9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a0a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.416998:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525a9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a0a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.417005:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.417010:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a8f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.417018:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.417022:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.417025:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.417031:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.417039:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0x0 (ffff90ce27a54700)
00010000:00010000:2.0:1789431562.417041:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.417044:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.417076:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525a8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.417089:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.417095:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525a96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.417101:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525a96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.417106:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.417109:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525a96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.417120:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525a96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.417128:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0x1e68dc46 (ffff90cf13195900)
00010000:00010000:2.0:1789431562.417131:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.417134:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525a96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.417139:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525a96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.417174:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525a88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b34 expref: 314 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.417189:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525a9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a0a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b34 expref: 313 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.417197:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a0a:0x0].0x0 (ffff90cf06585900)
00010000:00010000:2.0:1789431562.417199:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431562.417202:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb19800, rc 0)
00000100:00100000:2.0:1789431562.417265:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14617:x1876351933465600:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 828us (971us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.417273:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295917
00000100:00100000:1.0:1789431562.422028:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.422159:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933465728
00000100:00100000:3.0:1789431562.422174:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933465728
00010000:00010000:3.0:1789431562.422231:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525a73 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b26 expref: 313 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.422257:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431562.422313:0:5849:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@0000000005281523 x1876351894218880) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525a73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b26 expref: 313 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.422337:0:5849:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525a73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b26 expref: 313 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.422368:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525a73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b26 expref: 313 pid: 5847 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.422394:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894218880:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431562.422410:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894219008:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431562.422439:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:0.0:1789431562.422445:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.422456:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.422466:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.423902:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933465856
00000100:00100000:3.0:1789431562.423919:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933465856
00010000:00010000:3.0:1789431562.423968:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525a49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b18 expref: 313 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.424018:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16504
00000100:00100000:3.0:1789431562.424030:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:2347:x1876351933465728:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431562.424065:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431562.424069:0:14498:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d8e438fb63525a73)
00010000:00010000:3.0:1789431562.424072:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431562.424111:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16505
00000100:00100000:0.0:1789431562.424125:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:2348:x1876351933465856:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431562.424136:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:3.0:1789431562.424145:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:2347:x1876351933465728:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 115us (2274us total) trans 0 rc 116/116
00010000:00010000:0.0:1789431562.424146:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525a49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b18 expref: 313 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.424164:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16504
00010000:00010000:0.0:1789431562.424170:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525a49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b18 expref: 313 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.424195:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525a49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b18 expref: 312 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.424211:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:0.0:1789431562.424218:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.424229:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.424237:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a81 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.424316:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431562.424341:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:2348:x1876351933465856:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 220us (2086us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.424349:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16505
00010000:00010000:3.0:1789431562.427191:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.427213:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431562.427246:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100be:0x0]: returning size 260096
00010000:00010000:3.0:1789431562.427478:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525a7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b2d expref: 312 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.427506:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b2d expref: 311 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.427522:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:3.0:1789431562.427526:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431562.427530:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb18800, rc 0)
00000100:00100000:3.0:1789431562.427627:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933465472:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12444us (13080us total) trans 4295120938 rc 0/0
00000100:00100000:3.0:1789431562.427637:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295916
00000100:00100000:0.0:1789431562.428980:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.429139:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933466112
00000100:00100000:3.0:1789431562.429151:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933466112
00000100:00100000:3.0:1789431562.429210:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295918
00000100:00100000:3.0:1789431562.429222:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933466112:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431562.429713:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0
00010000:00010000:3.0:1789431562.429767:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74000/0xd8e438fb6351d6b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a0a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6333 expref: 311 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.429797:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb6351d2a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10a0a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c621b expref: 310 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.429813:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a0a:0x0].0x0 (ffff90cf06585900)
00010000:00010000:3.0:1789431562.429825:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525a57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10087:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b1f expref: 309 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.429835:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0x0 (ffff90ce27a54700)
00010000:00010000:3.0:1789431562.429840:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431562.429869:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525aab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.429894:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525aab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.429906:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525aab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.429925:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ab2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.429933:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.429940:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.430316:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525ab9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a0a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.430329:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525a9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10a0a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b34 expref: 308 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.430338:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525ab9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10a0a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.430379:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525a9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a0a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b34 expref: 308 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.430397:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525a9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10a0a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b34 expref: 308 pid: 5848 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.430420:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894219136:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431562.431077:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf377c6f00 going to sleep for 11 seconds
00000100:00100000:1.0:1789431562.431325:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.432654:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933466240
00000100:00100000:2.0:1789431562.432670:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933466240
00010000:00010000:2.0:1789431562.432728:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525a9d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10a0a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b34 expref: 309 pid: 5848 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.432803:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16506
00000100:00100000:2.0:1789431562.432814:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:2347:x1876351933466240:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431562.432833:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431562.432841:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525a9d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10a0a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b34 expref: 309 pid: 5848 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.432855:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525a9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10a0a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b34 expref: 309 pid: 5848 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.432881:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a0a:0x0].0x0 (ffff90cf06585900)
00010000:00010000:2.0:1789431562.432888:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525ab9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a0a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.432899:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a0a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.432908:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525ab9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10a0a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.432933:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431562.432995:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:2347:x1876351933466240:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 183us (1734us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.433002:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16506
00000100:00100000:1.0:1789431562.435844:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431562.436081:0:5847:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@00000000134d20c2 x1876351894219136) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525a9d lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10a0a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b34 expref: 308 pid: 5848 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.436109:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525a9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a0a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b34 expref: 308 pid: 5848 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.436132:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894219136:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431562.436160:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a0a:0x0].0x0 (ffff90cf06585900)
00010000:00010000:3.0:1789431562.436173:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a0a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.436184:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a0a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.436191:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a0a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431562.437288:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1216, 64 off86016
00000004:00080000:3.0:1789431562.437303:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3020468253017ns, next at 3021468249280ns, rc = 0
00010000:00010000:3.0:1789431562.437394:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525ac0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a0a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437415:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a0a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437434:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a0a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437443:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525ac0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a0a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437450:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525ac0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a0a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437457:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525ac0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a0a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437484:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431562.437513:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a0a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437520:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525ab9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a0a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437527:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525ab9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a0a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437533:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.437539:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525ab9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a0a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437547:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525ab9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a0a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437560:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a0a:0x0].0x0 (ffff90cf06585900)
00010000:00010000:3.0:1789431562.437563:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431562.437567:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525ab9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a0a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437573:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525ab9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a0a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437594:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525aab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437600:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525aab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437606:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525aab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437612:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.437614:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525aab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437620:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525aab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437628:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0x0 (ffff90ce27a54700)
00010000:00010000:3.0:1789431562.437630:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.437634:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525aab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.437640:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525aab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431562.437651:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c19894fc reply state 00000000f2c26c70 transno 4295120939 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.437665:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431562.437962:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431562.437971:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525ac0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a0a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.437979:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cbc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431562.437982:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525ac0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a0a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.437989:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525ac0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a0a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.437999:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a0a:0x0].0x0 (ffff90cf06585900)
00010000:00010000:1.0:1789431562.438002:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431562.438004:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525ac0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a0a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.438010:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525ac0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a0a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.438031:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431562.438033:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431562.438036:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431562.438355:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933466112:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 9129us (9378us total) trans 4295120939 rc 0/0
00000100:00100000:3.0:1789431562.438366:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295918
00000100:00100000:1.0:1789431562.439111:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933466368
00000100:00100000:1.0:1789431562.439125:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933466368
00000100:00100000:2.0:1789431562.439233:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295919
00000100:00100000:2.0:1789431562.439248:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933466368:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.439291:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.439315:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525ac7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b3b expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.439419:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ace lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.439436:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a81 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b2d expref: 310 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.439445:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ace lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.439485:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b2d expref: 310 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.439500:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b2d expref: 310 pid: 5849 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.439517:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e828000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894219264:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431562.439614:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1840 going to sleep for 11 seconds
00010000:00010000:3.0:1789431562.443811:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.443835:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ab2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.443844:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ab2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.443851:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.443858:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ab2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.443868:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ab2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.443889:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0x1e68dc46 (ffff90cf18b78100)
00010000:00010000:3.0:1789431562.443893:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.443900:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ab2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.443907:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ab2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10087:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.444203:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.444455:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e828000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894219264:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431562.444490:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ace lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.444715:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933466496
00000100:00100000:3.0:1789431562.444725:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933466496
00010000:00010000:3.0:1789431562.444865:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b2d expref: 310 pid: 5849 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.444918:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16507
00000100:00100000:3.0:1789431562.444929:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:2348:x1876351933466496:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431562.444948:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431562.444957:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b2d expref: 310 pid: 5849 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.444970:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b2d expref: 310 pid: 5849 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.444993:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525a81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b2d expref: 310 pid: 5849 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.445007:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:3.0:1789431562.445012:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ace lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.445024:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.445033:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ace lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.445083:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431562.445149:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:2348:x1876351933466496:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 221us (951us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431562.445162:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16507
00010000:00010000:1.0:1789431562.445449:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.445459:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431562.445521:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100be:0x0]: returning size 260096
00000004:00200000:1.0:1789431562.445526:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431562.445552:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.445591:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525ac7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100be:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b3b expref: 309 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.445610:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ace lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b3b expref: 308 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.445619:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:1.0:1789431562.445622:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431562.445625:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb19400, rc 0)
00000100:00100000:1.0:1789431562.445660:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933466368:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6416us (9831us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431562.445668:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295919
00000100:00100000:2.0:1789431562.454390:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.454437:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.454532:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933466752
00000100:00100000:3.0:1789431562.454546:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933466752
00000100:00100000:3.0:1789431562.454614:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12459
00000100:00100000:3.0:1789431562.454627:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933466752:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431562.454970:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933466752:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 344us (594us total) trans 4295120940 rc 0/0
00000100:00100000:3.0:1789431562.454978:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12459
00000100:00100000:0.0:1789431562.455549:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933467008
00000100:00100000:0.0:1789431562.455557:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933467008
00000100:00100000:0.0:1789431562.455615:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295920
00000100:00100000:0.0:1789431562.455626:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933467008:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431562.455680:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431562.455717:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6351c9e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a00:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c5f5f expref: 309 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.455758:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a00:0x0].0x0 (ffff90cf1247cd00)
00010000:00010000:0.0:1789431562.455773:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431562.455808:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525ad5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.455825:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525ad5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.455841:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525ad5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.455859:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525adc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10087:0x0].0x91184568 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.455866:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525adc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.455873:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525adc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.456017:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525ae3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a00:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.456026:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525ae3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a00:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.456034:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525ae3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a00:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:0.0:1789431562.457257:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1217, 64 off86080
00010000:00010000:0.0:1789431562.457341:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525aea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a00:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457358:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a00:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457369:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a00:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457379:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525aea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a00:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457387:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525aea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a00:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457393:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525aea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a00:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457412:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431562.457441:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525ae3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a00:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457447:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525ae3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a00:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457453:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525ae3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a00:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457460:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ace00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.457465:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525ae3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a00:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457474:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525ae3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a00:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457486:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a00:0x0].0x0 (ffff90ce07190400)
00010000:00010000:0.0:1789431562.457489:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431562.457495:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525ae3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a00:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457501:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525ae3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a00:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457528:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525ad5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457536:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525ad5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457542:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525ad5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457547:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.457550:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525ad5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457556:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525ad5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457564:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0x0 (ffff90ce27a54700)
00010000:00010000:0.0:1789431562.457567:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.457570:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525ad5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.457576:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525ad5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431562.457585:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008ebbc090 reply state 00000000d282a452 transno 4295120941 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525adc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.457594:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431562.457716:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933467008:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2088us (3272us total) trans 4295120941 rc 0/0
00000100:00100000:0.0:1789431562.457730:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295920
00010000:00010000:2.0:1789431562.458013:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431562.458023:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525aea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a00:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.458036:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431562.458039:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525aea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a00:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.458080:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525aea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a00:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.458093:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a00:0x0].0x0 (ffff90ce07190400)
00010000:00010000:2.0:1789431562.458095:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431562.458098:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525aea lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a00:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.458104:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525aea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a00:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.458125:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.458127:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.458128:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.461673:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525adc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.461697:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525adc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.461706:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525adc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.461713:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.461720:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525adc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.461729:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525adc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.461767:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0x91184568 (ffff90ce07190100)
00010000:00010000:0.0:1789431562.461771:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.461778:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525adc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10087:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.461786:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525adc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10087:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.464838:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.465459:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933467136
00000100:00100000:2.0:1789431562.465476:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933467136
00000100:00100000:2.0:1789431562.465597:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295921
00000100:00100000:2.0:1789431562.465610:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933467136:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.465644:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.465672:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525af1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b42 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.465778:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525af8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.465803:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525af8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.465818:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525af8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.465835:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525aff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.465843:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525aff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.465850:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525aff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.465983:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525b06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.465992:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.465999:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431562.466041:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100be:0x0]: returning size 260096
00000004:00200000:2.0:1789431562.466182:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431562.466213:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.466228:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.466241:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525af8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.466248:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525af8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.466256:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525af8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.466273:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb18600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.466278:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525af8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.466294:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525af8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.466308:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:2.0:1789431562.466312:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.466318:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525af8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.466325:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525af8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.466341:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525aff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.466347:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525aff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.466353:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525aff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.466359:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb18800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.466362:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525aff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.466368:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525aff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.466375:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xc4fc354d (ffff90cf13195900)
00010000:00010000:2.0:1789431562.466378:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.466381:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525aff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.466386:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525aff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.466423:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525af1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b42 expref: 311 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.466437:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525b06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b42 expref: 310 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.466445:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:2.0:1789431562.466447:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431562.466450:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb19800, rc 0)
00000100:00100000:2.0:1789431562.466535:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933467136:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 927us (1711us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.466543:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295921
00000100:00100000:3.0:1789431562.470348:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.470542:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933467264
00000100:00100000:0.0:1789431562.470555:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933467264
00000100:00100000:0.0:1789431562.470639:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14341
00000100:00100000:0.0:1789431562.470651:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:2347:x1876351933467264:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431562.470678:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431562.470710:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525b06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b42 expref: 310 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.470745:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:0.0:1789431562.470760:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431562.470832:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:2347:x1876351933467264:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 183us (499us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.470840:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14341
00000100:00100000:3.0:1789431562.473756:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.473850:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933467520
00000100:00100000:2.0:1789431562.473864:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933467520
00000100:00100000:2.0:1789431562.473935:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295922
00000100:00100000:2.0:1789431562.473947:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933467520:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.473974:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.474001:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525b0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b49 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.474171:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525b14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.474188:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ace lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b3b expref: 310 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.474199:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525b14 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.474240:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ace lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b3b expref: 310 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.474256:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ace lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b3b expref: 310 pid: 12775 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.474292:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894219392:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431562.474385:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1840 going to sleep for 11 seconds
00000100:00100000:0.0:1789431562.476708:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.476841:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933467776
00000100:00100000:3.0:1789431562.476857:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933467776
00000100:00100000:3.0:1789431562.476930:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295923
00000100:00100000:3.0:1789431562.476941:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933467776:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431562.477314:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431562.477350:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0a00/0xd8e438fb6351d048 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a06:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c613b expref: 311 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.477373:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a06:0x0].0x0 (ffff90cf03dd3500)
00010000:00010000:3.0:1789431562.477388:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431562.477415:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.477433:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.477445:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.477462:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525b22 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10087:0x0].0xba61c71c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.477470:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525b22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.477476:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525b22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.477640:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b29 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a06:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.477648:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a06:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.477655:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a06:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431562.478381:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1218, 64 off86144
00010000:00010000:3.0:1789431562.478463:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b30 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a06:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478476:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a06:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478485:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a06:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478495:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b30 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a06:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478502:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b30 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a06:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478511:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a06:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478532:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431562.478560:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a06:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478566:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b29 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a06:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478573:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b29 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a06:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478580:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.478585:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b29 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a06:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478593:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b29 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a06:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478604:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a06:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431562.478607:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431562.478611:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b29 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a06:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478618:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b29 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a06:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478638:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478649:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b1b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478655:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478660:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.478663:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478669:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478677:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0x0 (ffff90ce27a54700)
00010000:00010000:3.0:1789431562.478680:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.478683:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b1b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.478689:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b1b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431562.478700:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000cdddf9d reply state 00000000447a6b27 transno 4295120942 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525b22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.478709:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431562.479245:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431562.479301:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b30 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a06:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.479309:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431562.479312:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b30 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a06:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.479320:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a06:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.479331:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a06:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:0.0:1789431562.479334:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431562.479337:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b30 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a06:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.479342:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b30 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a06:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.479366:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.479368:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.479370:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431562.480533:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+312:14617:x1876351933467776:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3580us (3824us total) trans 4295120942 rc 0/0
00000100:00100000:3.0:1789431562.480548:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295923
00000100:00100000:1.0:1789431562.480838:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.481332:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894219392:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431562.481366:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525b14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.483636:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933467904
00000100:00100000:2.0:1789431562.483656:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933467904
00010000:00010000:3.0:1789431562.483688:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525b22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.483707:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525b22 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.483713:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ace lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b3b expref: 312 pid: 12775 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.483714:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525b22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.483721:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.483727:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525b22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.483745:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525b22 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.483765:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0xba61c71c (ffff90cf18b78100)
00010000:00010000:3.0:1789431562.483769:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.483774:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525b22 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10087:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.483780:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525b22 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10087:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.484436:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16508
00000100:00100000:2.0:1789431562.484453:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:2348:x1876351933467904:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431562.484474:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431562.484483:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ace lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b3b expref: 311 pid: 12775 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.484499:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ace lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b3b expref: 311 pid: 12775 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.484521:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ace lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b3b expref: 311 pid: 12775 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.484533:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:2.0:1789431562.484538:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525b14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.484550:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525b14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.484558:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525b14 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.484690:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431562.484787:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:2348:x1876351933467904:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 339us (3948us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.484796:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16508
00010000:00010000:0.0:1789431562.487370:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525b14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.487392:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525b14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431562.487423:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100be:0x0]: returning size 260096
00010000:00010000:0.0:1789431562.487668:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525b0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b49 expref: 311 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.487697:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525b14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b49 expref: 310 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.487708:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:0.0:1789431562.487715:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431562.487720:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bad0400, rc 0)
00000100:00100000:0.0:1789431562.487911:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933467520:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 13964us (14185us total) trans 4295120943 rc 0/0
00000100:00100000:0.0:1789431562.487922:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295922
00000100:00100000:1.0:1789431562.489934:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.490021:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.492007:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933468288
00000100:00100000:0.0:1789431562.492029:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933468288
00000100:00100000:0.0:1789431562.492156:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1133
00000100:00100000:0.0:1789431562.492170:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+95:2349:x1876351933468288:12345-192.168.203.4@tcp:400:kworker.0
00000100:00100000:0.0:1789431562.492288:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+95:2349:x1876351933468288:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 122us (2265us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.492297:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1133
00000100:00080000:1.0:1789431562.492825:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1789431562.493066:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933468032
00000100:00100000:2.0:1789431562.493076:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933468032
00000100:00100000:2.0:1789431562.493169:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1306
00000100:00100000:2.0:1789431562.493180:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2ad6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fbca16f1-ddd0-4a1e-a69e-4d5ed8005437+10:2349:x1876351933468032:12345-192.168.203.4@tcp:400:kworker.0
00000100:00100000:2.0:1789431562.493246:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2ad6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fbca16f1-ddd0-4a1e-a69e-4d5ed8005437+10:2349:x1876351933468032:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 68us (3326us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.493254:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1306
00000100:00100000:0.0:1789431562.494677:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.494711:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933468160
00000100:00100000:0.0:1789431562.494720:0:14499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933468160
00000100:00100000:0.0:1789431562.494784:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1134
00000100:00100000:0.0:1789431562.494795:0:14499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+99:2349:x1876351933468160:12345-192.168.203.4@tcp:400:kworker.0
00000100:00100000:0.0:1789431562.494875:0:14499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+99:2349:x1876351933468160:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 82us (207us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.494884:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1134
00000100:00100000:0.0:1789431562.494931:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.495096:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933468544
00000100:00100000:3.0:1789431562.495102:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933468544
00000100:00100000:3.0:1789431562.495142:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295924
00000100:00100000:3.0:1789431562.495149:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933468544:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431562.495220:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431562.495254:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6351d1bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a09:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c61c7 expref: 310 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.495515:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a09:0x0].0x0 (ffff90ce15f08900)
00010000:00010000:3.0:1789431562.495530:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431562.495559:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.495575:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.495588:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.495603:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10087:0x0].0xdb4ed787 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.495611:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.495617:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.496088:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a09:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.496099:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a09:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.496107:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a09:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431562.497166:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1220, 64 off86336
00010000:00010000:3.0:1789431562.497259:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525b53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a09:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497514:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525b53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a09:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497528:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525b53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a09:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497538:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525b53 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a09:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497544:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525b53 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a09:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497550:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525b53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a09:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497581:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431562.497611:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a09:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497618:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b4c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a09:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497676:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a09:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497684:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.497689:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a09:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497698:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b4c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a09:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497711:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a09:0x0].0x0 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431562.497715:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431562.497720:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b4c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a09:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497727:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525b4c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a09:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497813:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497821:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b3e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497826:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497831:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.497834:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497840:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497849:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0x0 (ffff90ce27a54700)
00010000:00010000:3.0:1789431562.497851:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.497855:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b3e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.497860:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525b3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431562.497876:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000beb1075f reply state 000000006374af6e transno 4295120944 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.497886:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431562.498006:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933468544:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2852us (3068us total) trans 4295120944 rc 0/0
00000100:00100000:3.0:1789431562.498017:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295924
00010000:00010000:1.0:1789431562.498162:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431562.498169:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525b53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a09:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.498175:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cbc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431562.498178:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525b53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a09:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.498185:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525b53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a09:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.498196:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a09:0x0].0x0 (ffff90cf18b78f00)
00010000:00010000:1.0:1789431562.498199:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431562.498202:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525b53 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a09:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.498208:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525b53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a09:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.498230:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431562.498232:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431562.498234:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431562.501338:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.501470:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933468672
00000100:00100000:1.0:1789431562.501484:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933468672
00000100:00100000:1.0:1789431562.501558:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295925
00000100:00100000:1.0:1789431562.501571:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933468672:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431562.501603:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431562.501631:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525b5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b50 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.501755:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525b61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.501773:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525b14 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b49 expref: 312 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.501783:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525b61 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.501829:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525b14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b49 expref: 312 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.501845:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525b14 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b49 expref: 312 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.501862:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894219520:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431562.501974:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05eadd80 going to sleep for 11 seconds
00010000:00010000:1.0:1789431562.502261:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.502271:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.502291:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.502299:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.502304:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.502315:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b45 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.502332:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0xdb4ed787 (ffff90cf18b78d00)
00010000:00010000:1.0:1789431562.502336:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.502341:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b45 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10087:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.502348:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525b45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10087:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.508323:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894219520:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431562.508370:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525b61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.511395:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.511508:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933468800
00000100:00100000:2.0:1789431562.511522:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933468800
00010000:00010000:2.0:1789431562.511588:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525b14 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b49 expref: 312 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.511651:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16509
00000100:00100000:2.0:1789431562.511664:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e955c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+312:2348:x1876351933468800:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431562.511683:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431562.511692:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525b14 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b49 expref: 312 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.511708:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525b14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b49 expref: 312 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.511755:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525b14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100be:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b49 expref: 312 pid: 6797 timeout: 3120 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.511774:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:2.0:1789431562.511781:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525b61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.511800:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.511811:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525b61 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.511846:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431562.511919:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e955c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:2348:x1876351933468800:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 258us (540us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.511927:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16509
00010000:00010000:1.0:1789431562.512340:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.512352:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431562.512427:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100be:0x0]: returning size 260096
00000004:00200000:1.0:1789431562.512434:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431562.512466:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.512510:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525b5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100be:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b50 expref: 311 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.512530:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308e00/0xd8e438fb63525b61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100be:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b50 expref: 310 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.512540:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100be:0x0].0x0 (ffff90ce2d721c00)
00010000:00010000:1.0:1789431562.512543:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431562.512546:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308e00, rc 0)
00000100:00100000:1.0:1789431562.512582:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933468672:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11016us (11260us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431562.512590:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295925
00000100:00100000:0.0:1789431562.521461:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.521606:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933468928
00000100:00100000:2.0:1789431562.521621:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933468928
00000100:00100000:2.0:1789431562.521699:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295926
00000100:00100000:2.0:1789431562.521712:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933468928:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.521828:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.521860:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525b68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b57 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.521954:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.521974:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.521990:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522008:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525b76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1007f:0x0].0xa12f67b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522021:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522027:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522523:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522535:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522542:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522548:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb18800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.522553:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522561:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522579:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007f:0x0].0x0 (ffff90ce15f18600)
00010000:00010000:2.0:1789431562.522582:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.522589:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522596:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522610:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522617:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525b76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522623:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525b76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522628:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb18600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.522631:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525b76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522638:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525b76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522645:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007f:0x0].0xa12f67b5 (ffff90cf13195900)
00010000:00010000:2.0:1789431562.522648:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.522651:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525b76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1007f:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522657:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525b76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1007f:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522700:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525b68 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b57 expref: 311 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522713:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007f:0x0].0x0 (ffff90ce15f18600)
00010000:00010000:2.0:1789431562.522716:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.522719:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525b68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b57 expref: 311 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.522744:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb19a00, rc 0)
00000100:00100000:2.0:1789431562.522907:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933468928:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1196us (1460us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431562.522916:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295926
00000100:00100000:0.0:1789431562.531278:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.531594:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933469056
00000100:00100000:2.0:1789431562.531609:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933469056
00000100:00100000:2.0:1789431562.531696:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295927
00000100:00100000:2.0:1789431562.531711:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933469056:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.531752:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.531980:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525b7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b5e expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.532144:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525b84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1007f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.532163:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.532178:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431562.532227:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1007f:0x0]: returning size 16384
00000004:00200000:2.0:1789431562.532232:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431562.532268:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.532640:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525b7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b5e expref: 312 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.532672:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525b84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b5e expref: 311 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.532682:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007f:0x0].0x0 (ffff90ce15f18600)
00010000:00010000:2.0:1789431562.532760:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:2.0:1789431562.532766:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb18600, rc 0)
00000100:00100000:2.0:1789431562.532934:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933469056:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1226us (1672us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.532944:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295927
00000100:00100000:2.0:1789431562.541255:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.541574:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.541957:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933469440
00000100:00100000:2.0:1789431562.541970:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933469440
00000100:00100000:2.0:1789431562.542038:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295928
00000100:00100000:2.0:1789431562.542161:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933469440:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431562.542243:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431562.542281:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06000/0xd8e438fb6351def7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c65b7 expref: 311 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.542314:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb6351dd06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10a12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6539 expref: 310 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.542327:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a12:0x0].0x0 (ffff90ce15f12d00)
00010000:00010000:2.0:1789431562.542343:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431562.542373:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525b8b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.542397:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525b8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.542408:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525b8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.542426:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10087:0x0].0x193cfbd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.542433:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.542440:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.542892:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933469184
00000100:00100000:0.0:1789431562.542900:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933469184
00000100:00100000:0.0:1789431562.542950:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12460
00000100:00100000:0.0:1789431562.542959:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933469184:12345-192.168.203.4@tcp:37:dbench.0
00010000:00010000:2.0:1789431562.544021:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525b99 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.544041:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525b99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.544066:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525b99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431562.544697:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1219, 64 off86208
00010000:00010000:2.0:1789431562.544788:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525ba0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.544800:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.544810:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.544820:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525ba0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.544821:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.544827:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525ba0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.544833:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525ba0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.544849:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431562.544867:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431562.544875:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525ba0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.544875:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525b99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a12:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.544882:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525b99 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a12:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.544889:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431562.544889:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525b99 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.544894:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525ba0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a12:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.544894:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.544897:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525b99 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a12:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.544903:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525ba0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a12:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.544903:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525b99 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a12:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.546614:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a12:0x0].0x0 (ffff90cf13195500)
00010000:00010000:2.0:1789431562.546627:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431562.546646:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525b99 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.546665:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525b99 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.546701:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525b8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.546709:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525b8b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.546716:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525b8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.546722:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.546727:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525b8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.546743:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525b8b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.546753:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0x0 (ffff90ce27a54700)
00010000:00010000:2.0:1789431562.546756:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.546759:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525b8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.546766:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525b8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431562.546777:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000795ad124 reply state 00000000c05d68d3 transno 4295120945 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.546787:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431562.546823:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a12:0x0].0x0 (ffff90cf13195500)
00010000:00010000:0.0:1789431562.546827:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431562.546832:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525ba0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.546837:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525ba0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.546859:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.546860:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.546863:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431562.546917:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14617:x1876351933469440:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 4859us (5333us total) trans 4295120945 rc 0/0
00000100:00100000:2.0:1789431562.546928:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295928
00000100:00100000:0.0:1789431562.554967:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933469184:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 11993us (13723us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.554985:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12460
00000100:00100000:0.0:1789431562.557826:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431562.559515:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.559539:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.559547:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.559554:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb18800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.559572:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.559582:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.559614:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0x193cfbd6 (ffff90cf13195900)
00010000:00010000:1.0:1789431562.559618:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.559625:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10087:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.559638:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525b92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10087:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.562618:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933469696
00000100:00100000:3.0:1789431562.562642:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933469696
00000100:00100000:3.0:1789431562.562729:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295929
00000100:00100000:3.0:1789431562.562759:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933469696:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431562.562840:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431562.562876:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6351e0be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6643 expref: 310 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.562897:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a16:0x0].0x0 (ffff90ce2d731800)
00010000:00010000:3.0:1789431562.562910:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431562.562939:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ba7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.562957:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.562968:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.562989:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525bae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10087:0x0].0x28dc98c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.562996:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525bae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.563002:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525bae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.563180:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525bb5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.563188:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525bb5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.563195:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525bb5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.563441:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.563488:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933469824
00000100:00100000:1.0:1789431562.563493:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933469824
00000100:00100000:1.0:1789431562.563539:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295930
00000100:00100000:1.0:1789431562.563557:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933469824:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431562.563576:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431562.563589:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525bbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b65 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.563833:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525bc3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.563845:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525bc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.563855:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525bc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.563869:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525bca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.563876:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525bca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.563882:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525bca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564164:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525bd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x109cf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564174:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109cf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564183:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109cf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431562.564222:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x109cf:0x0]: returning size 19054
00000004:00200000:1.0:1789431562.564228:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431562.564252:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109cf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564265:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109cf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564275:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525bc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564283:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525bc3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564290:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525bc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564296:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.564300:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525bc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564308:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525bc3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564319:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007f:0x0].0x0 (ffff90ce15f18600)
00010000:00010000:1.0:1789431562.564322:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.564327:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525bc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564339:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525bc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564352:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525bca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564359:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525bca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564365:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525bca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564370:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.564373:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525bca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564384:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525bca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564392:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007f:0x0].0x17610ee3 (ffff90ce03149e00)
00010000:00010000:1.0:1789431562.564394:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.564397:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525bca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564402:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525bca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564437:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525bbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b65 expref: 312 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564456:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x109cf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b65 expref: 311 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.564463:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109cf:0x0].0x0 (ffff90cf03e3d800)
00010000:00010000:1.0:1789431562.564466:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431562.564468:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309000, rc 0)
00000100:00100000:1.0:1789431562.564563:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933469824:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1015us (1122us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431562.564573:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295930
00000040:00080000:2.0:1789431562.566939:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1220, 64 off86272
00010000:00010000:2.0:1789431562.567078:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525bd8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.567102:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.567117:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.567127:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525bd8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.567133:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525bd8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.567140:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525bd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.567176:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431562.567207:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525bb5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.567213:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525bb5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.567221:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525bb5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.567234:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.567239:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525bb5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.567247:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525bb5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.567271:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a16:0x0].0x0 (ffff90cf18b78700)
00010000:00010000:2.0:1789431562.567274:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431562.567281:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525bb5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.567288:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525bb5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.567314:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.567321:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ba7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.567327:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ba7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.567333:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.567337:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ba7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.567343:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ba7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.567355:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0x0 (ffff90ce27a54700)
00010000:00010000:2.0:1789431562.567357:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.567360:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ba7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.567362:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431562.567366:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ba7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10087:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.567372:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525bd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431562.567377:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000823963f4 reply state 000000009ee3b729 transno 4295120946 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525bae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.567378:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431562.567381:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525bd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.567389:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431562.567389:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525bd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.567398:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a16:0x0].0x0 (ffff90cf18b78700)
00010000:00010000:3.0:1789431562.567400:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431562.567403:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525bd8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.567408:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525bd8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.567427:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431562.567429:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431562.567431:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431562.567514:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+312:14617:x1876351933469696:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 4760us (9697us total) trans 4295120946 rc 0/0
00000100:00100000:2.0:1789431562.567525:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295929
00010000:00010000:1.0:1789431562.573904:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525bae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10087:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.573932:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525bae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.573941:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525bae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.573948:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.573954:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525bae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.573964:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525bae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10087:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.573987:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10087:0x0].0x28dc98c0 (ffff90cf18b78100)
00010000:00010000:1.0:1789431562.573991:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.573999:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525bae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10087:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.574006:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525bae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10087:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.576281:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.576468:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933470080
00000100:00100000:3.0:1789431562.576484:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933470080
00000100:00100000:3.0:1789431562.576570:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12461
00000100:00100000:3.0:1789431562.576585:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933470080:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431562.577035:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+312:14616:x1876351933470080:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 452us (765us total) trans 4295120947 rc 0/0
00000100:00100000:3.0:1789431562.577043:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12461
00000100:00100000:1.0:1789431562.577240:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.578315:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933470208
00000100:00100000:3.0:1789431562.578327:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933470208
00000100:00100000:3.0:1789431562.578682:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295931
00000100:00100000:3.0:1789431562.578694:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+312:14617:x1876351933470208:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431562.578717:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431562.579895:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525bdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b6c expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.579991:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525be6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.580008:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525be6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.580026:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525be6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.580043:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525bed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa12f67b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.580719:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525bed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.580739:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525bed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.581207:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525be6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.581217:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525be6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.581236:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525be6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.581244:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.581249:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525be6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.581256:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525be6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.581272:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431562.581275:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.581281:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525be6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.581288:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525be6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.581304:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525bed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.581310:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525bed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.581315:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525bed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.581320:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.581323:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525bed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.581329:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525bed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.581340:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa12f67b5 (ffff90cf18b78700)
00010000:00010000:0.0:1789431562.581343:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.581346:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525bed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.581352:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525bed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.581404:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525bdf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b6c expref: 313 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.581416:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431562.581418:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.581421:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525bdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b6c expref: 313 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.581431:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cba00, rc 0)
00000100:00100000:0.0:1789431562.581533:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+312:14617:x1876351933470208:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2840us (4291us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431562.581543:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295931
00000100:00100000:1.0:1789431562.585387:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.585482:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933470464
00000100:00100000:0.0:1789431562.585496:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933470464
00000100:00100000:0.0:1789431562.585570:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12462
00000100:00100000:0.0:1789431562.585583:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+312:14616:x1876351933470464:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431562.586171:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14616:x1876351933470464:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 587us (796us total) trans 4295120948 rc 0/0
00000100:00100000:0.0:1789431562.586185:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12462
00000100:00100000:1.0:1789431562.596925:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.601202:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933470592
00000100:00100000:2.0:1789431562.601230:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933470592
00000100:00100000:2.0:1789431562.601868:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295932
00000100:00100000:2.0:1789431562.601883:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14617:x1876351933470592:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.601918:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.601947:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525bf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b73 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.602039:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525bfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.602089:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525bfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.602108:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525bfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431562.602166:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008c:0x0]: returning size 16384
00000004:00200000:2.0:1789431562.602171:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431562.602198:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525bfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.602232:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525bf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b73 expref: 315 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.602256:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525bfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b73 expref: 314 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.602272:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431562.602276:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00000100:00100000:1.0:1789431562.602967:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431562.603085:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb19a00, rc 0)
00000100:00100000:2.0:1789431562.603187:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+314:14617:x1876351933470592:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1308us (6277us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.603197:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295932
00000100:00100000:1.0:1789431562.609257:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.609761:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933470848
00000100:00100000:2.0:1789431562.609778:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933470848
00000100:00100000:2.0:1789431562.609861:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295933
00000100:00100000:2.0:1789431562.609872:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+314:14616:x1876351933470848:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431562.609949:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0
00010000:00010000:2.0:1789431562.609984:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525bd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109cf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b65 expref: 314 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.610017:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37474c00/0xd8e438fb63514934 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x109cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c35c1 expref: 313 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.610030:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109cf:0x0].0x0 (ffff90cf03e3d800)
00010000:00010000:2.0:1789431562.610072:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525b84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1007f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b5e expref: 312 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.610083:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007f:0x0].0x0 (ffff90ce15f18600)
00010000:00010000:2.0:1789431562.610086:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431562.610114:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525c02 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.610131:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525c02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.610144:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525c02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.610162:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525c09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.610169:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525c09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.610176:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525c09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.610540:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525c10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x109cf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.610554:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525c10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.610562:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525c10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431562.611341:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1221, 64 off86336
00010000:00010000:2.0:1789431562.611430:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x109cf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611445:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611456:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611465:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c17 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611473:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c17 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611481:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611515:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431562.611548:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431562.611555:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611563:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bad0400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431562.611569:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611578:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611589:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109cf:0x0].0x0 (ffff90cf13195900)
00010000:00010000:2.0:1789431562.611593:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431562.611598:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c17 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x109cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611605:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x109cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611617:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.611620:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.611622:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.611640:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525c10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611647:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525c10 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x109cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611653:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525c10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611658:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.611662:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525c10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611668:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525c10 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x109cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611680:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109cf:0x0].0x0 (ffff90cf13195900)
00010000:00010000:2.0:1789431562.611682:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431562.611686:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525c10 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x109cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611691:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525c10 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x109cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611711:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525c02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611718:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525c02 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611724:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525c02 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611728:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.611742:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525c02 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611749:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525c02 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611757:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007f:0x0].0x0 (ffff90ce15f18600)
00010000:00010000:2.0:1789431562.611759:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.611762:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525c02 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.611768:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525c02 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431562.611783:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000efd6a524 reply state 0000000040021aa7 transno 4295120949 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525c09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.611793:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431562.611904:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14616:x1876351933470848:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2029us (8937us total) trans 4295120949 rc 0/0
00000100:00100000:2.0:1789431562.611913:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295933
00000100:00100000:3.0:1789431562.616993:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933470976
00000100:00100000:3.0:1789431562.617017:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933470976
00000100:00100000:0.0:1789431562.617139:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12463
00000100:00100000:0.0:1789431562.617163:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14617:x1876351933470976:12345-192.168.203.4@tcp:37:dbench.0
00010000:00010000:1.0:1789431562.617784:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525c09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.617799:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525c09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.617807:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525c09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.617814:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb18800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.617819:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525c09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.617828:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525c09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.617848:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007f:0x0].0x17610ee3 (ffff90cf13195f00)
00010000:00010000:1.0:1789431562.617852:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.617858:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525c09 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.617871:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525c09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1007f:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.619693:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.619813:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933471104
00000100:00100000:2.0:1789431562.619824:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933471104
00000100:00100000:2.0:1789431562.619922:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295934
00000100:00100000:2.0:1789431562.619934:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14616:x1876351933471104:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.619963:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.619989:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525c1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b7a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620102:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620120:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620135:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620152:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525c2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620160:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525c2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620167:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525c2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620481:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0a00/0xd8e438fb63525c33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x109d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620490:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0a00/0xd8e438fb63525c33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109d6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620497:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0a00/0xd8e438fb63525c33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109d6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431562.620540:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x109d6:0x0]: returning size 14984
00000004:00200000:2.0:1789431562.620544:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431562.620569:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0a00/0xd8e438fb63525c33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109d6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620582:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0a00/0xd8e438fb63525c33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620591:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620597:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c25 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620604:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620610:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.620614:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620623:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c25 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620702:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007f:0x0].0x0 (ffff90ce15f18600)
00010000:00010000:2.0:1789431562.620705:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.620711:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620718:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620741:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525c2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620748:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525c2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620755:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525c2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620762:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.620765:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525c2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620772:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525c2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620780:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007f:0x0].0x220bffe4 (ffff90cf13195500)
00010000:00010000:2.0:1789431562.620783:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.620786:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525c2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620791:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525c2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620827:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525c1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b7a expref: 316 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620841:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0a00/0xd8e438fb63525c33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x109d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b7a expref: 315 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.620848:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109d6:0x0].0x0 (ffff90cf03e3d100)
00010000:00010000:2.0:1789431562.620850:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431562.620853:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce249e0a00, rc 0)
00000100:00100000:2.0:1789431562.621017:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+315:14616:x1876351933471104:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1084us (1387us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.621026:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295934
00000100:00100000:0.0:1789431562.628577:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14617:x1876351933470976:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 11403us (19319us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.628594:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12463
00000100:00100000:0.0:1789431562.633673:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.635830:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933471360
00000100:00100000:2.0:1789431562.635855:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933471360
00000100:00100000:2.0:1789431562.635955:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295935
00000100:00100000:2.0:1789431562.635968:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14616:x1876351933471360:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431562.636075:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431562.636112:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0a00/0xd8e438fb63525c33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b7a expref: 313 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.636136:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63515607 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x109d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c39a3 expref: 312 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.636152:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109d6:0x0].0x0 (ffff90cf03e3d100)
00010000:00010000:2.0:1789431562.636165:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431562.636194:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525c3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.636211:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525c3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.636222:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525c3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.636239:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525c41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.636247:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525c41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.636255:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525c41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.636600:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525c48 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x109d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.636676:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525c48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109d6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.636684:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525c48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109d6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.637335:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000040:00080000:2.0:1789431562.637580:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1222, 64 off86400
00010000:00010000:2.0:1789431562.637673:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525c4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x109d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.637688:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525c4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.637697:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525c4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.637707:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525c4f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.637715:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525c4f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.637722:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525c4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.637879:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431562.637908:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525c48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109d6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.637915:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525c48 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x109d6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.637923:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525c48 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109d6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.637929:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.637934:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525c48 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109d6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.637943:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525c48 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x109d6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.637956:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109d6:0x0].0x0 (ffff90cf13195900)
00010000:00010000:2.0:1789431562.637959:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431562.637964:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525c48 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x109d6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.637971:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525c48 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x109d6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.637993:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525c3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638001:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525c3a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638006:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525c3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638011:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.638014:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525c3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638020:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525c3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638028:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007f:0x0].0x0 (ffff90ce15f18600)
00010000:00010000:2.0:1789431562.638030:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.638033:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525c3a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638039:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525c3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1007f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431562.638084:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000000e4e136 reply state 00000000c5a92ad3 transno 4295120950 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525c41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.638093:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431562.638255:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14616:x1876351933471360:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2286us (4593us total) trans 4295120950 rc 0/0
00000100:00100000:2.0:1789431562.638272:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295935
00000100:00100000:2.0:1789431562.638312:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933471488
00000100:00100000:2.0:1789431562.638322:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933471488
00000100:00100000:2.0:1789431562.638367:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295936
00000100:00100000:2.0:1789431562.638377:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14617:x1876351933471488:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.638395:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.638410:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525c56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b81 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.638441:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431562.638450:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525c4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109d6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.638457:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431562.638460:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525c4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109d6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.638466:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525c4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109d6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.638476:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109d6:0x0].0x0 (ffff90cf13195900)
00010000:00010000:2.0:1789431562.638476:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c5d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.638479:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431562.638482:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525c4f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x109d6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.638488:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525c4f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x109d6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638488:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638497:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.638505:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.638507:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.638509:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.638513:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638519:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638527:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638757:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525c6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x109b7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638767:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525c6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109b7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638774:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525c6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109b7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431562.638812:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x109b7:0x0]: returning size 85026
00000004:00200000:2.0:1789431562.638817:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431562.638835:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525c6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109b7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638848:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525c6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109b7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638855:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638861:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c5d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638867:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638873:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.638876:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638884:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c5d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638892:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431562.638894:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.638898:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638904:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525c5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638915:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638922:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638928:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638934:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bad0400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.638937:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638943:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.638951:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90cf13195c00)
00010000:00010000:2.0:1789431562.638954:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.639476:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.639490:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525c64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.639538:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525c56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b81 expref: 315 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.639556:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525c6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x109b7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b81 expref: 314 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.639564:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109b7:0x0].0x0 (ffff90ce0be62c00)
00010000:00010000:2.0:1789431562.639566:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431562.639570:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb18800, rc 0)
00000100:00100000:2.0:1789431562.639867:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+314:14617:x1876351933471488:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1488us (2533us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.639875:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295936
00000100:00100000:1.0:1789431562.643987:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.644564:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933471616
00000100:00100000:2.0:1789431562.644578:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933471616
00000100:00100000:2.0:1789431562.644670:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14342
00000100:00100000:2.0:1789431562.644683:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a045880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+314:2350:x1876351933471616:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431562.644706:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431562.644751:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525c6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109b7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b81 expref: 314 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.644773:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109b7:0x0].0x0 (ffff90ce0be62c00)
00010000:00010000:2.0:1789431562.644779:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431562.644846:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a045880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:2350:x1876351933471616:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 165us (874us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.644855:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14342
00000100:00100000:2.0:1789431562.645233:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.645487:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933471872
00000100:00100000:3.0:1789431562.645494:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933471872
00000100:00100000:3.0:1789431562.645539:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295937
00000100:00100000:3.0:1789431562.645549:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14617:x1876351933471872:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431562.645614:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0
00010000:00010000:0.0:1789431562.645620:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525c41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.645632:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6351205a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109b7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2918 expref: 313 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.645641:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525c41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.645648:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525c41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.645651:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613a00/0xd8e438fb63511ec4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x109b7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c289a expref: 312 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.645656:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.645661:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525c41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.645661:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109b7:0x0].0x0 (ffff90ce0be62c00)
00010000:00010000:0.0:1789431562.645669:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525c41 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.645679:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1007f:0x0].0x220bffe4 (ffff90cf13195500)
00010000:00010000:3.0:1789431562.645679:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525bfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b73 expref: 311 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.645682:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.645686:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525c41 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.645693:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525c41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1007f:0x0].0x220bffe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.645694:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431562.645698:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431562.645722:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525c72 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.645755:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525c72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.645767:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525c72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.645784:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525c79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.645791:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525c79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.645797:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525c79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.646154:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525c80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x109b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.646164:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525c80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.646171:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525c80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431562.647894:0:12775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1221, 64 off86400
00010000:00010000:3.0:1789431562.647990:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525c87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x109b7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648010:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525c87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109b7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648022:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525c87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109b7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648033:0:12775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525c87 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109b7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648040:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525c87 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109b7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648080:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525c87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109b7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648105:0:12775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431562.648134:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525c80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109b7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648140:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525c80 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x109b7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648147:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525c80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109b7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648153:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.648158:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525c80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109b7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648167:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525c80 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x109b7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648182:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109b7:0x0].0x0 (ffff90cf18b78100)
00010000:00010000:3.0:1789431562.648185:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431562.648191:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525c80 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x109b7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648199:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525c80 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x109b7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648223:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525c72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648230:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525c72 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648236:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525c72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648242:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.648246:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525c72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648252:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525c72 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648260:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431562.648262:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.648265:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525c72 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.648271:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525c72 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431562.648286:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000374adf32 reply state 00000000e72a899d transno 4295120951 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525c79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.648296:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431562.648417:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933471872:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2864us (3179us total) trans 4295120951 rc 0/0
00000100:00100000:3.0:1789431562.648427:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295937
00010000:00010000:0.0:1789431562.649367:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431562.649379:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525c87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109b7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.649389:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431562.649392:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525c87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109b7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.649407:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525c87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109b7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.649420:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109b7:0x0].0x0 (ffff90cf18b78100)
00010000:00010000:0.0:1789431562.649423:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431562.649428:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525c87 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x109b7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.649434:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63525c87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x109b7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.649456:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.649458:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.649460:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431562.654974:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431562.655978:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525c79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.655994:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525c79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.656004:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525c79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.656010:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.656015:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525c79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.656024:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525c79 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.656088:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90cf18b78700)
00010000:00010000:1.0:1789431562.656092:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.656099:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525c79 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.656105:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63525c79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.656530:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933472000
00000100:00100000:2.0:1789431562.656546:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933472000
00000100:00100000:2.0:1789431562.656645:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295938
00000100:00100000:2.0:1789431562.656657:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933472000:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.656690:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.656713:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525c8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b88 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.656811:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525c95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.656829:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525c95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.656844:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525c95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.656863:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525c9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10086:0x0].0xa12f67b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.656870:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.656875:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.657174:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525c95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.657183:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525c95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.657190:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525c95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.657196:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb18600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.657199:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525c95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.657206:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525c95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.657217:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0x0 (ffff90ce27a57400)
00010000:00010000:2.0:1789431562.657220:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.657225:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525c95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.657231:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525c95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.657248:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.657255:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525c9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.657261:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525c9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.657267:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.657270:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525c9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.657277:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525c9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.657284:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0xa12f67b5 (ffff90cf13195700)
00010000:00010000:2.0:1789431562.657287:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.657289:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525c9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10086:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.657296:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525c9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10086:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.657338:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525c8e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b88 expref: 311 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.657350:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0x0 (ffff90ce27a57400)
00010000:00010000:2.0:1789431562.657353:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.657356:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525c8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b88 expref: 311 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.657366:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb19800, rc 0)
00000100:00100000:2.0:1789431562.657460:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933472000:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 805us (2501us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431562.657469:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295938
00000100:00100000:3.0:1789431562.657657:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.658027:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933472128
00000100:00100000:2.0:1789431562.658035:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933472128
00000100:00100000:2.0:1789431562.658119:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295939
00000100:00100000:2.0:1789431562.658130:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933472128:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.658161:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.658177:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ca3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b8f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658249:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525caa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658262:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525caa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658273:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525caa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658289:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658296:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658303:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658412:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525cb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x109c3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658422:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109c3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658429:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109c3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431562.658474:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x109c3:0x0]: returning size 77076
00000004:00200000:2.0:1789431562.658480:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431562.658503:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109c3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658516:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109c3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658524:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525caa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658531:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525caa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658539:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525caa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658545:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bad0400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.658549:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525caa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658556:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525caa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658568:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431562.658571:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.658576:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525caa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658582:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525caa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658593:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658603:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658609:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658615:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.658617:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658624:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658751:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90cf13195c00)
00010000:00010000:2.0:1789431562.658755:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.658759:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658765:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658798:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525ca3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b8f expref: 312 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658813:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x109c3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b8f expref: 311 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.658820:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109c3:0x0].0x0 (ffff90ce0be62b00)
00010000:00010000:2.0:1789431562.658822:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431562.658825:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62de00, rc 0)
00000100:00100000:2.0:1789431562.658882:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933472128:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 752us (1224us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.658890:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295939
00000100:00100000:1.0:1789431562.663829:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.664139:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933472256
00000100:00100000:3.0:1789431562.664153:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933472256
00000100:00100000:0.0:1789431562.664417:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14343
00000100:00100000:0.0:1789431562.664434:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:2349:x1876351933472256:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431562.664458:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431562.664497:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525cb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109c3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b8f expref: 311 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.664528:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109c3:0x0].0x0 (ffff90ce0be62b00)
00010000:00010000:0.0:1789431562.664535:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431562.664616:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:2349:x1876351933472256:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 187us (801us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.664623:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14343
00000100:00100000:2.0:1789431562.664753:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.664788:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933472384
00000100:00100000:2.0:1789431562.664793:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933472384
00000100:00100000:2.0:1789431562.664830:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295940
00000100:00100000:2.0:1789431562.664838:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933472384:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.664859:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.664879:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525cbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b96 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.664960:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525cc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10086:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.664978:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.664992:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431562.665041:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10086:0x0]: returning size 16384
00000004:00200000:2.0:1789431562.665045:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431562.665091:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.665119:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525cbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b96 expref: 312 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.665139:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b96 expref: 311 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.665148:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0x0 (ffff90ce27a57400)
00010000:00010000:2.0:1789431562.665151:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:2.0:1789431562.665154:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62c400, rc 0)
00000100:00100000:2.0:1789431562.665183:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933472384:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 346us (431us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.665189:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295940
00000100:00100000:1.0:1789431562.672322:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.672411:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933472512
00000100:00100000:2.0:1789431562.672426:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933472512
00000100:00100000:2.0:1789431562.672500:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12464
00000100:00100000:2.0:1789431562.672511:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933472512:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431562.677259:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.677434:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933472768
00000100:00100000:1.0:1789431562.677451:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933472768
00000100:00100000:1.0:1789431562.677580:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295941
00000100:00100000:1.0:1789431562.677611:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14617:x1876351933472768:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431562.677712:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:1.0:1789431562.677759:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613400/0xd8e438fb635135e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109c3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2fa8 expref: 313 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.677792:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612200/0xd8e438fb63513465 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x109c3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2f38 expref: 312 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.677805:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109c3:0x0].0x0 (ffff90ce0be62b00)
00010000:00010000:1.0:1789431562.677822:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431562.677854:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ccd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.677872:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ccd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.677884:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ccd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.677902:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525cd4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.677909:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.677918:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.678111:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525cdb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x109c3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.678130:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525cdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.678139:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525cdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431562.679563:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1222, 64 off86464
00010000:00010000:1.0:1789431562.679811:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525ce2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x109c3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.679831:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525ce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109c3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.679842:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525ce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109c3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.679852:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525ce2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109c3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.679858:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525ce2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109c3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.679864:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525ce2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109c3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.679893:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:3.0:1789431562.679893:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933472512:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 7378us (7580us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431562.679905:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12464
00010000:00010000:1.0:1789431562.679920:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431562.679926:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525ce2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109c3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.679932:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431562.679937:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525ce2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109c3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.679945:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525ce2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109c3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.679958:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109c3:0x0].0x0 (ffff90ce03149b00)
00010000:00010000:1.0:1789431562.679961:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431562.679966:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525ce2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x109c3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.679972:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525ce2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x109c3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.679987:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431562.679989:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431562.679991:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431562.680003:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525cdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.680009:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525cdb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x109c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.680015:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525cdb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.680019:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.680025:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525cdb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.680032:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525cdb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x109c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.680039:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109c3:0x0].0x0 (ffff90ce03149b00)
00010000:00010000:1.0:1789431562.680042:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431562.680044:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525cdb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x109c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.680079:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525cdb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x109c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.680101:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ccd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.680108:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ccd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.680114:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ccd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.680125:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.680128:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ccd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.680134:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ccd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.680143:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431562.680145:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.680149:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ccd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.680154:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ccd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431562.680164:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003c257349 reply state 0000000049927f21 transno 4295120952 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.680172:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431562.680219:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933472768:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2621us (2978us total) trans 4295120952 rc 0/0
00000100:00100000:1.0:1789431562.680296:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295941
00010000:00010000:0.0:1789431562.683346:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.683375:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525cd4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.683384:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525cd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.683391:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.683397:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525cd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.683407:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525cd4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.683429:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90ce03149e00)
00010000:00010000:0.0:1789431562.683433:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.683440:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525cd4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.683447:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525cd4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.688363:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.688433:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.688538:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933473024
00000100:00100000:2.0:1789431562.688553:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933473024
00000100:00100000:2.0:1789431562.688623:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933472896
00000100:00100000:2.0:1789431562.688627:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933472896
00000100:00100000:2.0:1789431562.688743:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295942
00000100:00100000:2.0:1789431562.688756:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933473024:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.688791:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.688820:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525ce9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ba4 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.688911:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cf0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.688940:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.688954:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.688972:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525cf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10099:0x0].0xa12f67b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.688980:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.688987:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689281:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689291:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cf0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689298:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689304:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.689309:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689318:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cf0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689336:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0x0 (ffff90ce15f0ee00)
00010000:00010000:2.0:1789431562.689340:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.689345:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689352:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525cf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689364:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689371:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525cf7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689376:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689380:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.689383:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689389:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525cf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689396:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0xa12f67b5 (ffff90cf13195c00)
00010000:00010000:2.0:1789431562.689398:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.689401:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525cf7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10099:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689406:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525cf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10099:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689443:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525ce9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ba4 expref: 312 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689455:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0x0 (ffff90ce15f0ee00)
00010000:00010000:2.0:1789431562.689457:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.689461:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525ce9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ba4 expref: 312 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689471:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62d200, rc 0)
00000100:00100000:2.0:1789431562.689552:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933473024:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 798us (1206us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431562.689560:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295942
00000100:00100000:2.0:1789431562.689585:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295943
00000100:00100000:2.0:1789431562.689595:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933472896:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.689604:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.689615:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525cfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8b9d expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689657:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525d05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689668:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525d05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689676:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525d05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689694:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689701:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689708:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689888:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525d13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a0f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689899:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a0f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.689907:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a0f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431562.689953:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10a0f:0x0]: returning size 88384
00000004:00200000:2.0:1789431562.689959:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431562.689985:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a0f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.690000:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a0f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.690008:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525d05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.690014:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525d05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.690026:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525d05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.690031:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bad0400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.690035:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525d05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.690043:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525d05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.690081:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0x0 (ffff90ce27a57400)
00010000:00010000:2.0:1789431562.690148:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.690153:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525d05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.690159:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525d05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.690169:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.690174:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.690180:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.690185:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.690187:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.690198:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.690205:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0x1e68dc46 (ffff90cf13195700)
00010000:00010000:2.0:1789431562.690206:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.690209:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.690214:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.690242:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525cfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b9d expref: 312 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.690254:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525d13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a0f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b9d expref: 311 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.690262:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a0f:0x0].0x0 (ffff90cf03e3d500)
00010000:00010000:2.0:1789431562.690265:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431562.690267:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bb19800, rc 0)
00000100:00100000:2.0:1789431562.690349:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933472896:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 756us (1915us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.690359:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295943
00000100:00100000:2.0:1789431562.699297:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.699352:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.699373:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933473152
00000100:00100000:1.0:1789431562.699387:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933473152
00000100:00100000:1.0:1789431562.699459:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295944
00000100:00100000:1.0:1789431562.699470:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933473152:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431562.699499:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431562.699533:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8bab expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.699602:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933473280
00000100:00100000:3.0:1789431562.699607:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933473280
00010000:00010000:1.0:1789431562.699638:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525d21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10099:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.699647:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14344
00000100:00100000:3.0:1789431562.699654:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:2347:x1876351933473280:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431562.699657:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.699665:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431562.699672:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.699685:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525d13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a0f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b9d expref: 313 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.699702:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a0f:0x0].0x0 (ffff90cf03e3d500)
00010000:00010000:3.0:1789431562.699709:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000004:00200000:1.0:1789431562.699719:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10099:0x0]: returning size 16384
00000004:00200000:1.0:1789431562.699723:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000100:00100000:3.0:1789431562.699790:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+312:2347:x1876351933473280:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 136us (437us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431562.699803:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14344
00000004:00010000:1.0:1789431562.699832:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.699862:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bab expref: 312 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.699876:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525d21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bab expref: 311 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.699883:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0x0 (ffff90ce15f0ee00)
00010000:00010000:1.0:1789431562.699886:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431562.699889:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309200, rc 0)
00000100:00100000:1.0:1789431562.699916:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933473152:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 448us (637us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431562.699922:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295944
00000100:00100000:2.0:1789431562.702178:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.702304:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933473536
00000100:00100000:0.0:1789431562.702318:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933473536
00000100:00100000:0.0:1789431562.702387:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295945
00000100:00100000:0.0:1789431562.702399:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933473536:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431562.702470:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0
00010000:00010000:0.0:1789431562.702504:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6351dc2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a0f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c64e5 expref: 311 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.702531:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6351d89f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10a0f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c63e9 expref: 310 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.702545:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a0f:0x0].0x0 (ffff90cf03e3d500)
00010000:00010000:0.0:1789431562.702565:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525cc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10086:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8b96 expref: 309 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.702844:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0x0 (ffff90ce27a57400)
00010000:00010000:0.0:1789431562.702848:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431562.702875:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525d28 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.702894:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525d28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.702907:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525d28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.702923:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525d2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.702931:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525d2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.702939:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525d2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.703312:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525d36 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a0f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.703326:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525d36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a0f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.703333:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525d36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a0f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:0.0:1789431562.704031:0:12775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1223, 64 off86528
00010000:00010000:0.0:1789431562.704141:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525d3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a0f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704154:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a0f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704163:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a0f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704171:0:12775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525d3d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a0f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704178:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525d3d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a0f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704185:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525d3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a0f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704214:0:12775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431562.704240:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525d36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a0f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704245:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525d36 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a0f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704255:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525d36 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a0f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704262:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ace00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.704266:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525d36 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a0f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704274:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525d36 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a0f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704287:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a0f:0x0].0x0 (ffff90ce07190200)
00010000:00010000:0.0:1789431562.704290:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431562.704295:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525d36 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a0f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704301:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525d36 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a0f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704333:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525d28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704339:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525d28 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704346:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525d28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704351:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.704354:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525d28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704364:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525d28 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704372:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0x0 (ffff90ce27a57400)
00010000:00010000:0.0:1789431562.704374:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.704377:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525d28 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.704383:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525d28 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431562.704393:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004de1596f reply state 00000000d77651e8 transno 4295120953 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525d2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.704402:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431562.704522:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933473536:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2122us (2358us total) trans 4295120953 rc 0/0
00000100:00100000:0.0:1789431562.704532:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295945
00010000:00010000:2.0:1789431562.705621:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431562.705636:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525d3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a0f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.705648:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431562.705652:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525d3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a0f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.705661:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525d3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a0f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.705677:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a0f:0x0].0x0 (ffff90ce07190200)
00010000:00010000:2.0:1789431562.705679:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431562.705684:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525d3d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a0f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.705690:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525d3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a0f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.705718:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.705720:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.705722:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431562.712581:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.712721:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933473664
00000100:00100000:1.0:1789431562.712745:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933473664
00000100:00100000:1.0:1789431562.712823:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12465
00000100:00100000:1.0:1789431562.712836:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933473664:12345-192.168.203.4@tcp:37:dbench.0
00010000:00010000:3.0:1789431562.714325:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525d2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.714352:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525d2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.714362:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525d2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.714369:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.714375:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525d2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.714385:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525d2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.714409:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0x1e68dc46 (ffff90ce07190100)
00010000:00010000:3.0:1789431562.714412:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.714418:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525d2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.714425:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525d2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10086:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.718039:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933473664:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 5187us (5454us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431562.725549:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12465
00000100:00100000:0.0:1789431562.726093:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.726136:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933473920
00000100:00100000:1.0:1789431562.726150:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933473920
00000100:00100000:1.0:1789431562.726223:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295946
00000100:00100000:1.0:1789431562.726235:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf33177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933473920:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431562.726330:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431562.726367:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb6351d025 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a05:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6134 expref: 309 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.726399:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a05:0x0].0x0 (ffff90cf22548800)
00010000:00010000:1.0:1789431562.726412:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431562.726442:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d44 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.726461:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.726473:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.726492:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10086:0x0].0x91184568 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.726499:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.726506:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.726666:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d52 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a05:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.726674:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a05:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.726681:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a05:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431562.727401:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1224, 64 off86592
00010000:00010000:1.0:1789431562.727475:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525d59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a05:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.727490:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525d59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a05:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.727500:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525d59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a05:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.727509:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525d59 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a05:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.727517:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525d59 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a05:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.727524:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525d59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a05:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.727551:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431562.727576:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a05:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.727582:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d52 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a05:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.727590:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a05:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.727596:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.727601:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a05:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.727609:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d52 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a05:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.727621:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a05:0x0].0x0 (ffff90ce03149600)
00010000:00010000:1.0:1789431562.727624:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431562.727629:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d52 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a05:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.727635:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d52 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a05:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.727644:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431562.727652:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525d59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a05:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.727655:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.727659:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431562.727662:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d44 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.727663:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525d59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a05:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.727668:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.727670:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525d59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a05:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.727672:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.727675:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.727680:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a05:0x0].0x0 (ffff90ce03149600)
00010000:00010000:1.0:1789431562.727681:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d44 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.727682:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431562.727685:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525d59 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a05:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.727688:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0x0 (ffff90ce27a57400)
00010000:00010000:1.0:1789431562.727690:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.727692:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525d59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a05:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.727693:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d44 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.727699:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d44 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.727706:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.727708:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.727710:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00010000:1.0:1789431562.727713:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000047ad36e9 reply state 00000000e57ed261 transno 4295120954 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.727722:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431562.727842:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf33177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933473920:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1605us (1747us total) trans 4295120954 rc 0/0
00000100:00100000:1.0:1789431562.727852:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295946
00000100:00100000:0.0:1789431562.734600:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431562.734714:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.734741:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.734750:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.734757:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.734763:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.734772:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.734794:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0x91184568 (ffff90ce03149b00)
00010000:00010000:1.0:1789431562.734798:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.734804:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10086:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.734811:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10086:0x0].0x91184568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.736880:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933474176
00000100:00100000:2.0:1789431562.736902:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933474176
00000100:00100000:2.0:1789431562.736998:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295947
00000100:00100000:2.0:1789431562.737011:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933474176:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431562.737136:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431562.737170:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf18a57c00/0xd8e438fb6352147a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c76c7 expref: 309 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.737194:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a50:0x0].0x0 (ffff90ce0f6c6d00)
00010000:00010000:2.0:1789431562.737216:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525d21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10099:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bab expref: 308 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.737237:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0x0 (ffff90ce15f0ee00)
00010000:00010000:2.0:1789431562.737243:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431562.737270:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d60 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.737288:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.737300:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.737317:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525d67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10099:0x0].0x7ca69afa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.737324:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525d67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10099:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.737330:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525d67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10099:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.737882:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d6e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.737893:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.737901:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431562.742279:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1223, 64 off86464
00010000:00010000:2.0:1789431562.742392:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742415:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742430:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742440:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d75 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742448:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d75 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742455:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742475:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431562.742502:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742508:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d6e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742514:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d6e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742519:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb18600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.742524:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d6e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742532:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d6e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742547:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a50:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:2.0:1789431562.742550:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431562.742555:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d6e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742561:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d6e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742585:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742592:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d60 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742598:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d60 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742603:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.742606:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d60 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742613:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d60 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742620:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0x0 (ffff90ce15f0ee00)
00010000:00010000:2.0:1789431562.742623:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.742627:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d60 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.742637:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d60 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431562.742647:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004bf0a400 reply state 000000005d2d165c transno 4295120955 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525d67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10099:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.742657:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431562.742806:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933474176:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 5789us (8215us total) trans 4295120955 rc 0/0
00000100:00100000:2.0:1789431562.742817:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295947
00010000:00010000:0.0:1789431562.743165:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431562.743177:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.743185:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431562.743188:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.743195:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.743205:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a50:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:0.0:1789431562.743208:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431562.743211:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d75 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.743216:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525d75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.743248:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.743250:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.743252:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431562.746757:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525d67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10099:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.746783:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525d67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.746794:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525d67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.746801:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb18800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.746807:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525d67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.746816:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525d67 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.746836:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0x7ca69afa (ffff90cf13195700)
00010000:00010000:1.0:1789431562.746840:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.746846:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525d67 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10099:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.746853:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525d67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10099:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.759339:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.759498:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933474432
00000100:00100000:2.0:1789431562.759514:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933474432
00000100:00100000:2.0:1789431562.759597:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295948
00000100:00100000:2.0:1789431562.759616:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933474432:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431562.759704:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431562.759752:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6351d51f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a0c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c62bc expref: 308 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.759778:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a0c:0x0].0x0 (ffff90cf22548900)
00010000:00010000:2.0:1789431562.759793:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431562.759823:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.759841:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.759852:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.759874:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10086:0x0].0xba61c71c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.759881:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.759887:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.760037:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525d8a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a0c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.760094:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525d8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a0c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.760105:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525d8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a0c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431562.761528:0:12775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1224, 64 off86528
00000100:00100000:0.0:1789431562.761551:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.761746:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933474688
00000100:00100000:1.0:1789431562.761758:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933474688
00000100:00100000:1.0:1789431562.761821:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295949
00000100:00100000:1.0:1789431562.761833:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933474688:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431562.761895:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431562.761926:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2f400/0xd8e438fb63521ced lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c798a expref: 309 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.761944:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a55:0x0].0x0 (ffff90ce2d731300)
00010000:00010000:1.0:1789431562.761954:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431562.761978:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d91 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.761993:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.762004:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.762018:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10099:0x0].0xe5e25d80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.762025:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10099:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.762031:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10099:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.762147:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.762156:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.762163:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763135:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525da6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a0c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763151:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525da6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a0c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763161:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525da6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a0c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763170:0:12775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525da6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a0c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763177:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525da6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a0c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763184:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525da6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a0c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763271:0:12775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431562.763303:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525d8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a0c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763311:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525d8a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a0c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763318:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525d8a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a0c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763324:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.763328:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525d8a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a0c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763336:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525d8a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a0c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763347:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a0c:0x0].0x0 (ffff90cf13195200)
00010000:00010000:2.0:1789431562.763350:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431562.763355:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525d8a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a0c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763361:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525d8a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a0c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763383:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763394:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d7c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763400:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763404:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.763408:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763414:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763422:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0x0 (ffff90ce27a57400)
00010000:00010000:2.0:1789431562.763424:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.763427:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.763432:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525d7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431562.763442:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000403e0781 reply state 00000000bc209734 transno 4295120956 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.763452:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431562.763565:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933474432:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3955us (4241us total) trans 4295120956 rc 0/0
00000100:00100000:2.0:1789431562.763574:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295948
00010000:00010000:3.0:1789431562.765340:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431562.765358:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525da6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a0c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.765372:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431562.765376:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525da6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a0c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.765387:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525da6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a0c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.765409:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a0c:0x0].0x0 (ffff90cf13195200)
00010000:00010000:3.0:1789431562.765412:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431562.765418:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525da6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a0c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.765425:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525da6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a0c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.768106:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.768127:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.768135:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.768142:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb18600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.768147:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.768154:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.768178:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0xba61c71c (ffff90cf13195400)
00010000:00010000:3.0:1789431562.768181:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.768186:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10086:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.768193:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18600/0xd8e438fb63525d83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10086:0x0].0xba61c71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.768541:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.768546:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.768550:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000040:00080000:1.0:1789431562.773347:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1225, 64 off86656
00010000:00010000:1.0:1789431562.773471:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525dad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.773494:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525dad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.773511:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525dad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.773522:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525dad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.773529:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525dad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.773537:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525dad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.773661:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431562.773696:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.773703:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d9f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.773712:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.773718:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.773723:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.773743:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d9f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.773821:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431562.773830:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525dad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a55:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.773838:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431562.773842:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525dad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a55:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.773849:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525dad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a55:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.773866:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a55:0x0].0x0 (ffff90ce03149100)
00010000:00010000:2.0:1789431562.773869:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431562.773876:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525dad lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a55:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.773882:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525dad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a55:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.773899:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.773901:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.773902:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431562.773939:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a55:0x0].0x0 (ffff90ce03149100)
00010000:00010000:1.0:1789431562.773941:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431562.773945:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d9f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.773953:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525d9f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.773979:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.773987:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d91 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.773994:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.773999:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.774003:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.774010:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d91 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.774018:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0x0 (ffff90ce15f0ee00)
00010000:00010000:1.0:1789431562.774020:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.774024:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d91 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.774035:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525d91 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431562.774184:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009a31d719 reply state 00000000bc628e14 transno 4295120957 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10099:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.774197:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431562.774401:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933474688:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 12564us (12848us total) trans 4295120957 rc 0/0
00000100:00100000:1.0:1789431562.774412:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295949
00000100:00100000:0.0:1789431562.780311:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.780360:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431562.781608:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10099:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.781697:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.781707:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.781715:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.781721:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.781743:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.781767:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0xe5e25d80 (ffff90ce03149b00)
00010000:00010000:1.0:1789431562.781771:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.781777:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10099:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.781785:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525d98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10099:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.782356:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933474944
00000100:00100000:2.0:1789431562.782371:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933474944
00000100:00100000:2.0:1789431562.782441:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933475072
00000100:00100000:2.0:1789431562.782444:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933475072
00000100:00100000:2.0:1789431562.782486:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295950
00000100:00100000:2.0:1789431562.782499:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933474944:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431562.782592:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431562.782622:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6351d748 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a0e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6364 expref: 309 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.782637:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a0e:0x0].0x0 (ffff90cf06585c00)
00010000:00010000:2.0:1789431562.782648:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431562.782675:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525db4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.782691:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525db4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.782703:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525db4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.782719:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525dbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10086:0x0].0xdb4ed787 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.782725:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525dbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.782742:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525dbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.782899:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525dc2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a0e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.782913:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525dc2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a0e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.782921:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525dc2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a0e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431562.783649:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1225, 64 off86592
00010000:00010000:2.0:1789431562.783726:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525dc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a0e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.783752:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525dc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a0e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.783761:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525dc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a0e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.783770:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525dc9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a0e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.783778:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525dc9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a0e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.783785:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525dc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a0e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.783815:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431562.783842:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431562.783849:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525dc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a0e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.783856:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb18800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431562.783860:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525dc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a0e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.783869:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525dc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a0e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.783880:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a0e:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431562.783883:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431562.783888:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525dc9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a0e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.783894:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb18800/0xd8e438fb63525dc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a0e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.783907:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.783909:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.783910:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.783928:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525dc2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a0e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.783934:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525dc2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a0e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.783939:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525dc2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a0e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.783944:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.783947:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525dc2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a0e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.783953:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525dc2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a0e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.783960:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a0e:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431562.783962:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431562.783965:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525dc2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a0e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.783971:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19000/0xd8e438fb63525dc2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a0e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.783996:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525db4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784003:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525db4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784009:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525db4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784014:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.784018:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525db4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784024:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525db4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784032:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0x0 (ffff90ce27a57400)
00010000:00010000:2.0:1789431562.784039:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.784042:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525db4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784076:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19a00/0xd8e438fb63525db4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431562.784086:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000643dd468 reply state 00000000d86bb9df transno 4295120958 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525dbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.784096:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431562.784204:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933474944:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1705us (3906us total) trans 4295120958 rc 0/0
00000100:00100000:2.0:1789431562.784216:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295950
00000100:00100000:2.0:1789431562.784252:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295951
00000100:00100000:2.0:1789431562.784265:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933475072:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.784284:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.784298:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525dd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8bb2 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784362:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525dd7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784373:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784381:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784396:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784404:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784411:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784493:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525de5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784501:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a4b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784508:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a4b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431562.784544:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10a4b:0x0]: returning size 10438
00000004:00200000:2.0:1789431562.784549:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431562.784565:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a4b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784576:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784583:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784589:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525dd7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784595:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784601:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bad0400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.784604:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784611:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525dd7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784620:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0x0 (ffff90ce15f0ee00)
00010000:00010000:2.0:1789431562.784623:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.784626:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525dd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784636:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525dd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784646:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784652:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dde lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784658:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784664:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.784666:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784672:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784679:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0xc4d44c31 (ffff90cf13195300)
00010000:00010000:2.0:1789431562.784682:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.784685:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dde lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784691:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784720:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19400/0xd8e438fb63525dd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bb2 expref: 311 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784754:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525de5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bb2 expref: 310 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.784761:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a4b:0x0].0x0 (ffff90cf13195b00)
00010000:00010000:2.0:1789431562.784763:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431562.784765:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62cc00, rc 0)
00000100:00100000:2.0:1789431562.784793:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933475072:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 533us (4432us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.784800:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295951
00010000:00010000:3.0:1789431562.790544:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525dbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.790572:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525dbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.790843:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525dbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.790853:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bb19800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.790859:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525dbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.790869:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525dbb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.790890:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0xdb4ed787 (ffff90cf13195600)
00010000:00010000:3.0:1789431562.790894:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.790900:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525dbb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10086:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.790908:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb19800/0xd8e438fb63525dbb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10086:0x0].0xdb4ed787 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.796293:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.797425:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933475328
00000100:00100000:2.0:1789431562.797440:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933475328
00000100:00100000:2.0:1789431562.797521:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295952
00000100:00100000:2.0:1789431562.797531:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933475328:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431562.797612:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431562.797644:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525de5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bb2 expref: 309 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.797667:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a4b:0x0].0x0 (ffff90cf13195b00)
00010000:00010000:2.0:1789431562.797680:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431562.797705:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.797721:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.797740:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.797757:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525df3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.797764:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525df3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.797771:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525df3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.797904:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525dfa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.797911:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525dfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.797917:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525dfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431562.798964:0:12775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1226, 64 off86720
00010000:00010000:2.0:1789431562.800802:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525e01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.800835:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525e01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.800850:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525e01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.800863:0:12775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525e01 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.800871:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525e01 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.800879:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525e01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.800967:0:12775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431562.801005:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525dfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.801011:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525dfa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.801017:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525dfa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.801023:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.801027:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525dfa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.801036:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525dfa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.801067:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a4b:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431562.801071:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431562.801076:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525dfa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.801082:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525dfa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.801111:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.801121:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.801127:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.801132:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.801135:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.801140:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.801147:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0x0 (ffff90ce15f0ee00)
00010000:00010000:2.0:1789431562.801149:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.801152:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.801158:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63525dec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431562.801169:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000044fe4769 reply state 000000009c81945d transno 4295120959 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525df3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.801180:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431562.801329:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933475328:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3793us (5050us total) trans 4295120959 rc 0/0
00000100:00100000:2.0:1789431562.801339:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295952
00010000:00010000:0.0:1789431562.802860:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431562.802875:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525e01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.802888:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431562.802892:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525e01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.802903:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525e01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.802921:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a4b:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:0.0:1789431562.802925:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431562.802931:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525e01 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.802938:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525e01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.802961:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.802963:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.802965:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431562.809960:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.810041:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933475456
00000100:00100000:2.0:1789431562.810104:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933475456
00000100:00100000:2.0:1789431562.810172:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295953
00000100:00100000:2.0:1789431562.810185:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933475456:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.810221:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431562.810259:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525e08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8bb9 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810352:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e0f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810370:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810384:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810403:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810411:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810419:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810554:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525e1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810563:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a53:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810571:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a53:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431562.810632:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10a53:0x0]: returning size 29253
00000004:00200000:2.0:1789431562.810638:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431562.810661:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a53:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810675:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810683:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810690:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e0f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810697:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810703:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bad0400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.810708:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810717:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e0f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810739:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0x0 (ffff90ce15f0ee00)
00010000:00010000:2.0:1789431562.810743:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.810750:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810757:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810777:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810784:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810790:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810796:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.810799:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810804:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810811:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0x586f5504 (ffff90cf13195b00)
00010000:00010000:2.0:1789431562.810814:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.810817:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810824:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810860:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525e08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bb9 expref: 312 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810877:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525e1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bb9 expref: 311 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.810891:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a53:0x0].0x0 (ffff90cf13195600)
00010000:00010000:2.0:1789431562.810894:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431562.810896:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce249e1000, rc 0)
00000100:00100000:2.0:1789431562.810967:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933475456:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 784us (1022us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431562.810975:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295953
00010000:00010000:3.0:1789431562.812132:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525df3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.812150:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525df3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.812157:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525df3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.812164:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.812169:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525df3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.812177:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525df3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.812194:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0xc4d44c31 (ffff90cf13195300)
00010000:00010000:3.0:1789431562.812198:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.812202:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525df3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.812208:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525df3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10099:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.820756:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.820910:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933475584
00000100:00100000:0.0:1789431562.820925:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933475584
00000100:00100000:0.0:1789431562.821001:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295954
00000100:00100000:0.0:1789431562.821013:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933475584:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431562.821039:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431562.821092:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525e24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8bc0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821180:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525e2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821198:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525e2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821211:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525e2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821228:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525e32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821235:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525e32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821243:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525e32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821510:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525e39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821520:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821528:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431562.821572:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10a17:0x0]: returning size 42652
00000004:00200000:0.0:1789431562.821577:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431562.821601:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821614:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821634:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525e2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821641:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525e2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821648:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525e2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821655:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ace00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.821660:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525e2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821669:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525e2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821683:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0x0 (ffff90ce27a57400)
00010000:00010000:0.0:1789431562.821686:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.821692:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525e2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821703:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63525e2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821717:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525e32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821725:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525e32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821740:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525e32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821745:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.821748:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525e32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821754:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525e32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821761:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0x193cfbd6 (ffff90ce07190100)
00010000:00010000:0.0:1789431562.821763:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.821766:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525e32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821771:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525e32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821808:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525e24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bc0 expref: 312 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821828:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525e39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bc0 expref: 311 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.821835:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a17:0x0].0x0 (ffff90ce032a1100)
00010000:00010000:0.0:1789431562.821838:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431562.821841:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7acc00, rc 0)
00000100:00100000:0.0:1789431562.821917:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933475584:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 905us (1189us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.821925:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295954
00000100:00100000:0.0:1789431562.824925:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.827820:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933475840
00000100:00100000:1.0:1789431562.827846:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933475840
00000100:00100000:1.0:1789431562.828006:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295955
00000100:00100000:1.0:1789431562.828019:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933475840:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431562.828122:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431562.828160:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1000/0xd8e438fb63525e1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a53:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bb9 expref: 311 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.828185:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a53:0x0].0x0 (ffff90cf13195600)
00010000:00010000:1.0:1789431562.828201:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431562.828555:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525e40 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.828574:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525e40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.828586:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525e40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.828608:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525e47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.828616:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525e47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.828623:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525e47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.828784:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525e4e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.828795:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525e4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.828803:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525e4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.830142:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.830236:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.830327:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933476224
00000100:00100000:2.0:1789431562.830339:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933476224
00000100:00100000:2.0:1789431562.830402:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295956
00000100:00100000:2.0:1789431562.830413:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933476224:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431562.830477:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00000040:00080000:0.0:1789431562.830486:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1227, 64 off86784
00010000:00010000:2.0:1789431562.830509:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f07200/0xd8e438fb6351e4a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6785 expref: 311 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.830532:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce20f06600/0xd8e438fb6351e2f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10a17:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6715 expref: 311 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.830542:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a17:0x0].0x0 (ffff90ce032a1100)
00010000:00010000:2.0:1789431562.830548:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431562.830568:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.830569:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525e5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a53:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.830584:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525e5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.830584:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.830595:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525e5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.830595:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.830604:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525e5c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.830611:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525e5c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.830611:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525e63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.830618:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525e63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.830619:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525e5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.830625:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525e63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.830650:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431562.830657:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431562.830663:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525e5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.830670:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431562.830671:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525e4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.830676:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525e4e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.830686:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525e4e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.830829:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933475968
00000100:00100000:3.0:1789431562.830834:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933475968
00000100:00100000:3.0:1789431562.830878:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14345
00000100:00100000:3.0:1789431562.830885:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:2350:x1876351933475968:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431562.830894:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431562.830905:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525e39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bc0 expref: 311 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.830915:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a17:0x0].0x0 (ffff90ce032a1100)
00010000:00010000:3.0:1789431562.830924:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431562.831306:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.831313:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525e4e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.831323:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525e4e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.831335:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a53:0x0].0x0 (ffff90ce07190400)
00010000:00010000:0.0:1789431562.831338:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431562.831342:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525e4e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.831348:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525e4e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.831369:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525e40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.831376:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525e40 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.831382:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525e40 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.831387:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.831389:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525e40 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.831399:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525e40 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.831407:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0x0 (ffff90ce15f0ee00)
00010000:00010000:0.0:1789431562.831409:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.831412:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525e40 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.831418:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525e40 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10099:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431562.831428:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001ff03746 reply state 000000006b1b7839 transno 4295120960 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525e47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.831437:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431562.831491:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933475840:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3475us (6580us total) trans 4295120960 rc 0/0
00000100:00100000:0.0:1789431562.831499:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295955
00000100:00100000:3.0:1789431562.831503:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:2350:x1876351933475968:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 370us (1121us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431562.831511:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14345
00010000:00010000:2.0:1789431562.831655:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525e5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.831664:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525e5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.831674:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a53:0x0].0x0 (ffff90ce07190400)
00010000:00010000:2.0:1789431562.831676:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431562.831680:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525e5c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.831685:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63525e5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.831702:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.831705:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.831707:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.831831:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0a00/0xd8e438fb63525e6a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.831843:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0a00/0xd8e438fb63525e6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.831852:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0a00/0xd8e438fb63525e6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431562.832887:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1228, 64 off86848
00010000:00010000:2.0:1789431562.832969:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.832984:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.832994:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.833003:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e71 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.833010:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e71 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.833016:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.833069:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431562.833095:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0a00/0xd8e438fb63525e6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.833098:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431562.833101:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0a00/0xd8e438fb63525e6a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.833106:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a17:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.833108:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0a00/0xd8e438fb63525e6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.833114:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bad0400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431562.833114:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e0a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.833117:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.833118:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0a00/0xd8e438fb63525e6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.833126:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a17:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.833127:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0a00/0xd8e438fb63525e6a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.833142:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a17:0x0].0x0 (ffff90cf13195400)
00010000:00010000:1.0:1789431562.833147:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431562.833150:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a17:0x0].0x0 (ffff90cf13195400)
00010000:00010000:1.0:1789431562.833152:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e71 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.833153:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431562.833156:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0a00/0xd8e438fb63525e6a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.833159:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a17:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.833162:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0a00/0xd8e438fb63525e6a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.833175:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431562.833177:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431562.833178:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.833180:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.833185:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e55 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.833191:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.833196:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.833199:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.833209:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.833217:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0x0 (ffff90ce27a57400)
00010000:00010000:2.0:1789431562.833219:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.833223:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e55 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.833229:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1a00/0xd8e438fb63525e55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431562.833240:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000089971db4 reply state 00000000fd207e31 transno 4295120961 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525e63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.833249:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431562.833353:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933476224:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2938us (3112us total) trans 4295120961 rc 0/0
00000100:00100000:2.0:1789431562.833362:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295956
00010000:00010000:3.0:1789431562.839701:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525e47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.839725:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525e47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.839743:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525e47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.839749:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.839755:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525e47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.839763:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525e47 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.839785:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10099:0x0].0x586f5504 (ffff90ce07190200)
00010000:00010000:3.0:1789431562.839789:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.839795:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525e47 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.839801:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525e47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10099:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.840172:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525e63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.840183:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525e63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.840189:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525e63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.840195:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce249e1200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.840199:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525e63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.840210:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525e63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.840220:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0x193cfbd6 (ffff90cf13195b00)
00010000:00010000:2.0:1789431562.840233:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.840239:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525e63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.840245:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e1200/0xd8e438fb63525e63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10086:0x0].0x193cfbd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.846410:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.846576:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933476352
00000100:00100000:1.0:1789431562.846591:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933476352
00000100:00100000:1.0:1789431562.846668:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295957
00000100:00100000:1.0:1789431562.846680:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933476352:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431562.846723:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431562.846768:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525e78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8bc7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.846855:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525e7f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.846874:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525e7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.846887:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525e7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.846903:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525e86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b1:0x0].0xa12f67b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.846910:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525e86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.846917:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525e86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.847223:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525e7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.847232:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525e7f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.847240:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525e7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.847246:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.847251:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525e7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.847516:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525e7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.847535:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b1:0x0].0x0 (ffff90ce363db500)
00010000:00010000:1.0:1789431562.847538:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.847546:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525e7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.847553:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525e7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.847569:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525e86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.847576:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525e86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.847584:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525e86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.847589:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.847592:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525e86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.847598:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525e86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.847605:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b1:0x0].0xa12f67b5 (ffff90ce03149b00)
00010000:00010000:1.0:1789431562.847608:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.847611:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525e86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.847617:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525e86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.847660:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525e78 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bc7 expref: 310 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.847672:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b1:0x0].0x0 (ffff90ce363db500)
00010000:00010000:1.0:1789431562.847675:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.847679:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525e78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bc7 expref: 310 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.847689:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309600, rc 0)
00000100:00100000:1.0:1789431562.847796:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933476352:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1117us (1401us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431562.847805:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295957
00000100:00100000:0.0:1789431562.861190:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.862406:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933476608
00000100:00100000:2.0:1789431562.862426:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933476608
00000100:00100000:2.0:1789431562.862524:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295958
00000100:00100000:2.0:1789431562.862537:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933476608:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431562.862772:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431562.862810:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce249e0000/0xd8e438fb6351e5f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c67e7 expref: 309 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.862835:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a1b:0x0].0x0 (ffff90ce211f4200)
00010000:00010000:2.0:1789431562.862850:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431562.862881:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.862899:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.862910:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.862928:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525e94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10086:0x0].0x28dc98c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.862935:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525e94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.862942:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525e94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.863178:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525e9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.863188:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525e9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.863196:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525e9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431562.865710:0:12775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1229, 64 off86912
00010000:00010000:2.0:1789431562.865827:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525ea2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.865849:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.865863:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.865873:0:12775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525ea2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.865879:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525ea2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.865886:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525ea2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.865911:0:12775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431562.865939:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525e9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.865945:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525e9b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.865952:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525e9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.865958:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.865964:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525e9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.865973:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525e9b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.865986:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a1b:0x0].0x0 (ffff90cf13195200)
00010000:00010000:2.0:1789431562.865990:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431562.865995:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525e9b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.866007:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525e9b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.866031:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.866042:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e8d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.866100:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.866106:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3bad0400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.866109:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.866115:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.866123:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0x0 (ffff90ce27a57400)
00010000:00010000:2.0:1789431562.866125:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.866128:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e8d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.866133:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63525e8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10086:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431562.866143:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008577e3cc reply state 0000000003147a12 transno 4295120962 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525e94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.866153:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431562.866285:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933476608:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3745us (5105us total) trans 4295120962 rc 0/0
00000100:00100000:2.0:1789431562.866296:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295958
00000100:00100000:3.0:1789431562.867357:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431562.868413:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431562.868426:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525ea2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.868437:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431562.868442:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525ea2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.868453:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525ea2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.868475:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a1b:0x0].0x0 (ffff90cf13195200)
00010000:00010000:0.0:1789431562.868478:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431562.868483:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525ea2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.868490:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525ea2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.868521:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.868524:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.868526:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431562.869534:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933476864
00000100:00100000:1.0:1789431562.869553:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933476864
00000100:00100000:1.0:1789431562.869757:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295959
00000100:00100000:1.0:1789431562.869771:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933476864:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431562.869845:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:1.0:1789431562.869876:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6351e9cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6937 expref: 310 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.869899:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a1e:0x0].0x0 (ffff90cf03dd3700)
00010000:00010000:1.0:1789431562.869916:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e75a00/0xd8e438fb6351fc16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6ef5 expref: 309 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.869927:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b1:0x0].0x0 (ffff90ce363db500)
00010000:00010000:1.0:1789431562.869931:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431562.869958:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525ea9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.869973:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525ea9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.869985:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525ea9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.870001:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525eb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b1:0x0].0x75c74963 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.870009:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.870018:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.870378:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525eb7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.870387:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525eb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.870396:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525eb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431562.871095:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1226, 64 off86656
00010000:00010000:1.0:1789431562.871171:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525ebe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871184:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871196:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871206:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525ebe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871214:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525ebe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871221:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525ebe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871238:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431562.871265:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525eb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871272:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525eb7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871279:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525eb7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871285:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.871290:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525eb7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871299:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525eb7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871310:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a1e:0x0].0x0 (ffff90ce03149100)
00010000:00010000:1.0:1789431562.871314:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431562.871320:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525eb7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871327:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525eb7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871348:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525ea9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871356:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525ea9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871362:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525ea9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871373:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.871377:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525ea9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871383:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525ea9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871390:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b1:0x0].0x0 (ffff90ce363db500)
00010000:00010000:1.0:1789431562.871393:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.871397:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525ea9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.871404:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525ea9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431562.871414:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000134d20c2 reply state 0000000028dd929d transno 4295120963 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.871422:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431562.871549:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933476864:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1776us (4193us total) trans 4295120963 rc 0/0
00000100:00100000:1.0:1789431562.871558:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295959
00010000:00010000:0.0:1789431562.871660:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431562.871669:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525ebe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.871676:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431562.871678:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525ebe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.871684:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525ebe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.871694:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a1e:0x0].0x0 (ffff90ce03149100)
00010000:00010000:0.0:1789431562.871696:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431562.871699:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525ebe lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.871704:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63525ebe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.871723:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.871725:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.871727:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431562.882562:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525e94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10086:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.882587:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525e94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.882596:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525e94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.882603:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62cc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.882609:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525e94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.882618:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525e94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10086:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.882639:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10086:0x0].0x28dc98c0 (ffff90cf13195b00)
00010000:00010000:3.0:1789431562.882643:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.882649:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525e94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10086:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.882656:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525e94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10086:0x0].0x28dc98c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.882725:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.882821:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933476992
00000100:00100000:3.0:1789431562.882833:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933476992
00010000:00010000:2.0:1789431562.882913:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.882918:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295960
00010000:00010000:2.0:1789431562.882926:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525eb0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.882930:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933476992:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431562.882933:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525eb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.882938:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.882942:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525eb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.882948:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525eb0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.882958:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b1:0x0].0x75c74963 (ffff90ce03149b00)
00010000:00010000:2.0:1789431562.882960:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.882964:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525eb0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b1:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.882969:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63525eb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b1:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.882969:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431562.882990:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525ec5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8bce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883127:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525ecc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883144:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525ecc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883157:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525ecc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883175:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525ed3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa12f67b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883188:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883195:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883702:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525ecc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883713:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525ecc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883719:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525ecc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883724:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.883728:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525ecc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883747:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525ecc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883759:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431562.883761:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.883765:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525ecc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883771:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525ecc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883782:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883788:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525ed3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883795:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883800:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.883803:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883809:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525ed3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883815:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa12f67b5 (ffff90cf13195700)
00010000:00010000:2.0:1789431562.883817:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.883820:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525ed3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883825:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525ed3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883864:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525ec5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bce expref: 309 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883876:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431562.883878:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.883881:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525ec5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bce expref: 309 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.883896:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb800, rc 0)
00000100:00100000:2.0:1789431562.885577:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933476992:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2631us (2839us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431562.885594:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295960
00000100:00100000:0.0:1789431562.890141:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.890238:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933477120
00000100:00100000:1.0:1789431562.890253:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933477120
00000100:00100000:1.0:1789431562.890491:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295961
00000100:00100000:1.0:1789431562.890506:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933477120:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431562.890543:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431562.890574:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525eda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8bd5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.890675:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525ee1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.890699:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.890713:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431562.890778:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008d:0x0]: returning size 16384
00000004:00200000:1.0:1789431562.890782:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431562.890805:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.890846:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63525eda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bd5 expref: 310 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.890877:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bd5 expref: 309 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.890888:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431562.890891:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431562.890895:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309000, rc 0)
00000100:00100000:1.0:1789431562.890982:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933477120:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 480us (854us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431562.890990:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295961
00000100:00100000:0.0:1789431562.897639:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.897742:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933477248
00000100:00100000:1.0:1789431562.897760:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933477248
00000100:00100000:1.0:1789431562.897835:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12466
00000100:00100000:1.0:1789431562.897849:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933477248:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431562.902468:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933477248:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 4604us (4824us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431562.902485:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12466
00000100:00100000:0.0:1789431562.912168:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.912313:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933477504
00000100:00100000:3.0:1789431562.912328:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933477504
00000100:00100000:3.0:1789431562.912594:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295962
00000100:00100000:3.0:1789431562.912607:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933477504:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431562.912637:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431562.912666:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ee8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8be3 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.912775:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525eef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.912793:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525eef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.912807:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525eef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.912822:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525ef6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.912828:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.912835:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.912971:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525efd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.912980:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525efd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a22:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.912987:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525efd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a22:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431562.913028:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10a22:0x0]: returning size 12543
00000004:00200000:3.0:1789431562.913032:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431562.913082:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525efd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a22:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.913096:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525efd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.913104:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525eef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.913111:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525eef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.913117:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525eef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.913123:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.913128:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525eef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.913137:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525eef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.913152:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b1:0x0].0x0 (ffff90ce363db500)
00010000:00010000:3.0:1789431562.913155:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.913161:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525eef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.913168:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525eef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.913183:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.913190:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525ef6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.913196:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.913201:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.913204:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.913209:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525ef6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.913217:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b1:0x0].0x458ba0d4 (ffff90cf18b78d00)
00010000:00010000:3.0:1789431562.913220:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.913223:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525ef6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.913229:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525ef6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.913265:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525ee8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8be3 expref: 311 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.913281:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525efd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8be3 expref: 310 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.913289:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a22:0x0].0x0 (ffff90ce2e707800)
00010000:00010000:3.0:1789431562.913291:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431562.913294:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035ca800, rc 0)
00000100:00100000:3.0:1789431562.913383:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933477504:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 778us (1229us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431562.913391:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295962
00000100:00100000:1.0:1789431562.913555:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.913782:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933477376
00000100:00100000:0.0:1789431562.913791:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933477376
00000100:00100000:0.0:1789431562.913839:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295963
00000100:00100000:0.0:1789431562.913849:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933477376:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431562.914033:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431562.914078:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525f04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8bdc expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914138:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f0b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914151:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914162:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914177:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914184:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914191:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914481:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525f19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x109b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914492:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109b9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914500:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109b9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431562.914536:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x109b9:0x0]: returning size 85026
00000004:00200000:0.0:1789431562.914541:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431562.914560:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109b9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914572:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109b9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914580:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914586:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914593:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914599:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.914603:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914611:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914622:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431562.914625:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.914630:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914636:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914648:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914654:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914659:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914664:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.914667:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914672:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914679:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce07190100)
00010000:00010000:0.0:1789431562.914682:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.914685:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914691:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.914724:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525f04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bdc expref: 312 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.915068:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525f19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x109b9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bdc expref: 311 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.915074:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109b9:0x0].0x0 (ffff90cf03e3d900)
00010000:00010000:0.0:1789431562.915076:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431562.915078:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7acc00, rc 0)
00000100:00100000:0.0:1789431562.915138:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933477376:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1290us (1581us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.915145:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295963
00000100:00100000:1.0:1789431562.920187:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.920995:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933477632
00000100:00100000:3.0:1789431562.921014:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933477632
00000100:00100000:3.0:1789431562.921138:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14346
00000100:00100000:3.0:1789431562.921152:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:2349:x1876351933477632:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431562.921175:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431562.921209:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525f19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109b9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bdc expref: 311 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.921236:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109b9:0x0].0x0 (ffff90cf03e3d900)
00010000:00010000:3.0:1789431562.921242:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431562.921382:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:2349:x1876351933477632:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 233us (1209us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431562.921390:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14346
00000100:00100000:2.0:1789431562.925616:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.926363:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933477888
00000100:00100000:1.0:1789431562.926380:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933477888
00000100:00100000:1.0:1789431562.926503:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295964
00000100:00100000:1.0:1789431562.926516:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933477888:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431562.926600:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:1.0:1789431562.926638:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525efd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8be3 expref: 310 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.926669:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613200/0xd8e438fb6351ef27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6af0 expref: 309 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.926682:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a22:0x0].0x0 (ffff90ce2e707800)
00010000:00010000:1.0:1789431562.926696:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431562.926725:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.926753:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.926766:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.926784:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.926792:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.926798:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.927221:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f2e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.927305:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.927313:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431562.928379:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1227, 64 off86720
00010000:00010000:1.0:1789431562.928458:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525f35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.928472:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525f35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.928481:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525f35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.928490:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525f35 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.928496:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525f35 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.928504:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525f35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.928528:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431562.928552:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.928557:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f2e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.928564:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.928570:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.928574:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.928727:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431562.928744:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525f35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.928750:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431562.928754:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525f35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.928763:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525f35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.928777:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a22:0x0].0x0 (ffff90ce03149d00)
00010000:00010000:2.0:1789431562.928781:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431562.928787:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525f35 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.928792:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63525f35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.928804:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.928806:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431562.928807:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431562.928834:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f2e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.928843:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a22:0x0].0x0 (ffff90ce03149d00)
00010000:00010000:1.0:1789431562.928845:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431562.928848:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f2e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.928853:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f2e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.928957:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.928970:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f20 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.928975:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.928979:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.928982:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.928987:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f20 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.928995:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b1:0x0].0x0 (ffff90ce363db500)
00010000:00010000:1.0:1789431562.928997:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.929000:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.929006:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431562.929013:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e42efcda reply state 000000006b403506 transno 4295120964 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.929022:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431562.929404:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933477888:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2883us (3796us total) trans 4295120964 rc 0/0
00000100:00100000:1.0:1789431562.929415:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295964
00000100:00100000:3.0:1789431562.931757:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431562.931850:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933478144
00000100:00100000:2.0:1789431562.931864:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933478144
00000100:00100000:2.0:1789431562.931947:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295965
00000100:00100000:2.0:1789431562.931959:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933478144:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431562.932032:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0
00010000:00010000:2.0:1789431562.932112:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613800/0xd8e438fb635125d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109b9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2abc expref: 310 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.932137:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635124f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x109b9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2a7d expref: 309 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.932150:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109b9:0x0].0x0 (ffff90cf03e3d900)
00010000:00010000:2.0:1789431562.932169:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63525ee1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bd5 expref: 308 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.932180:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431562.932183:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431562.932210:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525f3c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.932237:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525f3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.932248:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525f3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.932275:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525f43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.932290:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525f43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.932302:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525f43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.932630:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525f4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x109b9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.932640:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525f4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.932648:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525f4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431562.934087:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1230, 64 off86976
00010000:00010000:2.0:1789431562.934193:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525f51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x109b9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.934213:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525f51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.934688:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525f51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.934700:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525f51 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.934707:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525f51 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.934713:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525f51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.934811:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431562.934816:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431562.934825:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525f51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.934835:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431562.934840:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525f51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.934851:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525f51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.934851:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525f4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109b9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.934866:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525f4a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x109b9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.934871:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525f4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109b9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.934891:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62cc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.934892:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109b9:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:1.0:1789431562.934898:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431562.934905:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525f51 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x109b9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.934911:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63525f51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x109b9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.934930:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431562.934932:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431562.934934:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431562.936567:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.936592:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.936600:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.936607:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.936612:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.936625:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.936643:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b1:0x0].0x458ba0d4 (ffff90ce03149900)
00010000:00010000:1.0:1789431562.936647:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.936652:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.936659:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b1:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.936828:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525f4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109b9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.936842:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525f4a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x109b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.936854:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109b9:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:2.0:1789431562.936857:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431562.936861:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525f4a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x109b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.936868:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525f4a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x109b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.937424:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525f3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.937437:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525f3c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.937443:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525f3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.937455:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.937458:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525f3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.937466:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525f3c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.937479:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431562.937481:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.937485:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525f3c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.937491:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525f3c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431562.937506:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007def39ad reply state 0000000016741dc9 transno 4295120965 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525f43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.937517:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431562.937654:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933478144:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 5691us (5923us total) trans 4295120965 rc 0/0
00000100:00100000:2.0:1789431562.937665:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295965
00010000:00010000:2.0:1789431562.943164:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525f43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.943187:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525f43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.943195:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525f43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.943206:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.943212:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525f43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.943234:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525f43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.943254:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf13195700)
00010000:00010000:2.0:1789431562.943258:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.943278:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525f43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.943292:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63525f43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.956673:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431562.956830:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.958171:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933478400
00000100:00100000:0.0:1789431562.958192:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933478400
00000100:00100000:0.0:1789431562.958347:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933478528
00000100:00100000:0.0:1789431562.958352:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933478528
00000100:00100000:0.0:1789431562.958393:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295966
00000100:00100000:0.0:1789431562.958407:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933478400:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431562.958505:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431562.958546:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb6351eb37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c69a0 expref: 308 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.958573:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a21:0x0].0x0 (ffff90cf03dd3900)
00010000:00010000:0.0:1789431562.958588:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431562.958622:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525f58 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.958645:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525f58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.958657:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525f58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.958674:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b1:0x0].0xb10fb57d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.958681:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.958687:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.958862:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295967
00000100:00100000:3.0:1789431562.958874:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933478528:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431562.958885:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431562.958900:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525f66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8bea expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.958958:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525f6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.958969:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525f6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.958978:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525f6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.958991:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525f74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.958997:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959004:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959128:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525f7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x109c5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959137:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109c5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959144:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109c5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431562.959181:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x109c5:0x0]: returning size 77076
00000004:00200000:3.0:1789431562.959185:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431562.959205:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109c5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959217:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109c5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959226:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525f6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959233:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525f6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959241:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525f6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959247:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.959252:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525f6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959260:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525f6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959268:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431562.959270:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.959275:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525f6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959299:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525f6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959311:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959317:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525f74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959323:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959328:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.959331:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959337:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525f74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959343:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90cf18b78d00)
00010000:00010000:3.0:1789431562.959345:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.959348:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525f74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959353:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525f74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959382:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525f66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bea expref: 309 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959399:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525f7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x109c5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bea expref: 308 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.959407:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109c5:0x0].0x0 (ffff90ce0f6c6100)
00010000:00010000:3.0:1789431562.959410:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431562.959412:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cbc00, rc 0)
00000100:00100000:3.0:1789431562.959494:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933478528:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 623us (2664us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431562.959501:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295967
00010000:00010000:0.0:1789431562.962131:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f82 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.962162:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f82 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.962179:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f82 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431562.964694:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431562.965401:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933478656
00000100:00100000:0.0:1789431562.965417:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933478656
00000100:00100000:0.0:1789431562.965508:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14347
00000100:00100000:0.0:1789431562.965520:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:2349:x1876351933478656:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431562.965548:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431562.965582:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63525f7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109c5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bea expref: 308 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.965608:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109c5:0x0].0x0 (ffff90ce0f6c6100)
00010000:00010000:0.0:1789431562.965615:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431562.965693:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:2349:x1876351933478656:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 175us (1015us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431562.965702:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14347
00000040:00080000:0.0:1789431562.967675:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1231, 64 off87040
00010000:00010000:0.0:1789431562.967985:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525f89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968008:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525f89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968022:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525f89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968034:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525f89 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968041:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525f89 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968184:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525f89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968250:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431562.968288:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f82 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968296:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f82 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968304:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f82 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968310:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.968317:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f82 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968328:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f82 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968345:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a21:0x0].0x0 (ffff90ce07190200)
00010000:00010000:0.0:1789431562.968349:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431562.968355:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f82 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968363:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63525f82 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968392:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525f58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968399:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525f58 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968406:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525f58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968411:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431562.968414:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525f58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968425:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525f58 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968433:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b1:0x0].0x0 (ffff90ce363db500)
00010000:00010000:0.0:1789431562.968435:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431562.968438:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525f58 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.968444:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63525f58 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431562.968454:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d82ebca3 reply state 00000000ceb82b93 transno 4295120966 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431562.968467:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431562.968606:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933478400:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 10194us (11941us total) trans 4295120966 rc 0/0
00000100:00100000:0.0:1789431562.968617:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295966
00010000:00010000:3.0:1789431562.973696:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431562.973717:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525f89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.973741:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431562.973754:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525f89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.973768:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525f89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.973790:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a21:0x0].0x0 (ffff90ce07190200)
00010000:00010000:3.0:1789431562.973793:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431562.973800:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525f89 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.973807:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63525f89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.973844:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431562.973846:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431562.973848:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431562.975684:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.975706:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.975715:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.975722:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431562.975737:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.976545:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f5f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.976572:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b1:0x0].0xb10fb57d (ffff90ce07190100)
00010000:00010000:3.0:1789431562.976576:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431562.976582:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f5f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b1:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431562.976590:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63525f5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b1:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431562.982017:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431562.983447:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933478912
00000100:00100000:1.0:1789431562.983475:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933478912
00000100:00100000:1.0:1789431562.983567:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295968
00000100:00100000:1.0:1789431562.983580:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933478912:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431562.983661:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:1.0:1789431562.983699:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ce6b200/0xd8e438fb63513cd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109c5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c31d8 expref: 307 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.983753:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63513b49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x109c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3153 expref: 306 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.983769:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109c5:0x0].0x0 (ffff90ce0f6c6100)
00010000:00010000:1.0:1789431562.983782:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431562.983814:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f90 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.983833:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.983846:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.983865:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.983873:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.983880:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.984033:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x109c5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.984040:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.984089:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431562.991443:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1232, 64 off87104
00010000:00010000:1.0:1789431562.991569:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525fa5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x109c5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991591:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991605:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991617:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525fa5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991626:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525fa5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991633:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525fa5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991712:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431562.991755:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991762:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f9e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x109c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991769:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991776:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.991782:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991790:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f9e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x109c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991803:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109c5:0x0].0x0 (ffff90ce03149d00)
00010000:00010000:1.0:1789431562.991807:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431562.991813:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f9e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x109c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991820:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63525f9e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x109c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991852:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991859:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f90 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991866:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991871:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431562.991874:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991880:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f90 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991887:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431562.991889:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431562.991893:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f90 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431562.991899:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525f90 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431562.991918:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c47b0593 reply state 0000000097e23f6a transno 4295120967 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431562.991928:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431562.992072:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933478912:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 8466us (10044us total) trans 4295120967 rc 0/0
00000100:00100000:1.0:1789431562.992087:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295968
00010000:00010000:2.0:1789431562.995924:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.995947:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.995955:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.995962:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431562.995968:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.995976:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.995998:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce03149900)
00010000:00010000:2.0:1789431562.996002:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431562.996008:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431562.996015:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63525f97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.997552:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431562.997569:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525fa5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109c5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.997584:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431562.997588:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525fa5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109c5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.997599:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525fa5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109c5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.997619:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109c5:0x0].0x0 (ffff90ce03149d00)
00010000:00010000:0.0:1789431562.997622:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431562.997628:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525fa5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x109c5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.997634:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63525fa5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x109c5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431562.997662:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.997664:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431562.997666:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431563.009738:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.010117:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933479040
00000100:00100000:3.0:1789431563.010131:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933479040
00000100:00100000:3.0:1789431563.010213:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295969
00000100:00100000:3.0:1789431563.010226:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14616:x1876351933479040:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431563.010270:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431563.010300:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525fac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8bf1 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.010388:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.010409:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.010424:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.010441:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525fba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10098:0x0].0xa12f67b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.010449:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525fba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.010456:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525fba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.010862:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.010872:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.010879:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.010891:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.010896:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.010973:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.010990:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x0 (ffff90ce27a54300)
00010000:00010000:3.0:1789431563.010993:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.011000:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.011007:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.011022:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525fba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.011028:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525fba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.011034:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525fba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.011039:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.011042:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525fba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.011191:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525fba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.011205:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0xa12f67b5 (ffff90cf18b78d00)
00010000:00010000:3.0:1789431563.011208:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.011211:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525fba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10098:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.011216:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525fba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10098:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.011335:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525fac lrc: 1/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bf1 expref: 307 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.011348:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x0 (ffff90ce27a54300)
00010000:00010000:3.0:1789431563.011350:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.011354:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525fac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bf1 expref: 307 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.011366:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035ca200, rc 0)
00000100:00100000:3.0:1789431563.011455:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14616:x1876351933479040:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1231us (1737us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431563.011464:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295969
00000100:00100000:1.0:1789431563.028914:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.028967:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.029105:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933479168
00000100:00100000:3.0:1789431563.029119:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933479168
00000100:00100000:3.0:1789431563.029191:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933479424
00000100:00100000:3.0:1789431563.029195:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933479424
00000100:00100000:3.0:1789431563.029219:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295970
00000100:00100000:3.0:1789431563.029230:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933479168:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431563.029269:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431563.029299:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525fc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8bf8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.029388:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525fc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10098:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.029407:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.029422:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431563.029469:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10098:0x0]: returning size 16384
00000004:00200000:3.0:1789431563.029474:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431563.029496:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.029524:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63525fc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bf8 expref: 309 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.029547:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bf8 expref: 308 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.029557:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x0 (ffff90ce27a54300)
00010000:00010000:3.0:1789431563.029560:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431563.029565:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cac00, rc 0)
00000100:00100000:3.0:1789431563.029634:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933479168:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 405us (744us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431563.029642:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295970
00000100:00100000:3.0:1789431563.029665:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295971
00000100:00100000:3.0:1789431563.029674:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933479424:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431563.029707:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431563.029726:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6351f6c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6d4a expref: 307 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.029754:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a2e:0x0].0x0 (ffff90ce07190d00)
00010000:00010000:3.0:1789431563.029765:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431563.029779:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fcf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.029790:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fcf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.029798:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fcf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.029814:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525fd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b1:0x0].0xe260ec82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.029821:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.029829:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.029982:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525fdd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.029991:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525fdd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.030004:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525fdd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431563.030718:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1228, 64 off86784
00010000:00010000:3.0:1789431563.030816:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63525fe4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.030830:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63525fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.030841:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63525fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.030850:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63525fe4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.030856:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63525fe4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.030862:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63525fe4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.030881:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431563.030903:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525fdd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.030910:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525fdd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.030918:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525fdd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.030929:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.030934:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525fdd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.030942:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525fdd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.030953:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a2e:0x0].0x0 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431563.030956:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431563.030961:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525fdd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.030967:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63525fdd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.030986:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fcf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.030993:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fcf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.030999:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fcf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.031005:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.031008:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fcf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.031014:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fcf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.031025:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b1:0x0].0x0 (ffff90ce363db500)
00010000:00010000:3.0:1789431563.031027:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.031030:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fcf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.031036:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63525fcf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431563.031045:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cc228fbf reply state 0000000020ca7360 transno 4295120968 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.031093:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431563.031173:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933479424:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1497us (2201us total) trans 4295120968 rc 0/0
00000100:00100000:3.0:1789431563.031181:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295971
00010000:00010000:2.0:1789431563.031581:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431563.031591:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63525fe4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.031598:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431563.031603:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63525fe4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.031610:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63525fe4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.031620:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a2e:0x0].0x0 (ffff90cf18b78f00)
00010000:00010000:2.0:1789431563.031623:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431563.031626:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63525fe4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.031632:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63525fe4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.031652:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431563.031654:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431563.031657:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431563.034018:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.034042:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525fd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.034172:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525fd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.034179:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.034185:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525fd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.034194:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525fd6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.034218:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b1:0x0].0xe260ec82 (ffff90cf18b78d00)
00010000:00010000:3.0:1789431563.034222:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.034227:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525fd6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b1:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.034235:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63525fd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b1:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.037942:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.038171:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933479552
00000100:00100000:0.0:1789431563.038185:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933479552
00000100:00100000:0.0:1789431563.038256:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12467
00000100:00100000:0.0:1789431563.038279:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933479552:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431563.044780:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933479552:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 6486us (6835us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431563.044799:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12467
00000100:00100000:3.0:1789431563.056381:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.057337:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.058464:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933479808
00000100:00100000:2.0:1789431563.058480:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933479808
00000100:00100000:2.0:1789431563.058546:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933480064
00000100:00100000:2.0:1789431563.058549:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933480064
00000100:00100000:2.0:1789431563.058609:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295972
00000100:00100000:2.0:1789431563.058620:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933479808:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431563.058687:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431563.058720:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f76000/0xd8e438fb63521af5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a54:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c78e9 expref: 308 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.058814:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a54:0x0].0x0 (ffff90cf04d11c00)
00010000:00010000:2.0:1789431563.058838:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63525fc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10098:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bf8 expref: 307 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.058847:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x0 (ffff90ce27a54300)
00010000:00010000:2.0:1789431563.058852:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431563.058876:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525feb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.058894:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525feb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.058966:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525feb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.058984:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525ff2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10098:0x0].0x7ca69afa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.058992:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.059000:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.059442:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295973
00000100:00100000:1.0:1789431563.059457:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933480064:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431563.059488:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431563.059504:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb6351fbde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6ee0 expref: 306 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.059519:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a32:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:1.0:1789431563.059529:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431563.059541:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ff9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.059550:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.059558:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.059570:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526000 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b1:0x0].0x8849861e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.059577:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.059585:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.059673:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63526007 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.059680:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63526007 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.059688:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63526007 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431563.060241:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1229, 64 off86848
00010000:00010000:2.0:1789431563.060540:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352600e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.060553:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352600e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.060563:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352600e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431563.061533:0:12775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1230, 64 off86912
00010000:00010000:2.0:1789431563.061612:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526015 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.061629:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.061641:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.061651:0:12775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526015 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.061659:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526015 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.061666:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526015 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.061700:0:12775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431563.061892:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352601c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.061916:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352601c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.061925:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352601c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.061932:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352601c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.061938:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352601c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.061944:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352601c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.061961:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:1.0:1789431563.061977:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1789431563.061984:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526015 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.061992:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431563.061997:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526015 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062006:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526015 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062018:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a54:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:1.0:1789431563.062022:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431563.062027:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526015 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062033:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526015 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062068:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431563.062072:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352601c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062077:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431563.062081:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352601c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062087:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352601c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062095:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a32:0x0].0x0 (ffff90ce03149300)
00010000:00010000:1.0:1789431563.062097:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431563.062101:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352601c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062107:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352601c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062117:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431563.062119:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431563.062121:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431563.062140:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63526007 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062147:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63526007 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062152:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63526007 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062157:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.062162:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63526007 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062168:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63526007 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062176:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a32:0x0].0x0 (ffff90ce03149300)
00010000:00010000:1.0:1789431563.062178:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431563.062181:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63526007 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062186:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63526007 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062215:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062222:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ff9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062228:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ff9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062234:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.062237:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ff9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062243:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ff9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062250:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b1:0x0].0x0 (ffff90ce363db500)
00010000:00010000:1.0:1789431563.062253:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.062256:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ff9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.062262:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63525ff9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431563.062272:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000076689224 reply state 0000000031d3495d transno 4295120969 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.062494:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431563.062628:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933480064:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3171us (5291us total) trans 4295120969 rc 0/0
00000100:00100000:1.0:1789431563.062643:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295973
00010000:00010000:2.0:1789431563.062867:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431563.062887:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352600e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.062897:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352600e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.062914:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352600e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.062920:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62ce00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.062924:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352600e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.062930:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352600e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.062939:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a54:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:2.0:1789431563.062942:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431563.062945:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352600e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.062951:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352600e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.062974:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525feb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.062981:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525feb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.062987:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525feb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.062996:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.063000:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525feb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.063006:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525feb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.063015:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x0 (ffff90ce27a54300)
00010000:00010000:2.0:1789431563.063017:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.063020:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525feb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.063026:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63525feb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431563.063036:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000061048a9 reply state 000000004a4c356b transno 4295120970 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.063044:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431563.063110:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933479808:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 4491us (6741us total) trans 4295120970 rc 0/0
00000100:00100000:2.0:1789431563.063118:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295972
00010000:00010000:1.0:1789431563.065675:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.065698:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526000 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.065706:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526000 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.065713:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.065720:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526000 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.065739:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526000 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.065770:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b1:0x0].0x8849861e (ffff90ce03149c00)
00010000:00010000:1.0:1789431563.065773:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.065781:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526000 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b1:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.065788:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526000 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b1:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.068589:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.068613:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525ff2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.068623:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525ff2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.068630:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62cc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.068636:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525ff2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.068644:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525ff2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.068664:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x7ca69afa (ffff90cf13195700)
00010000:00010000:3.0:1789431563.068668:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.068673:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525ff2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10098:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.068684:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63525ff2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10098:0x0].0x7ca69afa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.076592:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.076713:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933480320
00000100:00100000:2.0:1789431563.076737:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933480320
00000100:00100000:2.0:1789431563.076867:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295974
00000100:00100000:2.0:1789431563.076880:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933480320:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431563.076984:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431563.077020:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a800/0xd8e438fb6351f8ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6deb expref: 306 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.077089:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a31:0x0].0x0 (ffff90ce07190700)
00010000:00010000:2.0:1789431563.077106:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431563.077137:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526023 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.077155:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526023 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.077167:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526023 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.077183:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352602a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b1:0x0].0x7eb5c453 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.077191:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352602a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.077196:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352602a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.077344:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526031 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.077354:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526031 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.077360:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526031 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431563.078015:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1233, 64 off87168
00010000:00010000:2.0:1789431563.078126:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526038 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078138:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078147:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078157:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526038 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078164:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526038 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078171:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526038 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078187:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431563.078212:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526031 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078217:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526031 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078226:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526031 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078232:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.078238:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526031 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078246:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526031 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078257:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a31:0x0].0x0 (ffff90cf13195500)
00010000:00010000:2.0:1789431563.078260:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431563.078266:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526031 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078273:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526031 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078294:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526023 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078301:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526023 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078307:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526023 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078312:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.078316:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526023 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078322:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526023 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078330:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b1:0x0].0x0 (ffff90ce363db500)
00010000:00010000:2.0:1789431563.078332:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.078335:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526023 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.078341:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526023 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431563.078356:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000027e8ef1b reply state 00000000c572595d transno 4295120971 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352602a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.078366:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431563.078480:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933480320:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1598us (1897us total) trans 4295120971 rc 0/0
00000100:00100000:2.0:1789431563.078488:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295974
00010000:00010000:0.0:1789431563.078586:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431563.078594:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526038 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.078601:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62dc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431563.078604:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526038 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.078611:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526038 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.078620:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a31:0x0].0x0 (ffff90cf13195500)
00010000:00010000:0.0:1789431563.078623:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431563.078626:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526038 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.078636:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526038 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.078653:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.078655:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.078656:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431563.083213:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352602a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.083235:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352602a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.083245:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352602a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.083252:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62ce00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.083266:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352602a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.083276:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352602a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b1:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.083298:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b1:0x0].0x7eb5c453 (ffff90cf13195c00)
00010000:00010000:3.0:1789431563.083302:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.083308:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352602a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b1:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.083315:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352602a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b1:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.086968:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.087120:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933480576
00000100:00100000:3.0:1789431563.087134:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933480576
00000100:00100000:3.0:1789431563.087204:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295975
00000100:00100000:3.0:1789431563.087218:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14616:x1876351933480576:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431563.087367:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431563.087403:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb635223a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b74 expref: 306 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.087424:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a5b:0x0].0x0 (ffff90ce2e707a00)
00010000:00010000:3.0:1789431563.087437:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431563.087466:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352603f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.087484:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352603f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.087496:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352603f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.087513:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526046 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.087520:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526046 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.087526:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526046 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.087816:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352604d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.087828:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352604d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.087837:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352604d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.090191:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000040:00080000:2.0:1789431563.090338:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1234, 64 off87232
00010000:00010000:2.0:1789431563.090454:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526054 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090476:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a5b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090489:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a5b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090499:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526054 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a5b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090505:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526054 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a5b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090513:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526054 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a5b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090543:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431563.090572:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352604d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090579:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352604d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090585:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352604d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090591:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.090596:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352604d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090604:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352604d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090617:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a5b:0x0].0x0 (ffff90cf13195900)
00010000:00010000:2.0:1789431563.090621:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431563.090626:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352604d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090633:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352604d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090658:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352603f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090668:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352603f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090674:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352603f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090678:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.090681:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352603f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090686:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352603f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090694:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x0 (ffff90ce27a54300)
00010000:00010000:2.0:1789431563.090697:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.090699:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352603f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.090705:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352603f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431563.090716:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007fba4f3a reply state 000000006dd67aef transno 4295120972 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526046 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.090725:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431563.090842:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933480576:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3626us (3888us total) trans 4295120972 rc 0/0
00000100:00100000:2.0:1789431563.090854:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295975
00010000:00010000:0.0:1789431563.091914:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431563.091928:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526054 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a5b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.091939:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431563.091943:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526054 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a5b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.091952:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526054 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a5b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.091966:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a5b:0x0].0x0 (ffff90cf13195900)
00010000:00010000:0.0:1789431563.091970:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431563.091974:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526054 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a5b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.091981:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526054 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a5b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.092008:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.092011:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.092013:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431563.092658:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933480704
00000100:00100000:2.0:1789431563.092672:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933480704
00000100:00100000:3.0:1789431563.092841:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295976
00000100:00100000:3.0:1789431563.092856:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933480704:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431563.092882:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431563.093166:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352605b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8bff expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093253:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526062 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093344:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093358:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093377:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526069 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa12f67b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093384:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093391:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093458:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093465:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526062 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093473:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093479:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.093483:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093491:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526062 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093503:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431563.093507:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.093512:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526062 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093518:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526062 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093531:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093538:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526069 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093544:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093550:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.093553:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093559:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526069 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b9:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093566:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0xa12f67b5 (ffff90cf18b78500)
00010000:00010000:3.0:1789431563.093568:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.093571:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526069 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093578:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526069 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093613:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352605b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bff expref: 308 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093624:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:3.0:1789431563.093626:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.093630:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352605b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8bff expref: 308 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.093640:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035ca200, rc 0)
00000100:00100000:3.0:1789431563.093778:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933480704:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 926us (3598us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431563.093787:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295976
00010000:00010000:1.0:1789431563.095879:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526046 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.095910:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526046 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.095924:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526046 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.095931:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.095936:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526046 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.095945:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526046 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.095965:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0xe5e25d80 (ffff90cf18b78d00)
00010000:00010000:1.0:1789431563.095968:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.095974:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526046 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.095981:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526046 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10098:0x0].0xe5e25d80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.102988:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.103099:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933480832
00000100:00100000:1.0:1789431563.103111:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933480832
00000100:00100000:1.0:1789431563.103184:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295977
00000100:00100000:1.0:1789431563.103198:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14616:x1876351933480832:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431563.103232:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431563.103268:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526070 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c06 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103354:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526077 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103379:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526077 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103393:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526077 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103412:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352607e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103419:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352607e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103425:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352607e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103560:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526085 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103569:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a4f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103577:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a4f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431563.103618:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10a4f:0x0]: returning size 10438
00000004:00200000:1.0:1789431563.103623:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431563.103644:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a4f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103655:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103669:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526077 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103676:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526077 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103683:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526077 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103689:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.103694:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526077 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103702:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526077 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103715:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x0 (ffff90ce27a54300)
00010000:00010000:1.0:1789431563.103718:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.103724:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526077 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103871:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526077 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103892:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352607e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103899:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352607e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103905:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352607e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103912:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.103915:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352607e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103922:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352607e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103930:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0xc4d44c31 (ffff90ce03149c00)
00010000:00010000:1.0:1789431563.103933:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.103936:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352607e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103942:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352607e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103981:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526070 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c06 expref: 308 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.103997:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526085 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c06 expref: 307 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.104005:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a4f:0x0].0x0 (ffff90ce03149300)
00010000:00010000:1.0:1789431563.104007:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431563.104010:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309a00, rc 0)
00000100:00100000:1.0:1789431563.104112:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933480832:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 918us (1139us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431563.104120:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295977
00000100:00100000:3.0:1789431563.107983:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.108170:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933481088
00000100:00100000:1.0:1789431563.108184:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933481088
00000100:00100000:1.0:1789431563.108254:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295978
00000100:00100000:1.0:1789431563.108280:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933481088:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431563.108352:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:1.0:1789431563.108389:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612000/0xd8e438fb63523685 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a7b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c80de expref: 307 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.108416:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a7b:0x0].0x0 (ffff90cf11d83300)
00010000:00010000:1.0:1789431563.108439:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4800/0xd8e438fb635250cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8816 expref: 306 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.108449:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431563.108453:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431563.108479:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352608c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.108495:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352608c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.108508:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352608c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.108525:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526093 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b9:0x0].0x22737f46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.108533:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526093 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.108539:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526093 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.108691:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352609a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.108700:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352609a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a7b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.108707:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352609a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a7b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431563.110035:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1235, 64 off87296
00010000:00010000:1.0:1789431563.110160:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635260a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a7b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110178:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635260a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a7b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110189:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635260a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a7b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110199:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635260a1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a7b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110206:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635260a1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a7b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110213:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635260a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a7b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110314:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431563.110344:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352609a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a7b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110356:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352609a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a7b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110363:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352609a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a7b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110369:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.110374:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352609a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a7b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110382:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352609a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a7b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110394:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a7b:0x0].0x0 (ffff90ce03149f00)
00010000:00010000:1.0:1789431563.110398:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431563.110403:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352609a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a7b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110410:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352609a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a7b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110432:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352608c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110438:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352608c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110444:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352608c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110450:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.110453:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352608c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110460:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352608c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110469:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x0 (ffff90ce05727a00)
00010000:00010000:1.0:1789431563.110471:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.110474:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352608c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.110480:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352608c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431563.110490:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ddd2b088 reply state 00000000669c2656 transno 4295120973 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526093 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.110500:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431563.110621:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933481088:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2351us (2649us total) trans 4295120973 rc 0/0
00000100:00100000:1.0:1789431563.110631:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295978
00010000:00010000:1.0:1789431563.113954:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526093 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.113976:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526093 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.113984:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526093 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.113990:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.113996:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526093 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.114006:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526093 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b9:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.114027:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b9:0x0].0x22737f46 (ffff90ce03149a00)
00010000:00010000:1.0:1789431563.114030:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.114036:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526093 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.114042:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526093 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b9:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.115019:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431563.115033:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635260a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a7b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.115044:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431563.115069:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635260a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a7b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.115079:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635260a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a7b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.115095:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a7b:0x0].0x0 (ffff90ce03149f00)
00010000:00010000:2.0:1789431563.115098:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431563.115103:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635260a1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a7b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.115111:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635260a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a7b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.115137:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431563.115140:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431563.115141:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431563.120593:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.126476:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933481344
00000100:00100000:1.0:1789431563.126496:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933481344
00000100:00100000:1.0:1789431563.126593:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295979
00000100:00100000:1.0:1789431563.126605:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14616:x1876351933481344:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431563.126685:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431563.126722:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526085 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a4f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c06 expref: 306 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.126757:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a4f:0x0].0x0 (ffff90ce03149300)
00010000:00010000:1.0:1789431563.126878:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431563.126980:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635260a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.126998:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635260a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.127010:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635260a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.127028:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635260af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.127036:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635260af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.127042:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635260af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.127285:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635260b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.127294:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635260b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.127302:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635260b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431563.128410:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1236, 64 off87360
00010000:00010000:1.0:1789431563.128494:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635260bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.128511:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635260bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.128523:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635260bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.128531:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635260bd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.128539:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635260bd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.128547:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635260bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.129291:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431563.129334:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635260b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.129345:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635260b6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.129352:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635260b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.129359:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.129365:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635260b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.129375:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635260b6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.129391:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a4f:0x0].0x0 (ffff90ce03149700)
00010000:00010000:1.0:1789431563.129394:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431563.129400:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635260b6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.129407:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635260b6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.129432:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635260a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.129444:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635260a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.129450:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635260a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.129456:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.129459:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635260a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.129465:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635260a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.129473:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x0 (ffff90ce27a54300)
00010000:00010000:1.0:1789431563.129476:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.129479:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635260a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.129485:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635260a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431563.129497:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003c303817 reply state 00000000342df517 transno 4295120974 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635260af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.129507:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431563.129632:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933481344:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3024us (9046us total) trans 4295120974 rc 0/0
00000100:00100000:1.0:1789431563.129642:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295979
00010000:00010000:3.0:1789431563.132658:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431563.132672:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635260bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.132684:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309e00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431563.132689:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635260bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.132701:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635260bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.132723:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431563.132724:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a4f:0x0].0x0 (ffff90ce03149700)
00010000:00010000:3.0:1789431563.132744:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431563.132751:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635260bd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.132757:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635260bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.132783:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431563.132785:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431563.132787:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431563.133020:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933481472
00000100:00100000:1.0:1789431563.133033:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933481472
00010000:00010000:0.0:1789431563.133119:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635260af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.133130:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635260af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.133136:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635260af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.133141:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.133146:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635260af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.133153:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635260af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.133164:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0xc4d44c31 (ffff90ce03149c00)
00010000:00010000:0.0:1789431563.133168:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.133172:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635260af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.133179:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635260af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10098:0x0].0xc4d44c31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.133194:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295980
00000100:00100000:1.0:1789431563.133209:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933481472:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431563.133237:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431563.133262:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635260c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c0d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.133405:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635260cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100c1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.133420:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635260cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.133430:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635260cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431563.133465:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100c1:0x0]: returning size 16384
00000004:00200000:3.0:1789431563.133469:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431563.133487:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635260cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.133519:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635260c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c0d expref: 308 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.133535:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635260cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c0d expref: 307 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.133600:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c1:0x0].0x0 (ffff90ce05727100)
00010000:00010000:3.0:1789431563.133603:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431563.133607:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035ca200, rc 0)
00000100:00100000:3.0:1789431563.133674:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933481472:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 469us (962us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431563.133683:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295980
00000100:00100000:0.0:1789431563.136586:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.136635:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.136686:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933481600
00000100:00100000:2.0:1789431563.136703:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933481600
00000100:00100000:2.0:1789431563.136787:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933481728
00000100:00100000:2.0:1789431563.136791:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933481728
00000100:00100000:2.0:1789431563.136836:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295981
00000100:00100000:2.0:1789431563.136849:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933481600:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431563.136881:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00000100:00100000:0.0:1789431563.136999:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295982
00000100:00100000:0.0:1789431563.137012:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933481728:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431563.137022:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431563.137037:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635260d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c1b expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137155:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635260e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137176:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635260e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137189:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635260e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137208:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635260e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100c1:0x0].0xa12f67b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137216:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635260e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137224:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635260e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137478:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635260e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137485:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635260e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137490:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635260e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137493:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ace00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.137497:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635260e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137507:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635260e0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137518:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c1:0x0].0x0 (ffff90ce05727100)
00010000:00010000:0.0:1789431563.137520:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.137525:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635260e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137529:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635260e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137539:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635260e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137543:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635260e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137546:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635260e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137549:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.137551:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635260e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137554:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635260e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137557:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c1:0x0].0xa12f67b5 (ffff90ce07190400)
00010000:00010000:0.0:1789431563.137559:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.137560:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635260e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100c1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137565:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635260e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100c1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137596:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635260d9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c1b expref: 309 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137603:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c1:0x0].0x0 (ffff90ce05727100)
00010000:00010000:0.0:1789431563.137605:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.137607:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635260d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c1b expref: 309 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.137613:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ac600, rc 0)
00000100:00100000:0.0:1789431563.137687:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933481728:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 679us (1051us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431563.137694:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295982
00010000:00010000:2.0:1789431563.137853:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635260d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c14 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.137973:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635260ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.137985:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635260ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.137995:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635260ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138010:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635260f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138017:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635260f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138023:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635260f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138154:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635260fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138163:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635260fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a59:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138170:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635260fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a59:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431563.138214:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10a59:0x0]: returning size 29253
00000004:00200000:2.0:1789431563.138219:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431563.138243:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635260fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a59:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138261:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635260fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138269:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635260ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138275:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635260ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138282:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635260ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138288:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.138291:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635260ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138297:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635260ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138307:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x0 (ffff90ce27a54300)
00010000:00010000:2.0:1789431563.138310:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.138314:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635260ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138319:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635260ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138330:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635260f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138337:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635260f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138344:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635260f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138350:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.138352:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635260f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138358:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635260f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138366:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x586f5504 (ffff90cf13195f00)
00010000:00010000:2.0:1789431563.138368:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.138371:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635260f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138376:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635260f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138607:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635260d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c14 expref: 309 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138624:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635260fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c14 expref: 308 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.138632:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a59:0x0].0x0 (ffff90cf13195900)
00010000:00010000:2.0:1789431563.138634:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431563.138637:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62c200, rc 0)
00000100:00100000:2.0:1789431563.138769:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933481600:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1921us (2191us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.138777:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295981
00000100:00100000:0.0:1789431563.151090:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.155509:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933481856
00000100:00100000:3.0:1789431563.155534:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933481856
00000100:00100000:3.0:1789431563.155624:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12468
00000100:00100000:3.0:1789431563.155641:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933481856:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431563.157106:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.157389:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933482112
00000100:00100000:3.0:1789431563.157399:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933482112
00000100:00100000:3.0:1789431563.157462:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295983
00000100:00100000:3.0:1789431563.157472:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933482112:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431563.157536:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431563.157573:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635260fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c14 expref: 310 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.157596:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a59:0x0].0x0 (ffff90cf13195900)
00010000:00010000:3.0:1789431563.157609:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431563.157636:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526103 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.157653:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526103 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.157670:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526103 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.157686:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352610a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.157694:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352610a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.157701:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352610a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.157828:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526111 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.157836:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526111 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a59:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.157843:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526111 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a59:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431563.160964:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1237, 64 off87424
00010000:00010000:2.0:1789431563.161082:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526118 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.161102:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.161116:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.161125:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526118 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.161131:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526118 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.161139:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526118 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.161163:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431563.161193:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526111 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.161198:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431563.161199:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526111 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.161205:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526111 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a59:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.161207:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526118 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.161212:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.161213:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431563.161218:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526118 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a59:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.161218:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526111 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.161228:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526118 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.161228:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526111 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a59:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.162309:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933481856:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 6662us (11223us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431563.162324:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12468
00010000:00010000:2.0:1789431563.164342:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a59:0x0].0x0 (ffff90cf18b78800)
00010000:00010000:2.0:1789431563.164354:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431563.164365:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526111 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.164378:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526111 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.164417:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a59:0x0].0x0 (ffff90cf18b78800)
00010000:00010000:2.0:1789431563.164420:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526103 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.164425:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431563.164434:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526118 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.164442:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526118 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.164471:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.164474:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.164477:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431563.164545:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526103 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.164556:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526103 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.164563:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.164567:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526103 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.164576:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526103 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.164587:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x0 (ffff90ce27a54300)
00010000:00010000:2.0:1789431563.164590:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.164594:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526103 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.164604:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526103 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10098:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431563.164617:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000059258ca8 reply state 0000000092e6e4fa transno 4295120975 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352610a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.164628:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431563.164769:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933482112:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 7288us (7663us total) trans 4295120975 rc 0/0
00000100:00100000:2.0:1789431563.164835:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295983
00010000:00010000:1.0:1789431563.167139:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352610a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.167162:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352610a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.167172:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352610a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.167178:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.167184:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352610a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.167193:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352610a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.167213:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10098:0x0].0x586f5504 (ffff90cf18b78500)
00010000:00010000:1.0:1789431563.167216:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.167222:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352610a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.167229:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352610a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10098:0x0].0x586f5504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.170393:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.170507:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933482240
00000100:00100000:3.0:1789431563.170521:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933482240
00000100:00100000:3.0:1789431563.170600:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295984
00000100:00100000:3.0:1789431563.170614:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933482240:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431563.170648:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431563.170679:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352611f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c22 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.170777:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526126 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.170794:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.170808:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.170824:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352612d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b0:0x0].0xa12f67b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.170831:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352612d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b0:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.170837:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352612d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b0:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.174140:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.174164:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526126 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.174173:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.174179:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.174184:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.174194:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526126 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.174220:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b0:0x0].0x0 (ffff90ce363db600)
00010000:00010000:3.0:1789431563.174223:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.174230:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526126 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.174237:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526126 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.174255:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352612d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b0:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.174266:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352612d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b0:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.174271:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352612d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b0:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.174276:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.174279:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352612d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b0:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.174284:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352612d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b0:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.174292:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b0:0x0].0xa12f67b5 (ffff90cf18b78200)
00010000:00010000:3.0:1789431563.174295:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.174298:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352612d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b0:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.174305:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352612d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b0:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.174371:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352611f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c22 expref: 309 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.174383:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b0:0x0].0x0 (ffff90ce363db600)
00010000:00010000:3.0:1789431563.174385:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.174389:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352611f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c22 expref: 309 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.174401:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb600, rc 0)
00000100:00100000:2.0:1789431563.174697:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933482240:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4083us (4579us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431563.174709:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295984
00000100:00100000:1.0:1789431563.177446:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.177553:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933482368
00000100:00100000:2.0:1789431563.177566:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933482368
00000100:00100000:2.0:1789431563.177651:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295985
00000100:00100000:2.0:1789431563.177663:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933482368:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431563.177690:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431563.177722:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526134 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c29 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.177828:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352613b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.177847:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352613b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.177861:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352613b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.177878:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526142 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.177886:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.177891:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178232:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526149 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x109da:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178242:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109da:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178250:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109da:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431563.178294:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x109da:0x0]: returning size 543
00000004:00200000:2.0:1789431563.178300:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431563.178321:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109da:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178333:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109da:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178343:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352613b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178351:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352613b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178363:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352613b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178369:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.178373:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352613b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178381:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352613b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178393:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c1:0x0].0x0 (ffff90ce05727100)
00010000:00010000:2.0:1789431563.178397:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.178403:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352613b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178410:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb6352613b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178424:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178430:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526142 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178436:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178442:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62ce00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.178445:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178455:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526142 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178462:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c1:0x0].0xb0449b87 (ffff90cf13195f00)
00010000:00010000:2.0:1789431563.178465:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.178467:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526142 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178473:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526142 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178510:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526134 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c29 expref: 310 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178525:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526149 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x109da:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c29 expref: 309 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.178534:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109da:0x0].0x0 (ffff90ce032a1200)
00010000:00010000:2.0:1789431563.178536:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431563.178539:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62dc00, rc 0)
00000100:00100000:2.0:1789431563.180008:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933482368:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2332us (2563us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.180023:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295985
00000100:00100000:0.0:1789431563.193556:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.193661:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933482496
00000100:00100000:2.0:1789431563.193675:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933482496
00000100:00100000:2.0:1789431563.193874:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14348
00000100:00100000:2.0:1789431563.193892:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e956c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:2348:x1876351933482496:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431563.193919:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431563.193955:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526149 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109da:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c29 expref: 309 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.193979:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109da:0x0].0x0 (ffff90ce032a1200)
00010000:00010000:2.0:1789431563.193985:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431563.194097:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e956c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:2348:x1876351933482496:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 211us (559us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.194253:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14348
00000100:00100000:1.0:1789431563.195290:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.195346:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.195518:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933482752
00000100:00100000:3.0:1789431563.195528:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933482752
00000100:00100000:3.0:1789431563.195581:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933483008
00000100:00100000:3.0:1789431563.195584:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933483008
00000100:00100000:3.0:1789431563.195610:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295986
00000100:00100000:3.0:1789431563.195620:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933482752:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431563.195687:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:3.0:1789431563.195716:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd4c00/0xd8e438fb6351ed75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6a72 expref: 309 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.195738:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295987
00000100:00100000:2.0:1789431563.195752:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933483008:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431563.195757:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a24:0x0].0x0 (ffff90ce211f4300)
00010000:00010000:3.0:1789431563.195780:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612600/0xd8e438fb63520030 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c704c expref: 308 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.195791:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b0:0x0].0x0 (ffff90ce363db600)
00010000:00010000:3.0:1789431563.195795:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431563.195821:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526150 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.195836:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526150 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.195847:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526150 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.195863:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63526157 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b0:0x0].0x75c74963 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.195870:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63526157 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.195877:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63526157 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.196241:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352615e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.196252:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352615e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.196274:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352615e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.196291:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431563.196309:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac43e00/0xd8e438fb6351a0c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109da:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c5231 expref: 307 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.196325:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109da:0x0].0x0 (ffff90ce032a1200)
00010000:00010000:2.0:1789431563.196341:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635260cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100c1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c0d expref: 306 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.196352:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c1:0x0].0x0 (ffff90ce05727100)
00010000:00010000:2.0:1789431563.196356:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431563.196370:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526165 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.196380:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526165 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.196394:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526165 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.196408:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352616c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.196415:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352616c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.196423:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352616c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.196651:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526173 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x109da:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.196661:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526173 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.196668:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526173 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431563.201261:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1231, 64 off86976
00010000:00010000:2.0:1789431563.201501:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352617a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x109da:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.201525:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352617a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.201541:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352617a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.201551:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352617a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.201560:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352617a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.201566:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352617a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.201721:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431563.201768:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526173 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.201943:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526173 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x109da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.201951:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526173 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.201959:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.201964:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526173 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.201973:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526173 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x109da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.201980:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431563.201988:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109da:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:0.0:1789431563.201991:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352617a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.201994:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431563.202003:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526173 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x109da:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.202004:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62cc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431563.202011:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352617a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109da:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.202014:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526173 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x109da:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.202027:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352617a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109da:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.202043:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109da:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:0.0:1789431563.202070:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431563.202075:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352617a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x109da:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.202084:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352617a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x109da:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.202084:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526165 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.202101:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526165 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.202106:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526165 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.202112:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.202115:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526165 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.202116:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.202120:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.202126:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431563.202127:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526165 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.202137:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c1:0x0].0x0 (ffff90ce05727100)
00010000:00010000:2.0:1789431563.202140:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.202143:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526165 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.202150:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526165 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431563.202163:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005eea77da reply state 000000002a94aa83 transno 4295120976 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352616c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.202173:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431563.202299:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933483008:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 6544us (6946us total) trans 4295120976 rc 0/0
00000100:00100000:2.0:1789431563.202315:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295987
00000040:00080000:3.0:1789431563.202487:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1232, 64 off87040
00010000:00010000:3.0:1789431563.202560:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526181 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.202574:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526181 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.202585:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526181 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.202592:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526181 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.202599:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526181 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.202605:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526181 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.202626:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431563.202641:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352615e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.202647:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352615e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.202653:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352615e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.202658:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.202661:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352615e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.202668:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352615e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.202675:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a24:0x0].0x0 (ffff90cf18b78400)
00010000:00010000:3.0:1789431563.202678:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431563.202682:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352615e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.202688:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352615e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.202702:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526150 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.202708:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526150 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.202714:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526150 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.202719:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.202722:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526150 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.202737:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526150 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.202750:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431563.202754:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b0:0x0].0x0 (ffff90ce363db600)
00010000:00010000:0.0:1789431563.202758:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526181 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.202759:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.202764:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526150 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.202774:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431563.202776:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526150 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.202781:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526181 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431563.202790:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007940308f reply state 000000003a57c7f3 transno 4295120977 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63526157 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.202792:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526181 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.202816:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a24:0x0].0x0 (ffff90cf18b78400)
00000100:00100000:3.0:1789431563.202816:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431563.202822:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431563.202825:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526181 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.202832:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526181 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.202849:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.202852:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.202856:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431563.202857:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933482752:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 7236us (7570us total) trans 4295120977 rc 0/0
00000100:00100000:3.0:1789431563.202865:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295986
00010000:00010000:1.0:1789431563.208459:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352616c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.208484:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352616c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.208493:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352616c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.208500:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62ce00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.208507:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352616c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.208516:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352616c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.208539:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c1:0x0].0xb0449b87 (ffff90cf13195f00)
00010000:00010000:1.0:1789431563.208543:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.208549:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352616c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.208558:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352616c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100c1:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.212069:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63526157 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.212098:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63526157 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.212107:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63526157 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.212114:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.212119:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63526157 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.212128:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63526157 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.212159:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b0:0x0].0x75c74963 (ffff90cf18b78200)
00010000:00010000:1.0:1789431563.212163:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.212170:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63526157 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b0:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.212177:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb63526157 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b0:0x0].0x75c74963 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.216849:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.216934:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933483264
00000100:00100000:3.0:1789431563.216949:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933483264
00000100:00100000:3.0:1789431563.217027:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295988
00000100:00100000:3.0:1789431563.217040:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933483264:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431563.217163:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431563.217202:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb635167fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109df:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3f61 expref: 306 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.217230:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109df:0x0].0x0 (ffff90cf03e3df00)
00010000:00010000:3.0:1789431563.217245:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431563.217285:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526188 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.217303:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526188 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.217315:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526188 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.217334:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352618f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100c1:0x0].0x5a114248 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.217342:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352618f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.217358:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352618f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.218337:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526196 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x109df:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.218355:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526196 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.218367:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526196 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431563.220560:0:12775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1238, 64 off87488
00010000:00010000:3.0:1789431563.220962:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352619d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x109df:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.220984:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352619d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.220997:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352619d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.221007:0:12775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352619d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.221015:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352619d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.221021:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352619d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.221143:0:12775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431563.221177:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526196 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109df:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.221184:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526196 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x109df:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.221192:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526196 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109df:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.221198:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.221203:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526196 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109df:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.221212:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526196 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x109df:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.221227:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109df:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431563.221231:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431563.221237:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526196 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x109df:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.221245:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526196 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x109df:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.221512:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526188 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.221520:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526188 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.221526:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526188 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.221536:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cbc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.221540:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526188 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.221547:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526188 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.221556:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c1:0x0].0x0 (ffff90ce05727100)
00010000:00010000:3.0:1789431563.221558:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.221562:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526188 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.221567:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526188 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431563.221579:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005acc67a1 reply state 00000000fdf39ba4 transno 4295120978 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352618f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.221971:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431563.223724:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431563.223755:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352619d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.223769:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431563.223773:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352619d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.223785:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352619d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.223807:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109df:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:1.0:1789431563.223811:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431563.223816:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352619d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x109df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.223822:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb6352619d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x109df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.223870:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431563.223873:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431563.223875:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431563.228592:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933483264:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 11536us (11740us total) trans 4295120978 rc 0/0
00000100:00100000:0.0:1789431563.228610:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295988
00000100:00100000:2.0:1789431563.236034:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431563.236171:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352618f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.236186:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352618f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.236195:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352618f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.236201:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.236207:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352618f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.236216:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352618f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.236236:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c1:0x0].0x5a114248 (ffff90cf18b78400)
00010000:00010000:1.0:1789431563.236240:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.236246:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352618f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100c1:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.236254:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352618f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100c1:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.237103:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933483392
00000100:00100000:0.0:1789431563.237119:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933483392
00000100:00100000:0.0:1789431563.237191:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295989
00000100:00100000:0.0:1789431563.237205:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933483392:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431563.237239:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431563.237264:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635261a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c30 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237350:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635261ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237367:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635261ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237380:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635261ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237398:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237405:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237413:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237547:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635261b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x109e8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237557:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635261b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109e8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237563:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635261b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109e8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431563.237616:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x109e8:0x0]: returning size 4096
00000004:00200000:0.0:1789431563.237622:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431563.237647:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635261b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109e8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237663:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635261b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109e8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237671:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635261ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237679:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635261ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237685:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635261ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237691:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.237695:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635261ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237702:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635261ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237712:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c1:0x0].0x0 (ffff90ce05727100)
00010000:00010000:0.0:1789431563.237715:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.237719:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635261ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237734:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635261ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237749:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237754:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237760:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237765:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.237768:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237774:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237782:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c1:0x0].0x8ee21578 (ffff90ce07190400)
00010000:00010000:0.0:1789431563.237784:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.237787:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237792:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237829:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635261a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c30 expref: 308 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237854:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635261b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x109e8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c30 expref: 307 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.237863:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109e8:0x0].0x0 (ffff90cf1247c100)
00010000:00010000:0.0:1789431563.237865:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431563.237868:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7acc00, rc 0)
00000100:00100000:0.0:1789431563.237944:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933483392:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 742us (1925us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431563.237953:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295989
00000100:00100000:2.0:1789431563.245208:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.245363:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933483648
00000100:00100000:3.0:1789431563.245377:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933483648
00000100:00100000:2.0:1789431563.245477:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295990
00000100:00100000:2.0:1789431563.245493:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933483648:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431563.245568:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431563.245602:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635261b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109e8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c30 expref: 307 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.245627:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbe00/0xd8e438fb63517f51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109e8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c471e expref: 306 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.245640:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109e8:0x0].0x0 (ffff90cf1247c100)
00010000:00010000:2.0:1789431563.245652:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431563.245683:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635261c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.245700:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635261c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.245712:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635261c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.245932:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635261c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.245942:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635261c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.245951:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635261c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.246361:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635261ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x109e8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.246372:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635261ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.246382:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635261ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431563.247043:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1233, 64 off87104
00000100:00100000:3.0:1789431563.249911:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431563.249975:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635261d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x109e8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.249997:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635261d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.250011:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635261d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.250021:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635261d5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.250028:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635261d5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.250035:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635261d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.250078:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431563.250108:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635261ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.250116:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635261ce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x109e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.250124:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635261ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.250130:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.250135:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635261ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.250143:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635261ce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x109e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.250157:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109e8:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431563.250160:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431563.250167:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635261ce lrc: 2/0,0 mode: --/EX res: [0x200000401:0x109e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.250173:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635261ce lrc: 0/0,0 mode: --/EX res: [0x200000401:0x109e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.250201:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635261c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.250208:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635261c0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.250215:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635261c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.250224:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62dc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.250227:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635261c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.250233:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635261c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.250241:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c1:0x0].0x0 (ffff90ce05727100)
00010000:00010000:2.0:1789431563.250243:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.250246:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635261c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.250252:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635261c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431563.250262:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000997e2383 reply state 0000000030ce18e7 transno 4295120979 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635261c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.250272:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431563.250371:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933483648:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 4881us (5176us total) trans 4295120979 rc 0/0
00000100:00100000:2.0:1789431563.250382:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295990
00000100:00100000:2.0:1789431563.250533:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933483904
00000100:00100000:2.0:1789431563.250543:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933483904
00010000:00010000:3.0:1789431563.250872:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431563.250881:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635261d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109e8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.250891:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431563.250896:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635261d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109e8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.250904:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635261d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109e8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.250918:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109e8:0x0].0x0 (ffff90cf13195700)
00010000:00010000:3.0:1789431563.250921:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431563.250925:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635261d5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x109e8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.250932:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635261d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x109e8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.250950:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431563.250952:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431563.250954:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431563.259061:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295991
00000100:00100000:1.0:1789431563.259125:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933483904:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431563.259208:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431563.259250:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb6351f31e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6c32 expref: 307 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.259271:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a28:0x0].0x0 (ffff90ce211f4d00)
00010000:00010000:1.0:1789431563.259284:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431563.259312:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635261dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.259329:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635261dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.259341:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635261dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.259358:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635261e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b0:0x0].0x458ba0d4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.259364:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635261e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.259372:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635261e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.259537:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635261ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.259546:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635261ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.259553:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635261ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431563.260295:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1234, 64 off87168
00010000:00010000:1.0:1789431563.260377:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635261f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.260389:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635261f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.260399:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635261f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.260408:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635261f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.260415:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635261f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.260422:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635261f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.260445:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431563.260471:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635261ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.260483:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635261ea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.260489:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431563.260491:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635261ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.260500:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635261f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a28:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.260500:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.260508:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635261ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a28:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.260511:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431563.260521:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635261f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.260522:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635261ea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a28:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.260538:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635261f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a28:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.260545:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a28:0x0].0x0 (ffff90ce03149a00)
00010000:00010000:1.0:1789431563.260550:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431563.260555:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635261ea lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.260559:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a28:0x0].0x0 (ffff90ce03149a00)
00010000:00010000:1.0:1789431563.260564:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635261ea lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.260565:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431563.260571:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635261f1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a28:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.260580:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635261f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.260588:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635261dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.260598:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635261dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.260608:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635261dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.260613:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431563.260615:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.260617:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.260621:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431563.260621:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635261dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.260630:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635261dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.260639:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b0:0x0].0x0 (ffff90ce363db600)
00010000:00010000:1.0:1789431563.260641:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.260644:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635261dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.260650:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635261dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431563.260661:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bd28dc75 reply state 000000000098cfd9 transno 4295120980 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635261e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.260672:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431563.260802:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933483904:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1716us (10897us total) trans 4295120980 rc 0/0
00000100:00100000:1.0:1789431563.260812:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295991
00010000:00010000:1.0:1789431563.263668:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635261c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.263687:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635261c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.263696:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635261c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.263704:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.263708:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635261c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.263716:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635261c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.263742:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c1:0x0].0x8ee21578 (ffff90cf13195500)
00010000:00010000:1.0:1789431563.263745:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.263750:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635261c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.263758:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635261c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100c1:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.264751:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635261e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.264763:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635261e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.264770:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635261e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.264777:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.264780:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635261e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.264787:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635261e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.264800:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b0:0x0].0x458ba0d4 (ffff90ce03149300)
00010000:00010000:1.0:1789431563.264804:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.264809:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635261e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b0:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.264816:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635261e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b0:0x0].0x458ba0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.265149:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.265272:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933484160
00000100:00100000:0.0:1789431563.265287:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933484160
00000100:00100000:0.0:1789431563.265369:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295992
00000100:00100000:0.0:1789431563.265383:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933484160:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431563.265468:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431563.265503:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6351ad64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c5652 expref: 306 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.265524:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109ea:0x0].0x0 (ffff90ce2d731900)
00010000:00010000:0.0:1789431563.265535:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431563.265566:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635261f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.265591:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635261f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.265605:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635261f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.265624:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100c1:0x0].0x283705e2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.265631:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.265638:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.265799:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526206 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x109ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.265808:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526206 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.265816:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526206 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:0.0:1789431563.266506:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1235, 64 off87232
00010000:00010000:0.0:1789431563.267006:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352620d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x109ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267025:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352620d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267038:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352620d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267246:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352620d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267256:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352620d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267263:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352620d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267341:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431563.267381:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526206 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267388:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526206 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x109ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267396:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526206 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267403:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.267408:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526206 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267417:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526206 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x109ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267431:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109ea:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:0.0:1789431563.267435:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431563.267440:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526206 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x109ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267446:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526206 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x109ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267473:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635261f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267480:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635261f8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267487:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635261f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267492:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ace00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.267495:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635261f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267501:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635261f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267510:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c1:0x0].0x0 (ffff90ce05727100)
00010000:00010000:0.0:1789431563.267513:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.267516:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635261f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.267522:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635261f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431563.267538:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d70e9bba reply state 00000000860bb7ce transno 4295120981 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.267547:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431563.267668:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933484160:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2282us (2528us total) trans 4295120981 rc 0/0
00000100:00100000:0.0:1789431563.267679:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295992
00010000:00010000:2.0:1789431563.267993:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431563.268003:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352620d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109ea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.268011:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431563.268015:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352620d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109ea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.268024:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352620d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109ea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.268034:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109ea:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:2.0:1789431563.268037:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431563.268040:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352620d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x109ea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.268142:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352620d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x109ea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.268171:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431563.268174:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431563.268176:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431563.273171:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431563.273490:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.273493:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933484288
00000100:00100000:0.0:1789431563.273510:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933484288
00010000:00010000:1.0:1789431563.273514:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.273525:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.273532:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.273537:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.273545:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100c1:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.273564:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c1:0x0].0x283705e2 (ffff90ce07190400)
00010000:00010000:1.0:1789431563.273568:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.273574:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100c1:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.273581:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635261ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100c1:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.273597:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295993
00000100:00100000:0.0:1789431563.273612:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933484288:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431563.273648:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431563.273673:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526214 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c37 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.273883:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352621b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100ec:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.273903:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352621b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.273917:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352621b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.273933:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63526222 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100ec:0x0].0xa12f67b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.273940:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63526222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ec:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.273947:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63526222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ec:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.275840:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352621b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.275864:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352621b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.275873:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352621b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.275882:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.275888:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352621b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.275898:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352621b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.275916:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ec:0x0].0x0 (ffff90ce15f08f00)
00010000:00010000:0.0:1789431563.275919:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.275925:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352621b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.275931:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352621b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.275952:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63526222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ec:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.275958:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63526222 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100ec:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.275965:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63526222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ec:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.275970:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce19859200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.275972:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63526222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ec:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.275978:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63526222 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100ec:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.275985:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ec:0x0].0xa12f67b5 (ffff90ce07190700)
00010000:00010000:0.0:1789431563.275988:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.275991:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63526222 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100ec:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.275996:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63526222 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100ec:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.276491:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526214 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c37 expref: 307 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.276506:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ec:0x0].0x0 (ffff90ce15f08f00)
00010000:00010000:0.0:1789431563.276509:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.276513:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526214 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c37 expref: 307 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.276526:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad800, rc 0)
00000100:00100000:0.0:1789431563.276684:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933484288:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3073us (3526us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431563.276695:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295993
00000100:00100000:2.0:1789431563.283565:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.283688:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.283883:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933484544
00000100:00100000:0.0:1789431563.283898:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933484544
00000100:00100000:0.0:1789431563.284012:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933484672
00000100:00100000:0.0:1789431563.284017:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933484672
00000100:00100000:2.0:1789431563.284081:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295994
00000100:00100000:2.0:1789431563.284095:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933484544:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431563.284173:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431563.284210:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6351ef97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6b13 expref: 307 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.284238:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a26:0x0].0x0 (ffff90ce07190000)
00010000:00010000:2.0:1789431563.284254:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431563.284584:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526229 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.284605:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526229 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.284617:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526229 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.284634:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526230 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b0:0x0].0xb10fb57d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.284642:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.284649:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.284884:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526237 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.284894:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526237 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.284901:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526237 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.285537:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295995
00000100:00100000:0.0:1789431563.285558:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933484672:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431563.285578:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431563.285598:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352623e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c3e expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.285671:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526245 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.285684:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ec:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.285694:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ec:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431563.285741:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100ec:0x0]: returning size 16384
00000040:00080000:2.0:1789431563.286255:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1236, 64 off87296
00000004:00200000:0.0:1789431563.286439:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431563.286564:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100ec:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.286615:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352623e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c3e expref: 309 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.286647:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526245 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100ec:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c3e expref: 308 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.286656:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ec:0x0].0x0 (ffff90ce15f08f00)
00010000:00010000:1.0:1789431563.286660:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431563.286664:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ace00, rc 0)
00010000:00010000:2.0:1789431563.286678:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352624c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.286694:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352624c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.286705:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352624c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.286718:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352624c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.286736:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352624c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.286803:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933484672:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1253us (3111us total) trans 0 rc 0/0
00010000:00010000:2.0:1789431563.286811:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352624c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.286824:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295995
00010000:00010000:2.0:1789431563.286854:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431563.286881:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526237 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.286889:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526237 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.286896:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526237 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.286902:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.286906:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526237 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.286915:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526237 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.286927:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a26:0x0].0x0 (ffff90cf13195200)
00010000:00010000:2.0:1789431563.286930:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431563.286935:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526237 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.286945:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526237 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.286968:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526229 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.286975:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526229 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.286981:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526229 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.286987:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62dc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.286991:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526229 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.286998:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526229 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.287008:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b0:0x0].0x0 (ffff90ce363db600)
00010000:00010000:2.0:1789431563.287011:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.287014:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526229 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.287020:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526229 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431563.287031:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000aee750c4 reply state 000000008f80b694 transno 4295120982 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.287041:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431563.287157:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933484544:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3064us (3610us total) trans 4295120982 rc 0/0
00000100:00100000:2.0:1789431563.287166:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295994
00010000:00010000:0.0:1789431563.287270:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431563.289427:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352624c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.289441:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431563.289446:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352624c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.289463:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352624c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.289483:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a26:0x0].0x0 (ffff90cf13195200)
00010000:00010000:0.0:1789431563.289486:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431563.289492:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352624c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.289498:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352624c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.289533:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.289536:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.289538:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431563.291427:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.293967:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933484800
00000100:00100000:3.0:1789431563.293981:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933484800
00000100:00100000:3.0:1789431563.294044:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12469
00000100:00100000:3.0:1789431563.294082:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933484800:12345-192.168.203.4@tcp:37:dbench.0
00010000:00010000:1.0:1789431563.295976:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.295993:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526230 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.296002:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526230 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.296009:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.296014:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526230 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.296022:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526230 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.296038:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b0:0x0].0xb10fb57d (ffff90cf13195b00)
00010000:00010000:1.0:1789431563.296041:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.296084:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526230 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b0:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.296092:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526230 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b0:0x0].0xb10fb57d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.301922:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933484800:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 7825us (10490us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431563.301939:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12469
00000100:00100000:0.0:1789431563.329793:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.329993:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933485056
00000100:00100000:2.0:1789431563.330011:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933485056
00000100:00100000:2.0:1789431563.330121:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295996
00000100:00100000:2.0:1789431563.330132:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b5cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933485056:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431563.330190:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431563.330218:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb635201e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c70d8 expref: 307 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.330239:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a3a:0x0].0x0 (ffff90ce07190500)
00010000:00010000:2.0:1789431563.330257:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526245 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100ec:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c3e expref: 306 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.330266:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ec:0x0].0x0 (ffff90ce15f08f00)
00010000:00010000:2.0:1789431563.330269:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431563.330289:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526253 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.330301:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526253 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.330311:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526253 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.330324:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352625a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100ec:0x0].0xd4ab1204 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.330335:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352625a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100ec:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.330342:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352625a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100ec:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.330596:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526261 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.330605:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526261 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.330612:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526261 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431563.331659:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1237, 64 off87360
00010000:00010000:3.0:1789431563.332484:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526268 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332512:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332527:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332538:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526268 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332551:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526268 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332558:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332590:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431563.332625:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526261 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332632:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526261 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332639:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526261 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332646:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.332651:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526261 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332660:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526261 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332674:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a3a:0x0].0x0 (ffff90cf13195600)
00010000:00010000:3.0:1789431563.332678:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431563.332684:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526261 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332689:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526261 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332721:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526253 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332738:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526253 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332744:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526253 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332749:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.332751:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526253 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332758:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526253 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332765:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ec:0x0].0x0 (ffff90ce15f08f00)
00010000:00010000:3.0:1789431563.332768:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.332772:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526253 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.332778:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526253 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431563.332789:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000056208c58 reply state 000000001d75e427 transno 4295120983 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352625a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100ec:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.332798:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431563.332930:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b5cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933485056:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2794us (3148us total) trans 4295120983 rc 0/0
00000100:00100000:3.0:1789431563.332945:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295996
00010000:00010000:0.0:1789431563.333198:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431563.333206:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526268 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.333214:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cbc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431563.333217:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526268 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.333224:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.333234:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a3a:0x0].0x0 (ffff90cf13195600)
00010000:00010000:0.0:1789431563.333237:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431563.333240:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526268 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.333251:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526268 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.333270:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.333272:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.333274:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431563.337600:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352625a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100ec:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.337617:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352625a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100ec:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.337635:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352625a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100ec:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.337646:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62ce00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.337651:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352625a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100ec:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.337658:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352625a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100ec:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.337864:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ec:0x0].0xd4ab1204 (ffff90cf13195400)
00010000:00010000:1.0:1789431563.337868:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.337874:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352625a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100ec:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.337881:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352625a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100ec:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.342295:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.342492:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933485312
00000100:00100000:3.0:1789431563.342507:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933485312
00000100:00100000:3.0:1789431563.342588:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295997
00000100:00100000:3.0:1789431563.342601:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14616:x1876351933485312:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431563.342684:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431563.342720:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e75600/0xd8e438fb6351fb7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6ec4 expref: 306 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.342755:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a34:0x0].0x0 (ffff90ce2e707600)
00010000:00010000:3.0:1789431563.342769:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431563.342802:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352626f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.342819:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352626f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.342829:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352626f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.342845:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526276 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b0:0x0].0xe260ec82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.342852:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.342858:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.343006:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb6352627d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.343015:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb6352627d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.343021:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb6352627d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431563.344831:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1238, 64 off87424
00010000:00010000:3.0:1789431563.344935:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526284 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.344954:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526284 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.344966:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526284 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.344976:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526284 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.344983:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526284 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.344989:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526284 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.345016:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431563.345043:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb6352627d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.345139:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431563.345149:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526284 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a34:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.345581:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb6352627d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.345588:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb6352627d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.345633:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431563.345640:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526284 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.345650:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526284 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.345668:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a34:0x0].0x0 (ffff90cf18b78d00)
00010000:00010000:0.0:1789431563.345671:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431563.345677:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526284 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.345684:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526284 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.345703:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.345705:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.345707:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431563.345741:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.345755:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb6352627d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.345763:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb6352627d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.345774:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a34:0x0].0x0 (ffff90cf18b78d00)
00010000:00010000:3.0:1789431563.345776:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431563.345779:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb6352627d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.345785:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb6352627d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.345815:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352626f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.345822:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352626f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.345827:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352626f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.345832:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.345835:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352626f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.345840:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352626f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.345847:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b0:0x0].0x0 (ffff90ce363db600)
00010000:00010000:3.0:1789431563.345850:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.345853:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352626f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.345858:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352626f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431563.345868:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004a664c06 reply state 000000007e7525bb transno 4295120984 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.345877:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431563.346138:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933485312:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3532us (3858us total) trans 4295120984 rc 0/0
00000100:00100000:3.0:1789431563.346149:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295997
00010000:00010000:1.0:1789431563.355917:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.355947:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526276 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.355955:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526276 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.355962:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.356760:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526276 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.356835:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526276 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.356861:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b0:0x0].0xe260ec82 (ffff90cf18b78800)
00010000:00010000:1.0:1789431563.356865:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.356873:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526276 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b0:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.356880:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526276 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b0:0x0].0xe260ec82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.365006:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.365116:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.365875:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933485440
00000100:00100000:2.0:1789431563.365890:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933485440
00000100:00100000:2.0:1789431563.367585:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933485696
00000100:00100000:2.0:1789431563.367602:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933485696
00000100:00100000:2.0:1789431563.368842:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295998
00000100:00100000:3.0:1789431563.368858:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295999
00000100:00100000:2.0:1789431563.368869:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933485440:12345-192.168.203.4@tcp:101:dbench.0
00000100:00100000:3.0:1789431563.368876:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933485696:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431563.368978:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431563.369030:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63520386 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c716b expref: 307 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.369080:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a3d:0x0].0x0 (ffff90ce211f4f00)
00010000:00010000:3.0:1789431563.369095:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431563.369124:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352628b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.369153:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352628b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.369165:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352628b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.369183:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526292 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100ec:0x0].0x2f16ddac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.369190:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100ec:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.369196:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100ec:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.369339:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526299 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.369357:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526299 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.369364:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526299 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431563.369983:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1239, 64 off87552
00000004:00080000:3.0:1789431563.369993:0:6797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3021400943393ns, next at 3022400940554ns, rc = 0
00010000:00010000:3.0:1789431563.370110:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635262a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370122:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635262a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370133:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635262a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370140:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635262a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370147:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635262a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370154:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635262a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370180:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431563.370205:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526299 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370212:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526299 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370219:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526299 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370226:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.370231:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526299 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370240:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526299 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370250:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a3d:0x0].0x0 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431563.370253:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431563.370258:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526299 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370264:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526299 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370283:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352628b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370290:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352628b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370296:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352628b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370301:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.370304:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352628b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370309:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352628b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370317:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ec:0x0].0x0 (ffff90ce15f08f00)
00010000:00010000:3.0:1789431563.370319:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.370322:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352628b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.370328:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352628b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431563.370337:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000035a904b4 reply state 00000000f24e0961 transno 4295120985 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100ec:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.370351:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431563.370464:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933485696:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1591us (5343us total) trans 4295120985 rc 0/0
00000100:00100000:3.0:1789431563.370473:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295999
00010000:00010000:3.0:1789431563.371121:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431563.371140:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635262a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.371150:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431563.371154:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635262a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.371163:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635262a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.371175:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a3d:0x0].0x0 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431563.371178:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431563.371182:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635262a0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.371188:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb635262a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.371209:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431563.371211:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431563.371213:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431563.371947:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431563.371976:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c45 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.372082:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.372097:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.372110:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.372128:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.372134:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.372141:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.372862:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100ec:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.372876:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526292 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100ec:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.372884:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526292 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100ec:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.372891:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.372897:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526292 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100ec:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.372905:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526292 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100ec:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.372922:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ec:0x0].0x2f16ddac (ffff90cf18b78d00)
00010000:00010000:1.0:1789431563.372925:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.372930:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526292 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100ec:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.372937:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526292 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100ec:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373371:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635262bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10a37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373386:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635262bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373397:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635262bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431563.373447:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10a37:0x0]: returning size 18630
00000004:00200000:2.0:1789431563.373452:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431563.373477:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635262bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373491:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635262bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10a37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373500:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373511:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373517:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373523:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.373527:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373533:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373542:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b0:0x0].0x0 (ffff90ce363db600)
00010000:00010000:2.0:1789431563.373545:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.373549:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373555:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373566:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373573:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373578:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373583:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62cc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.373587:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373593:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373599:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b0:0x0].0x8849861e (ffff90cf13195300)
00010000:00010000:2.0:1789431563.373602:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.373605:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373611:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373665:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c45 expref: 308 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373681:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635262bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10a37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c45 expref: 307 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.373689:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a37:0x0].0x0 (ffff90ce2e707400)
00010000:00010000:2.0:1789431563.373691:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431563.373694:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62ce00, rc 0)
00000100:00100000:2.0:1789431563.373788:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933485440:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4932us (8796us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.373799:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295998
00000100:00100000:0.0:1789431563.386516:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.386744:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.386786:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933485824
00000100:00100000:0.0:1789431563.386800:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933485824
00000100:00100000:0.0:1789431563.386886:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14349
00000100:00100000:0.0:1789431563.386900:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:2349:x1876351933485824:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431563.386921:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431563.386954:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635262bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c45 expref: 307 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.386976:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a37:0x0].0x0 (ffff90ce2e707400)
00010000:00010000:0.0:1789431563.386982:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431563.387095:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:2349:x1876351933485824:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 198us (350us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431563.387102:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14349
00000100:00100000:2.0:1789431563.387898:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933486080
00000100:00100000:2.0:1789431563.387909:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933486080
00000100:00100000:2.0:1789431563.388012:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296000
00000100:00100000:2.0:1789431563.388023:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933486080:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431563.388152:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431563.388179:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613e00/0xd8e438fb6352046d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c71b8 expref: 306 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.388198:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a3f:0x0].0x0 (ffff90ce15f08a00)
00010000:00010000:2.0:1789431563.388211:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431563.388239:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.388256:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.388297:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.388315:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100ec:0x0].0x3b73c5df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.388324:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100ec:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.388331:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100ec:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.388475:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.388484:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.388492:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431563.389207:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1240, 64 off87616
00010000:00010000:2.0:1789431563.389289:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635262d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389301:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635262d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389310:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635262d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389318:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635262d8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389325:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635262d8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389331:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635262d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389357:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431563.389384:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389390:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389396:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389402:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.389408:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389416:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389427:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a3f:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431563.389430:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431563.389435:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389441:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635262d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389460:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389467:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389473:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389479:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.389482:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389488:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389496:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ec:0x0].0x0 (ffff90ce15f08f00)
00010000:00010000:2.0:1789431563.389499:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.389503:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.389514:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431563.389524:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000047a5f9f6 reply state 00000000d48b57ff transno 4295120986 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100ec:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.389534:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431563.390101:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431563.390111:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635262d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.390119:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431563.390122:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635262d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.390130:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635262d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.390140:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a3f:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:0.0:1789431563.390143:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431563.390147:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635262d8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.390153:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635262d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.390173:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.390176:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.390178:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431563.390488:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933486080:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1614us (3133us total) trans 4295120986 rc 0/0
00000100:00100000:2.0:1789431563.390507:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296000
00000100:00100000:0.0:1789431563.393549:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.393699:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933486336
00000100:00100000:2.0:1789431563.393717:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933486336
00000100:00100000:2.0:1789431563.394019:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296001
00000100:00100000:2.0:1789431563.394033:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933486336:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431563.394192:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431563.394231:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb6352000d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c703e expref: 307 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.394258:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a37:0x0].0x0 (ffff90ce2e707400)
00010000:00010000:1.0:1789431563.394271:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100ec:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.394271:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431563.394284:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100ec:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.394293:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100ec:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.394300:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62cc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.394306:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100ec:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.394315:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100ec:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.394327:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100ec:0x0].0x3b73c5df (ffff90cf13195300)
00010000:00010000:1.0:1789431563.394330:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.394335:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100ec:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.394341:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635262ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100ec:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.394533:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635262df lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.394551:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635262df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.394563:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635262df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.396326:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635262e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.396358:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635262e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.396373:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635262e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.396546:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635262ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.396555:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635262ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.396562:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635262ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431563.397314:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1241, 64 off87680
00010000:00010000:2.0:1789431563.397395:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397409:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397418:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397426:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397432:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397438:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397454:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431563.397481:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635262ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397487:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635262ed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397494:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635262ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397500:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62ce00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.397505:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635262ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397513:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635262ed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397527:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a37:0x0].0x0 (ffff90cf13195600)
00010000:00010000:2.0:1789431563.397531:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431563.397536:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635262ed lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397542:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635262ed lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397563:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635262df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397572:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635262df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397577:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635262df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397582:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.397585:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635262df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397591:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635262df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397600:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b0:0x0].0x0 (ffff90ce363db600)
00010000:00010000:2.0:1789431563.397602:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.397605:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635262df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.397610:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635262df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431563.397619:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f3340108 reply state 000000001212feb9 transno 4295120987 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635262e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.397629:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431563.397756:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933486336:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3720us (4219us total) trans 4295120987 rc 0/0
00000100:00100000:2.0:1789431563.397766:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296001
00010000:00010000:0.0:1789431563.397810:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431563.397819:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.397826:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431563.397830:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.397838:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.397850:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a37:0x0].0x0 (ffff90cf13195600)
00010000:00010000:0.0:1789431563.397854:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431563.397857:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262f4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.397862:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635262f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.397878:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.397879:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.397881:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431563.400954:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635262e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.400976:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635262e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.400984:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635262e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.400990:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62dc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.400996:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635262e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.401005:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635262e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.401025:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b0:0x0].0x8849861e (ffff90cf13195400)
00010000:00010000:1.0:1789431563.401028:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.401034:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635262e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.401041:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635262e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b0:0x0].0x8849861e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.405462:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.405670:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933486464
00000100:00100000:3.0:1789431563.405683:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933486464
00000100:00100000:3.0:1789431563.405768:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296002
00000100:00100000:3.0:1789431563.405781:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07453450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933486464:12345-192.168.203.4@tcp:41:dbench.0
00000004:00000024:3.0:1789431563.405868:0:6797:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7643070464 avail 7517241344
00000100:00100000:3.0:1789431563.405960:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07453450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933486464:12345-192.168.203.4@tcp:41:dbench.0 Request processed in 181us (511us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431563.405968:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296002
00000100:00100000:3.0:1789431563.410020:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.410474:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933486720
00000100:00100000:0.0:1789431563.410488:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933486720
00000100:00100000:0.0:1789431563.410620:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296003
00000100:00100000:0.0:1789431563.410632:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14616:x1876351933486720:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431563.410711:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431563.410765:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb6351fda5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6f73 expref: 306 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.410789:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a36:0x0].0x0 (ffff90ce211f4800)
00010000:00010000:0.0:1789431563.410802:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431563.410830:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635262fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.410849:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635262fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.410860:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635262fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.410876:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526302 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b0:0x0].0x7eb5c453 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.410882:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526302 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.410888:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526302 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.411026:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526309 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.411037:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526309 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.411045:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526309 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:0.0:1789431563.411743:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1239, 64 off87488
00010000:00010000:0.0:1789431563.411817:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526310 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.411829:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.411839:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.411847:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526310 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.411853:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526310 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.411861:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526310 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.411895:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431563.411920:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526309 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.411927:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526309 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.411937:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526309 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.411943:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.411948:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526309 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.411956:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526309 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.411966:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a36:0x0].0x0 (ffff90ce07190d00)
00010000:00010000:0.0:1789431563.411969:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431563.411973:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526309 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.411980:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526309 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.412001:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635262fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.412007:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635262fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.412013:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635262fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.412019:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.412022:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635262fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.412032:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635262fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.412040:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b0:0x0].0x0 (ffff90ce363db600)
00010000:00010000:0.0:1789431563.412043:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.412045:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635262fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.412090:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635262fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431563.412102:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007def39ad reply state 000000009ca5aee2 transno 4295120988 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526302 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.412112:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431563.412229:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933486720:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1596us (2220us total) trans 4295120988 rc 0/0
00000100:00100000:0.0:1789431563.412239:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296003
00010000:00010000:3.0:1789431563.412640:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431563.412652:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526310 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.412660:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ace00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431563.412663:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526310 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.412670:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526310 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.412681:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a36:0x0].0x0 (ffff90ce07190d00)
00010000:00010000:3.0:1789431563.412684:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431563.412688:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526310 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.412694:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526310 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.412715:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431563.412718:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431563.412720:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431563.417542:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.418029:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933486848
00000100:00100000:3.0:1789431563.418044:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933486848
00000100:00100000:3.0:1789431563.420361:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296004
00000100:00100000:3.0:1789431563.420377:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933486848:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431563.420405:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431563.420435:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526317 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c4c expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.420526:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352631e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.420544:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352631e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.420558:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352631e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.420575:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526325 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x39269a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.420583:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x39269a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.420589:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x39269a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.421311:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526302 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.421325:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526302 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.421334:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526302 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.421341:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.421346:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526302 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.421355:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526302 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b0:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.421371:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b0:0x0].0x7eb5c453 (ffff90ce07190700)
00010000:00010000:1.0:1789431563.421374:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.421381:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526302 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b0:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.421387:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526302 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b0:0x0].0x7eb5c453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.424552:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352631e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.424563:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352631e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.424572:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352631e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.424584:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.424589:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352631e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.426147:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352631e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.426173:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431563.426178:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.426186:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352631e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.426193:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352631e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.426216:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x39269a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.426224:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526325 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x39269a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.426230:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x39269a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.426235:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.426239:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x39269a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.426244:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526325 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x39269a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.426256:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x39269a67 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431563.426259:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.426261:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526325 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x39269a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.426266:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526325 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x39269a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.426330:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526317 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c4c expref: 307 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.426340:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431563.426342:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.426345:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526317 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c4c expref: 307 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.426354:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb800, rc 0)
00000100:00100000:3.0:1789431563.426451:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933486848:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6076us (8922us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431563.426460:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296004
00000100:00100000:0.0:1789431563.432170:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.432393:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933486976
00000100:00100000:3.0:1789431563.432408:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933486976
00000100:00100000:3.0:1789431563.432488:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296005
00000100:00100000:3.0:1789431563.432501:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933486976:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431563.432535:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431563.432562:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb6352632c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c53 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.432659:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbe00/0xd8e438fb63526333 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.432679:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbe00/0xd8e438fb63526333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.432699:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbe00/0xd8e438fb63526333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431563.432756:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008c:0x0]: returning size 16384
00000004:00200000:3.0:1789431563.433026:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431563.435339:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbe00/0xd8e438fb63526333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.435414:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb6352632c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c53 expref: 308 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.435447:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbe00/0xd8e438fb63526333 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c53 expref: 307 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.435457:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431563.435461:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:2.0:1789431563.435466:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cbe00, rc 0)
00000100:00100000:2.0:1789431563.435641:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933486976:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3141us (3484us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.435653:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296005
00000100:00100000:2.0:1789431563.441189:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.441235:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.441431:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933487232
00000100:00100000:1.0:1789431563.441445:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933487232
00000100:00100000:1.0:1789431563.441521:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296006
00000100:00100000:1.0:1789431563.441534:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933487232:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431563.441575:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431563.441603:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352633a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c5a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.441697:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526341 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.441716:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526341 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.441747:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526341 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.441877:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526348 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa12f67b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.441887:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.441896:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.442043:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526341 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.442561:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933487104
00000100:00100000:0.0:1789431563.442571:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933487104
00000100:00100000:0.0:1789431563.442641:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12470
00000100:00100000:0.0:1789431563.442653:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933487104:12345-192.168.203.4@tcp:37:dbench.0
00010000:00010000:1.0:1789431563.443493:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526341 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.443504:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526341 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.443510:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.443516:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526341 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.443532:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526341 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.443552:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431563.443556:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.443563:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526341 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.443569:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526341 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.443587:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.443594:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526348 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.443601:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.443606:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.443609:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.443615:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526348 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100b8:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.445908:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0xa12f67b5 (ffff90ce03149300)
00010000:00010000:1.0:1789431563.446839:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.446854:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526348 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.446869:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526348 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.447388:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352633a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c5a expref: 309 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.447406:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:1.0:1789431563.447410:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.447415:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352633a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c5a expref: 309 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.447429:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309200, rc 0)
00000100:00100000:1.0:1789431563.447549:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933487232:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6015us (6310us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431563.447559:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296006
00000100:00100000:2.0:1789431563.464854:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.465127:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933487488
00000100:00100000:0.0:1789431563.465143:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933487488
00000100:00100000:0.0:1789431563.465220:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296007
00000100:00100000:0.0:1789431563.465232:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933487488:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431563.465304:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:0.0:1789431563.465343:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63523bc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a82:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8282 expref: 308 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.465368:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a82:0x0].0x0 (ffff90cf11d83400)
00010000:00010000:0.0:1789431563.465389:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63525437 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100b8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8927 expref: 307 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.465400:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431563.465403:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431563.465430:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352634f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.465447:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352634f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.465457:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352634f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.465472:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526356 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.465478:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526356 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.465483:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526356 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.465614:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352635d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.465634:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352635d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.465641:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352635d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.466878:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933487104:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 24215us (25693us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.466893:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12470
00000040:00080000:0.0:1789431563.468485:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1240, 64 off87552
00000004:00080000:0.0:1789431563.468501:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3021499451127ns, next at 3022499447420ns, rc = 0
00010000:00010000:0.0:1789431563.468601:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526364 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.468735:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a82:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.468753:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a82:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.468764:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526364 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a82:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.468772:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526364 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a82:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.468778:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526364 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a82:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.468861:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431563.468892:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352635d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.468899:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352635d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.468907:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352635d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.468931:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.468937:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352635d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.468945:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352635d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.468961:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a82:0x0].0x0 (ffff90ce07190200)
00010000:00010000:0.0:1789431563.468964:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431563.468970:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352635d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.468977:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb6352635d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.469003:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352634f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.469009:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352634f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.469015:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352634f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.469021:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.469024:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352634f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.469029:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352634f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.469042:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x0 (ffff90ce2727ae00)
00010000:00010000:0.0:1789431563.469045:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.469083:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352634f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.469090:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352634f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431563.469102:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e42ff069 reply state 00000000513f6296 transno 4295120989 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526356 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.469113:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431563.469217:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14616:x1876351933487488:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3983us (4375us total) trans 4295120989 rc 0/0
00000100:00100000:0.0:1789431563.469227:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296007
00010000:00010000:3.0:1789431563.469420:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431563.469429:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526364 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a82:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.469437:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431563.469440:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526364 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a82:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.469447:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526364 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a82:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.469455:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a82:0x0].0x0 (ffff90ce07190200)
00010000:00010000:3.0:1789431563.469458:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431563.469461:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526364 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a82:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.469466:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526364 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a82:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.469491:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431563.469492:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431563.469494:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431563.473103:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526356 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.473127:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526356 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.473136:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526356 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.473143:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.473149:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526356 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.473165:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526356 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.473186:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100b8:0x0].0x22737f46 (ffff90ce07190100)
00010000:00010000:1.0:1789431563.473189:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.473195:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526356 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.473202:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526356 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100b8:0x0].0x22737f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.481312:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.481501:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933487616
00000100:00100000:1.0:1789431563.481516:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933487616
00000100:00100000:1.0:1789431563.481591:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296008
00000100:00100000:1.0:1789431563.481783:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+306:14617:x1876351933487616:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431563.481820:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431563.481848:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352636b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c61 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.481936:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526372 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.481955:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526372 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.481970:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526372 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.481985:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526379 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.481993:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.482000:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.482173:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526380 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.482183:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.482191:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431563.482235:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008e:0x0]: returning size 260096
00000004:00200000:1.0:1789431563.482240:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431563.482264:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.482278:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.482288:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526372 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.482295:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526372 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.482303:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526372 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.482313:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.482319:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526372 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.482328:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526372 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.487278:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431563.487294:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.487312:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526372 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.487325:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526372 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.487357:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.487364:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526379 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.487372:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526379 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.487378:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.487384:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526379 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.487393:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526379 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.487417:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x6428115e (ffff90ce03149300)
00010000:00010000:1.0:1789431563.487421:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.487424:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526379 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.487431:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526379 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.487501:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352636b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c61 expref: 308 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.487519:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c61 expref: 307 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.487527:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:1.0:1789431563.487529:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431563.487532:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:2.0:1789431563.487966:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933487616:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6254us (6665us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.487978:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296008
00000100:00100000:2.0:1789431563.495827:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.496121:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933487872
00000100:00100000:3.0:1789431563.496135:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933487872
00000100:00100000:3.0:1789431563.496219:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296009
00000100:00100000:3.0:1789431563.496232:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+307:14617:x1876351933487872:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431563.496272:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431563.496305:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526387 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c68 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.496464:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.496485:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63510923 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2345 expref: 308 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.496494:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526380 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c61 expref: 308 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.496505:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 5/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.496556:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c61 expref: 308 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.496574:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c61 expref: 308 pid: 5849 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.496593:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce35e47100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894219648:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431563.497591:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63510923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2345 expref: 308 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.497607:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63510923 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2345 expref: 308 pid: 12775 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.497622:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce35e46300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894219776:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431563.497700:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf377c66c0 going to sleep for 11 seconds
00000100:00100000:2.0:1789431563.500532:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.500648:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933488000
00000100:00100000:3.0:1789431563.500662:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933488000
00000100:00100000:3.0:1789431563.500749:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296010
00000100:00100000:3.0:1789431563.500777:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933488000:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431563.500805:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431563.500836:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526395 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c6f expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.500924:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352639c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100c0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.500944:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352639c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.500958:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352639c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431563.501004:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100c0:0x0]: returning size 16384
00000004:00200000:3.0:1789431563.501009:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431563.501035:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352639c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.501116:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526395 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c6f expref: 311 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.501141:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352639c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c6f expref: 310 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.501151:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c0:0x0].0x0 (ffff90ce2d721600)
00010000:00010000:3.0:1789431563.501155:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431563.501159:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb200, rc 0)
00000100:00100000:3.0:1789431563.501232:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933488000:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 458us (715us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431563.501240:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296010
00000100:00100000:0.0:1789431563.504755:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.505026:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933488128
00000100:00100000:1.0:1789431563.505040:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933488128
00010000:00010000:1.0:1789431563.505124:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526380 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c61 expref: 310 pid: 5849 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.505174:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16510
00000100:00100000:1.0:1789431563.505186:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:2350:x1876351933488128:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431563.505207:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431563.505215:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526380 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c61 expref: 310 pid: 5849 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.505235:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c61 expref: 310 pid: 5849 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.505273:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:1.0:1789431563.505280:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.505292:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.505299:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431563.505361:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:2350:x1876351933488128:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 177us (621us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431563.505370:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16510
00010000:00010000:2.0:1789431563.511315:0:12181:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@00000000d82ebca3 x1876351894219648) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526380 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c61 expref: 309 pid: 5849 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.511349:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526380 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c61 expref: 309 pid: 5849 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.511373:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce35e47100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894219648:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431563.514245:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.514501:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce35e46300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894219776:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431563.514542:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:1.0:1789431563.514551:0:12181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.514565:0:12181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.514576:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.515070:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933488256
00000100:00100000:2.0:1789431563.515080:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933488256
00000100:00100000:2.0:1789431563.515151:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296011
00000100:00100000:2.0:1789431563.515163:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933488256:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431563.515188:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431563.515215:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635263a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c76 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.515309:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.515325:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.515338:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.515357:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100c0:0x0].0xa12f67b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.515365:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.515372:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.515643:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.515653:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.515660:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.515667:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.515673:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.515682:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.515695:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c0:0x0].0x0 (ffff90ce2d721600)
00010000:00010000:2.0:1789431563.515698:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.515704:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.515711:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.515736:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.515752:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.516879:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.517099:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933488384
00000100:00100000:0.0:1789431563.517111:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933488384
00010000:00010000:0.0:1789431563.517158:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63510923 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2345 expref: 311 pid: 12775 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.517195:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16511
00000100:00100000:0.0:1789431563.517206:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:2347:x1876351933488384:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431563.517225:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431563.517232:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63510923 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2345 expref: 311 pid: 12775 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.517254:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63510923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2345 expref: 311 pid: 12775 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.517290:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63510923 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2345 expref: 311 pid: 12775 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.517311:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:0.0:1789431563.517318:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.517329:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.517338:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.517375:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431563.517440:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:2347:x1876351933488384:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 236us (572us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431563.517449:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16511
00010000:00010000:3.0:1789431563.517597:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.517607:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431563.517634:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008e:0x0]: returning size 260096
00010000:00010000:2.0:1789431563.518090:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.518100:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.518105:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.518115:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.518129:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c0:0x0].0xa12f67b5 (ffff90cf13195200)
00010000:00010000:2.0:1789431563.518132:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.518137:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100c0:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.518145:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100c0:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.518210:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635263a3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c76 expref: 310 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.518221:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c0:0x0].0x0 (ffff90ce2d721600)
00010000:00010000:2.0:1789431563.518224:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.518229:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635263a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c76 expref: 310 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.518239:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62d200, rc 0)
00000100:00100000:2.0:1789431563.518293:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933488256:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3133us (4064us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431563.518301:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296011
00010000:00010000:3.0:1789431563.519246:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526387 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c68 expref: 309 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.519290:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c68 expref: 308 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.519300:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:3.0:1789431563.519303:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431563.519306:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cba00, rc 0)
00000100:00100000:3.0:1789431563.519366:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933487872:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 23136us (23554us total) trans 4295120990 rc 0/0
00000100:00100000:3.0:1789431563.519374:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296009
00000100:00100000:3.0:1789431563.527486:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.528544:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933488512
00000100:00100000:1.0:1789431563.528561:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933488512
00000100:00100000:1.0:1789431563.528768:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12471
00000100:00100000:1.0:1789431563.528782:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933488512:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:2.0:1789431563.534857:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.535041:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933488640
00000100:00100000:1.0:1789431563.535071:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933488640
00000100:00100000:1.0:1789431563.535204:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296012
00000100:00100000:1.0:1789431563.535217:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933488640:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431563.535247:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431563.535287:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635263bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c7d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.535406:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635263c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.535426:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c68 expref: 311 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.535438:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635263c6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.535485:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c68 expref: 311 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.535501:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c68 expref: 311 pid: 12181 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.535519:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b2c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894219904:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431563.535635:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead900 going to sleep for 11 seconds
00000100:00100000:0.0:1789431563.539297:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933488512:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 10504us (11811us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431563.539314:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12471
00000100:00100000:1.0:1789431563.542367:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b2c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894219904:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431563.542421:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635263c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.542594:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.542734:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933488768
00000100:00100000:3.0:1789431563.542863:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933488768
00010000:00010000:3.0:1789431563.542916:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c68 expref: 310 pid: 12181 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.543114:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16512
00000100:00100000:3.0:1789431563.543126:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:2348:x1876351933488768:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431563.543146:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431563.543155:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c68 expref: 310 pid: 12181 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.543169:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c68 expref: 310 pid: 12181 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.543197:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb6352638e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c68 expref: 310 pid: 12181 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.543217:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:3.0:1789431563.543222:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635263c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.543234:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635263c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.543243:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635263c6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.543344:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431563.543413:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:2348:x1876351933488768:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 288us (820us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431563.543422:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16512
00010000:00010000:2.0:1789431563.543496:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635263c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.543505:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635263c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431563.543573:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008e:0x0]: returning size 260096
00000004:00200000:2.0:1789431563.543578:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431563.543607:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635263c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.543650:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635263bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c7d expref: 309 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.543669:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635263c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c7d expref: 308 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.543678:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:2.0:1789431563.543681:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431563.543684:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:2.0:1789431563.543717:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933488640:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8503us (9000us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.543736:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296012
00000100:00100000:2.0:1789431563.553905:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.554086:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933488896
00000100:00100000:0.0:1789431563.554100:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933488896
00000100:00100000:0.0:1789431563.554182:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296013
00000100:00100000:0.0:1789431563.554196:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14616:x1876351933488896:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431563.554227:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431563.554264:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635263cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c84 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.554355:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635263d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.554374:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635263d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.554389:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635263d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.554407:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635263db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.554414:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635263db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.554421:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635263db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.554897:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635263e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x109de:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.554908:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635263e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109de:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.554916:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635263e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109de:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431563.554964:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x109de:0x0]: returning size 543
00000004:00200000:0.0:1789431563.554970:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431563.554993:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635263e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109de:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.555007:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635263e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109de:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.555016:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635263d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.555023:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635263d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.555031:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635263d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.555037:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.555092:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635263d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.555102:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635263d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.555115:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c0:0x0].0x0 (ffff90ce2d721600)
00010000:00010000:0.0:1789431563.555118:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.555124:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635263d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.555130:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635263d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.555144:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635263db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.555154:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635263db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.555160:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635263db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.555165:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.555167:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635263db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.555173:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635263db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.555181:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c0:0x0].0xb0449b87 (ffff90ce07190200)
00010000:00010000:0.0:1789431563.555183:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.555186:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635263db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.555191:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635263db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.555232:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635263cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c84 expref: 310 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.555248:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635263e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x109de:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c84 expref: 309 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.555312:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109de:0x0].0x0 (ffff90ce0be62400)
00010000:00010000:0.0:1789431563.555315:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431563.555318:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ac400, rc 0)
00000100:00100000:0.0:1789431563.555398:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933488896:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1205us (1509us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431563.555407:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296013
00000100:00100000:0.0:1789431563.565235:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.565294:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.565447:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933489280
00000100:00100000:3.0:1789431563.565461:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933489280
00000100:00100000:3.0:1789431563.565549:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14350
00000100:00100000:3.0:1789431563.565561:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:2348:x1876351933489280:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431563.565580:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431563.565615:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635263e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109de:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c84 expref: 309 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.565640:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109de:0x0].0x0 (ffff90ce0be62400)
00010000:00010000:3.0:1789431563.565646:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431563.565722:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:2348:x1876351933489280:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 163us (426us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431563.565738:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14350
00000100:00100000:2.0:1789431563.566490:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933489152
00000100:00100000:2.0:1789431563.566500:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933489152
00000100:00100000:2.0:1789431563.566555:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12472
00000100:00100000:2.0:1789431563.566565:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933489152:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431563.567142:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933489152:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 575us (1918us total) trans 4295120991 rc 0/0
00000100:00100000:2.0:1789431563.567150:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12472
00010000:00010000:0.0:1789431563.568181:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431563.574320:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.574538:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933489536
00000100:00100000:2.0:1789431563.574553:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933489536
00000100:00100000:2.0:1789431563.574631:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296014
00000100:00100000:2.0:1789431563.574645:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933489536:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431563.574732:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431563.574901:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bae3e00/0xd8e438fb6351a8c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109de:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c54c3 expref: 309 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.574928:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109de:0x0].0x0 (ffff90ce0be62400)
00010000:00010000:2.0:1789431563.574955:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352639c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100c0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c6f expref: 308 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.574964:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c0:0x0].0x0 (ffff90ce2d721600)
00010000:00010000:2.0:1789431563.574968:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431563.574997:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263e9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.575020:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.575032:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.575110:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.575119:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.575126:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.575512:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635263f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x109de:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.575521:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635263f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109de:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.575529:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635263f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109de:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431563.576697:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1241, 64 off87616
00010000:00010000:2.0:1789431563.577120:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635263fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x109de:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577139:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635263fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577151:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635263fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577161:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635263fe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577167:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635263fe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577173:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635263fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577266:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431563.577303:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635263f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109de:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577310:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635263f7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x109de:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577317:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635263f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109de:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577323:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.577328:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635263f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109de:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577336:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635263f7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x109de:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577348:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109de:0x0].0x0 (ffff90cf13195b00)
00010000:00010000:2.0:1789431563.577352:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431563.577357:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635263f7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x109de:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577367:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb635263f7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x109de:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577390:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577397:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263e9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577403:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577408:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.577410:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577415:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263e9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577423:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c0:0x0].0x0 (ffff90ce2d721600)
00010000:00010000:2.0:1789431563.577425:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.577428:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.577434:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635263e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431563.577445:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d6fd918e reply state 000000003bba35fa transno 4295120992 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.577456:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431563.577643:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933489536:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2996us (3337us total) trans 4295120992 rc 0/0
00000100:00100000:2.0:1789431563.577653:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296014
00010000:00010000:0.0:1789431563.579317:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431563.579333:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635263fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.579344:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62dc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431563.579348:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635263fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.579360:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635263fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.579377:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109de:0x0].0x0 (ffff90cf13195b00)
00010000:00010000:0.0:1789431563.579380:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431563.579386:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635263fe lrc: 1/0,0 mode: --/PW res: [0x200000401:0x109de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.579392:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635263fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x109de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.579430:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.579432:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.579433:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431563.580113:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.580214:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933489664
00000100:00100000:3.0:1789431563.580227:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933489664
00000100:00100000:3.0:1789431563.580311:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296015
00000100:00100000:3.0:1789431563.580324:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933489664:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431563.580358:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431563.580382:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526405 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c8b expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.580459:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352640c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.580476:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352640c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.580490:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352640c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.580507:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526413 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.580514:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.580521:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.580654:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352641a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.580664:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352641a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.580672:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352641a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431563.580718:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008e:0x0]: returning size 260096
00000004:00200000:3.0:1789431563.580733:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431563.581175:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352641a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.581192:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352641a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.581202:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352640c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.581212:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352640c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.581218:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352640c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.581224:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.581229:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352640c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.581237:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352640c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.581250:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431563.581431:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.581438:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352640c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.581445:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb6352640c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.581464:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.581471:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526413 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.581477:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.581483:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.581486:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.581492:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526413 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.581500:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x6428115e (ffff90cf18b78f00)
00010000:00010000:3.0:1789431563.581502:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.581505:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526413 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.581511:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526413 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.581559:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526405 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c8b expref: 311 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.581576:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352641a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c8b expref: 310 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.581583:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:3.0:1789431563.581586:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431563.581588:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cac00, rc 0)
00000100:00100000:3.0:1789431563.581681:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933489664:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1359us (1575us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431563.581691:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296015
00010000:00010000:1.0:1789431563.586035:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.586094:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.586103:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.586110:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.586116:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.586125:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.586146:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c0:0x0].0xb0449b87 (ffff90cf13195200)
00010000:00010000:1.0:1789431563.586149:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.586156:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.586163:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635263f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100c0:0x0].0xb0449b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.594247:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.594712:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933489792
00000100:00100000:0.0:1789431563.594736:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933489792
00000100:00100000:0.0:1789431563.594913:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14351
00000100:00100000:0.0:1789431563.594926:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:2350:x1876351933489792:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431563.594946:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431563.594981:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb6352641a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c8b expref: 309 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.595005:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:0.0:1789431563.595012:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431563.595146:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:2350:x1876351933489792:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 222us (913us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431563.595154:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14351
00000100:00100000:1.0:1789431563.595941:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.597091:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933490048
00000100:00100000:3.0:1789431563.597109:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933490048
00000100:00100000:3.0:1789431563.597188:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296016
00000100:00100000:3.0:1789431563.597200:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+308:14617:x1876351933490048:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431563.597234:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431563.597262:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526421 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c92 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.597408:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526428 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.597428:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635263c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c7d expref: 309 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.597439:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526428 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.597485:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635263c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c7d expref: 309 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.597502:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635263c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c7d expref: 309 pid: 5848 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.597521:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce35e47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894220032:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431563.597652:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf377c66c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431563.602652:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce35e47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894220032:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431563.602707:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526428 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.608235:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.608938:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.609253:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933490432
00000100:00100000:3.0:1789431563.609276:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933490432
00000100:00100000:0.0:1789431563.609662:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296017
00000100:00100000:0.0:1789431563.609676:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933490432:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431563.609892:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431563.609937:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63516fb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109e2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c41de expref: 310 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.609968:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109e2:0x0].0x0 (ffff90cf06585a00)
00010000:00010000:0.0:1789431563.609983:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431563.610018:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352642f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.610038:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352642f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.610101:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352642f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.610122:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526436 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100c0:0x0].0x5a114248 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.610131:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526436 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.610138:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526436 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.610485:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352643d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x109e2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.610495:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352643d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.610503:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352643d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431563.613273:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1242, 64 off87680
00010000:00010000:1.0:1789431563.613630:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526444 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x109e2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.613653:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526444 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.613666:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526444 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.613676:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526444 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.613683:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526444 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.613689:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526444 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.613733:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431563.614012:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352643d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109e2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.614021:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352643d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x109e2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.614027:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352643d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109e2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.614034:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.614039:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352643d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109e2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.614078:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352643d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x109e2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.614093:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109e2:0x0].0x0 (ffff90ce07190100)
00010000:00010000:1.0:1789431563.614097:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431563.614103:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352643d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x109e2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.614110:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352643d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x109e2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.614139:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352642f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.614146:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352642f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.614152:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352642f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.614158:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.614161:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352642f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.614167:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352642f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.614176:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c0:0x0].0x0 (ffff90ce2d721600)
00010000:00010000:1.0:1789431563.614179:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.614183:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352642f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.614193:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352642f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431563.614205:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c18fcbf5 reply state 000000000d3bc341 transno 4295120993 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526436 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.614216:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431563.614521:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431563.614531:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526444 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109e2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.614539:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431563.614543:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526444 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109e2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.614550:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526444 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109e2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.614561:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109e2:0x0].0x0 (ffff90ce07190100)
00010000:00010000:3.0:1789431563.614564:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431563.614568:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526444 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x109e2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.614574:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526444 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x109e2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.614598:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431563.614600:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431563.614602:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431563.614784:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933490432:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 5104us (6557us total) trans 4295120993 rc 0/0
00000100:00100000:1.0:1789431563.614796:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296017
00000100:00100000:2.0:1789431563.615038:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933490176
00000100:00100000:2.0:1789431563.615070:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933490176
00010000:00010000:2.0:1789431563.615126:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635263c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c7d expref: 311 pid: 5848 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.615160:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16513
00000100:00100000:2.0:1789431563.615171:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e951850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:2349:x1876351933490176:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431563.615189:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431563.615197:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635263c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c7d expref: 311 pid: 5848 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.615210:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635263c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c7d expref: 311 pid: 5848 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.615229:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635263c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c7d expref: 311 pid: 5848 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.615240:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:2.0:1789431563.615246:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526428 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.615265:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526428 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.615273:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526428 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.615306:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431563.615334:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e951850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:2349:x1876351933490176:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 166us (6401us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.615341:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16513
00010000:00010000:3.0:1789431563.615884:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526428 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.615896:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526428 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431563.615921:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008e:0x0]: returning size 260096
00010000:00010000:3.0:1789431563.616147:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526421 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c92 expref: 311 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.616169:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526428 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c92 expref: 310 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.616179:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:3.0:1789431563.616182:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431563.616185:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035ca800, rc 0)
00000100:00100000:3.0:1789431563.616231:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933490048:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 19034us (20296us total) trans 4295120994 rc 0/0
00000100:00100000:3.0:1789431563.616239:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296016
00010000:00010000:3.0:1789431563.622631:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526436 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.622657:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526436 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.622666:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526436 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.622672:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.622677:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526436 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.622686:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526436 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.622708:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c0:0x0].0x5a114248 (ffff90ce07190200)
00010000:00010000:3.0:1789431563.622711:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.622718:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526436 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100c0:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.622735:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526436 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100c0:0x0].0x5a114248 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.623683:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.623939:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933490560
00000100:00100000:2.0:1789431563.623954:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933490560
00000100:00100000:2.0:1789431563.624022:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296018
00000100:00100000:2.0:1789431563.624034:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14616:x1876351933490560:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431563.624094:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431563.624119:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb63526452 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8c99 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624203:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526459 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624222:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526459 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624235:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526459 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624262:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624270:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624277:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624528:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63526467 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x109ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624538:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63526467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109ec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624547:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63526467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109ec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431563.624589:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x109ec:0x0]: returning size 4096
00000004:00200000:2.0:1789431563.624594:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431563.624617:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63526467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109ec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624631:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63526467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x109ec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624640:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526459 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624646:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526459 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624652:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526459 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624659:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.624663:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526459 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624671:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526459 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624682:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c0:0x0].0x0 (ffff90ce2d721600)
00010000:00010000:2.0:1789431563.624685:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.624690:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526459 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624697:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526459 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624712:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624719:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526460 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624736:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624741:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.624744:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624750:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526460 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624921:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c0:0x0].0x8ee21578 (ffff90cf13195500)
00010000:00010000:2.0:1789431563.624926:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.624929:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526460 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624936:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526460 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624979:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb63526452 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c99 expref: 311 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.624994:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63526467 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x109ec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c99 expref: 310 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.625002:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109ec:0x0].0x0 (ffff90cf06585500)
00010000:00010000:2.0:1789431563.625004:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431563.625007:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62cc00, rc 0)
00000100:00100000:2.0:1789431563.625421:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14616:x1876351933490560:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1387us (1747us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.625431:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296018
00000100:00100000:1.0:1789431563.638468:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.638544:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933490688
00000100:00100000:2.0:1789431563.638560:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933490688
00000100:00100000:1.0:1789431563.638579:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.638860:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296019
00000100:00100000:2.0:1789431563.638875:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933490688:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431563.638908:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431563.638939:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb6352646e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ca0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.639089:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526475 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.639109:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526428 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c92 expref: 311 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.639116:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933490816
00010000:00010000:2.0:1789431563.639125:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526475 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.639125:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933490816
00010000:00010000:2.0:1789431563.639167:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526428 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c92 expref: 312 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.639171:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14352
00000100:00100000:3.0:1789431563.639179:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+312:2350:x1876351933490816:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431563.639183:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526428 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c92 expref: 312 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.639189:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:2.0:1789431563.639198:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894220160:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431563.639211:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb63526467 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c99 expref: 312 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.639228:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109ec:0x0].0x0 (ffff90cf06585500)
00010000:00010000:3.0:1789431563.639234:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431563.641671:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:2350:x1876351933490816:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 2474us (3072us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431563.641691:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14352
00000100:00100000:3.0:1789431563.642223:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38900 going to sleep for 11 seconds
00000100:00100000:3.0:1789431563.642273:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894220160:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431563.642311:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526475 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.643210:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.643307:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.643415:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933491200
00000100:00100000:3.0:1789431563.643432:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933491200
00010000:00010000:3.0:1789431563.643521:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526428 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c92 expref: 311 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.643542:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933491072
00000100:00100000:2.0:1789431563.643548:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933491072
00000100:00100000:3.0:1789431563.643583:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16514
00000100:00100000:2.0:1789431563.644145:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296020
00000100:00100000:2.0:1789431563.644165:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+312:14616:x1876351933491072:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431563.644237:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431563.644280:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37f77400/0xd8e438fb63518627 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109ec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c496a expref: 312 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.644301:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109ec:0x0].0x0 (ffff90cf06585500)
00010000:00010000:2.0:1789431563.644315:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431563.644342:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352647c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.644358:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352647c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.644367:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352647c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.644383:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526483 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.644390:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.644396:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.644544:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352648a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x109ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.644552:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352648a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.644558:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352648a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.644703:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:2348:x1876351933491200:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431563.644718:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431563.644741:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526428 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c92 expref: 311 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.644760:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526428 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c92 expref: 311 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.644784:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526428 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c92 expref: 311 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.644796:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:3.0:1789431563.644801:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526475 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.644811:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.644819:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526475 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.644848:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431563.644934:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:2348:x1876351933491200:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 237us (1626us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431563.644943:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16514
00010000:00010000:3.0:1789431563.644976:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.644985:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431563.645031:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008e:0x0]: returning size 260096
00000004:00200000:3.0:1789431563.645036:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431563.645077:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.645115:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb6352646e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ca0 expref: 310 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.645132:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ca0 expref: 309 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.645141:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:3.0:1789431563.645144:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431563.645147:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62c200, rc 0)
00000100:00100000:3.0:1789431563.645178:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+309:14617:x1876351933490688:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6307us (6720us total) trans 0 rc 0/0
00000040:00080000:2.0:1789431563.645924:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1243, 64 off87744
00010000:00010000:2.0:1789431563.646013:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526491 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x109ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.646317:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.646329:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.646339:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526491 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.646345:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526491 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.646352:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.646371:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431563.646395:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352648a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.646402:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352648a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x109ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.646408:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352648a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.646410:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431563.646415:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.646418:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526491 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.646420:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352648a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109ec:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.646425:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62dc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431563.646429:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526491 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109ec:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.646429:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352648a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x109ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.646436:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.646441:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109ec:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431563.646444:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431563.646448:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352648a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x109ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.646455:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109ec:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431563.646455:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352648a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x109ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.646458:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431563.646462:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526491 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x109ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.646467:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526491 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x109ec:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.646475:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352647c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.646479:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.646481:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.646483:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431563.646486:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352647c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.646493:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352647c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.646498:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.646502:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352647c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.646508:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352647c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.646516:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c0:0x0].0x0 (ffff90ce2d721600)
00010000:00010000:2.0:1789431563.646519:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.646522:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352647c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.646532:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352647c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431563.646543:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007a28289a reply state 00000000f18d57a7 transno 4295120995 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.646552:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431563.646975:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933491072:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2812us (3764us total) trans 4295120995 rc 0/0
00000100:00100000:2.0:1789431563.646986:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296020
00000100:00100000:3.0:1789431563.648382:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296019
00000100:00100000:1.0:1789431563.653358:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.653578:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933491456
00000100:00100000:3.0:1789431563.653592:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933491456
00000100:00100000:3.0:1789431563.653702:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12473
00000100:00100000:3.0:1789431563.653715:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933491456:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431563.654092:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933491456:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 378us (745us total) trans 4295120996 rc 0/0
00000100:00100000:3.0:1789431563.654100:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12473
00010000:00010000:1.0:1789431563.658275:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.658298:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526483 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.658307:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526483 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.658314:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.658319:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526483 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.658328:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526483 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.658349:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c0:0x0].0x8ee21578 (ffff90cf13195500)
00010000:00010000:1.0:1789431563.658352:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.658358:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526483 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.658364:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526483 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100c0:0x0].0x8ee21578 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.661908:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.661994:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933491584
00000100:00100000:2.0:1789431563.662008:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933491584
00000100:00100000:2.0:1789431563.662114:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296021
00000100:00100000:2.0:1789431563.662127:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:14617:x1876351933491584:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431563.662167:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431563.662198:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526498 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ca7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662293:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352649f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662312:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352649f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662325:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352649f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662344:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662352:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662359:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662525:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635264ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662535:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635264ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662544:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635264ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431563.662597:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008e:0x0]: returning size 260096
00000004:00200000:2.0:1789431563.662602:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431563.662626:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635264ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662640:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635264ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662649:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352649f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662657:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352649f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662664:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352649f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662671:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.662676:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352649f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662685:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352649f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662697:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431563.662700:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.662706:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352649f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662713:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352649f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662741:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662748:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662753:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662759:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.662762:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662769:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662776:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x6428115e (ffff90cf13195f00)
00010000:00010000:2.0:1789431563.662779:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.662782:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662788:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662824:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526498 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ca7 expref: 312 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662839:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635264ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ca7 expref: 311 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.662852:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:2.0:1789431563.662855:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431563.662858:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62ce00, rc 0)
00000100:00100000:2.0:1789431563.662957:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933491584:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 832us (1062us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.662965:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296021
00000100:00100000:0.0:1789431563.673204:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.673314:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.673430:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.673697:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933492224
00000100:00100000:2.0:1789431563.673713:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933492224
00000100:00100000:2.0:1789431563.673818:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14353
00000100:00100000:2.0:1789431563.673830:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:2349:x1876351933492224:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431563.673851:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431563.673887:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635264ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ca7 expref: 311 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.673911:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:2.0:1789431563.673917:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431563.674001:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+310:2349:x1876351933492224:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 174us (575us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.674009:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14353
00000100:00100000:1.0:1789431563.675625:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933491840
00000100:00100000:1.0:1789431563.675642:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933491840
00000100:00100000:1.0:1789431563.675747:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933492096
00000100:00100000:1.0:1789431563.675751:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933492096
00000100:00100000:1.0:1789431563.675797:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296022
00000100:00100000:1.0:1789431563.675808:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933491840:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431563.675842:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431563.675868:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635264b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8cae expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.676022:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635264bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.676041:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526475 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ca0 expref: 312 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.676076:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635264bb lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.676126:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ca0 expref: 312 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.676141:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526475 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ca0 expref: 312 pid: 5849 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.676156:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b2c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894220288:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431563.676274:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead540 going to sleep for 11 seconds
00000100:00100000:2.0:1789431563.676293:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296023
00000100:00100000:2.0:1789431563.676306:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+312:14616:x1876351933492096:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431563.676337:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431563.676361:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ac42a00/0xd8e438fb6351b528 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x109ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c58e4 expref: 312 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.676384:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109ed:0x0].0x0 (ffff90cf1247c700)
00010000:00010000:2.0:1789431563.676395:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431563.676413:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.676424:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.676494:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.676514:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100c0:0x0].0x283705e2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.676521:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.676527:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.676869:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635264d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x109ed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.676880:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635264d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.676887:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635264d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431563.680018:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1242, 64 off87744
00010000:00010000:2.0:1789431563.680413:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635264d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x109ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680436:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635264d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680450:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635264d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x109ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680460:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635264d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680468:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635264d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x109ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680474:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635264d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680490:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431563.680517:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635264d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x109ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680524:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635264d0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x109ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680531:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635264d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680537:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.680542:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635264d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x109ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680550:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635264d0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x109ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680566:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109ed:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:2.0:1789431563.680570:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431563.680576:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635264d0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x109ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680582:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635264d0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x109ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680606:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680612:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680617:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680623:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.680625:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680631:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680639:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c0:0x0].0x0 (ffff90ce2d721600)
00010000:00010000:2.0:1789431563.680642:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.680645:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.680651:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431563.680667:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dfed3aae reply state 00000000d48b57ff transno 4295120997 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.680676:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431563.680802:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14616:x1876351933492096:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 4494us (7482us total) trans 4295120997 rc 0/0
00000100:00100000:2.0:1789431563.680812:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296023
00010000:00010000:0.0:1789431563.680990:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431563.680999:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635264d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.681005:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62ce00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431563.681009:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635264d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x109ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.681015:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635264d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x109ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.681025:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x109ed:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:0.0:1789431563.681028:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431563.681031:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635264d7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x109ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.681037:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635264d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x109ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.681095:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.681098:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.681099:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431563.681405:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b2c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894220288:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431563.681439:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635264bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.687862:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431563.687989:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.688006:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.688011:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933492352
00010000:00010000:2.0:1789431563.688016:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.688025:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc211f4f0)
00000100:00100000:3.0:1789431563.688025:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933492352
00010000:00010000:2.0:1789431563.688032:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.688043:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100c0:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.688100:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100c0:0x0].0x283705e2 (ffff90cf13195f00)
00010000:00010000:2.0:1789431563.688104:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.688111:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100c0:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.688116:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526475 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ca0 expref: 313 pid: 5849 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.688120:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100c0:0x0].0x283705e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.688169:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16515
00000100:00100000:3.0:1789431563.688182:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+312:2347:x1876351933492352:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431563.688201:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431563.688209:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526475 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ca0 expref: 312 pid: 5849 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.688224:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ca0 expref: 312 pid: 5849 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.688243:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526475 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ca0 expref: 312 pid: 5849 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.688254:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:3.0:1789431563.688270:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635264bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.688282:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635264bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.688291:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635264bb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.688327:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431563.688395:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:2347:x1876351933492352:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 215us (547us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431563.688403:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16515
00010000:00010000:2.0:1789431563.688427:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635264bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.688439:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635264bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431563.688464:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008e:0x0]: returning size 260096
00010000:00010000:2.0:1789431563.688667:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635264b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cae expref: 312 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.688685:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635264bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cae expref: 311 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.688694:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:2.0:1789431563.688697:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431563.688700:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308600, rc 0)
00000100:00100000:2.0:1789431563.688741:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933491840:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12935us (15552us total) trans 4295120998 rc 0/0
00000100:00100000:2.0:1789431563.688750:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296022
00000100:00100000:3.0:1789431563.694430:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.694546:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933492480
00000100:00100000:2.0:1789431563.694562:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933492480
00000100:00100000:2.0:1789431563.694641:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296024
00000100:00100000:2.0:1789431563.694653:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933492480:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431563.694689:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431563.694719:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8cb5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.694887:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.694905:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635264bb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cae expref: 312 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.694915:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264ec lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.694956:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635264bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cae expref: 312 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.694972:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635264bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cae expref: 312 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.694987:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894220416:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431563.695566:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38840 going to sleep for 11 seconds
00000100:00100000:2.0:1789431563.699677:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894220416:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431563.699735:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.703210:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.703642:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.703773:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933492736
00000100:00100000:0.0:1789431563.703790:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933492736
00000100:00100000:0.0:1789431563.703865:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296025
00000100:00100000:0.0:1789431563.703878:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14616:x1876351933492736:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431563.703916:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431563.703948:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635264f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8cbc expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.704035:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635264fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x100e9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.704111:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635264fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.704127:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635264fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.704230:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933492608
00000100:00100000:2.0:1789431563.704237:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933492608
00010000:00010000:2.0:1789431563.704269:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635264bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cae expref: 315 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.704301:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16516
00000100:00100000:2.0:1789431563.704311:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+315:2348:x1876351933492608:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431563.704323:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431563.704330:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635264bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cae expref: 315 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.704344:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635264bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cae expref: 315 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.704367:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635264bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cae expref: 315 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.704396:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:2.0:1789431563.704403:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.704411:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.704418:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264ec lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.704457:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431563.704528:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+314:2348:x1876351933492608:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 217us (1334us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.704535:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16516
00010000:00010000:2.0:1789431563.704571:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.704579:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431563.704635:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008e:0x0]: returning size 260096
00000004:00200000:2.0:1789431563.704640:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431563.704666:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.704700:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb635264e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cb5 expref: 314 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.704715:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cb5 expref: 313 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.704734:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:2.0:1789431563.704737:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431563.704740:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62de00, rc 0)
00000100:00100000:2.0:1789431563.704769:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14617:x1876351933492480:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10119us (10356us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.704788:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296024
00010000:00010000:0.0:1789431563.705979:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526501 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100e9:0x0].0xa12f67b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.706001:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100e9:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.706013:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100e9:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.706322:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635264fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.706332:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635264fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.706340:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635264fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.706347:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.706352:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635264fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.706361:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635264fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.706374:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100e9:0x0].0x0 (ffff90ce214bc100)
00010000:00010000:0.0:1789431563.706378:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.706385:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635264fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.706391:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635264fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.706406:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100e9:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.706412:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526501 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x100e9:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.710159:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100e9:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.710170:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.710176:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100e9:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.710193:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526501 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x100e9:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.710217:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100e9:0x0].0xa12f67b5 (ffff90ce07190700)
00010000:00010000:0.0:1789431563.710220:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.710227:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526501 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x100e9:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.710234:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526501 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100e9:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.710322:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635264f3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cbc expref: 312 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.710335:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100e9:0x0].0x0 (ffff90ce214bc100)
00010000:00010000:0.0:1789431563.710337:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.710341:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635264f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cbc expref: 312 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.710353:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ace00, rc 0)
00000100:00100000:0.0:1789431563.710459:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14616:x1876351933492736:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6581us (6816us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431563.710471:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296025
00000100:00100000:3.0:1789431563.713357:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.714031:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933492864
00000100:00100000:2.0:1789431563.714092:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933492864
00000100:00100000:2.0:1789431563.714746:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296026
00000100:00100000:2.0:1789431563.714764:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+311:14617:x1876351933492864:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431563.714896:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431563.715037:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526508 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8cc3 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.715170:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352650f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.715190:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352650f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.715206:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352650f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.715225:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526516 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.715233:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.715239:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.716686:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352651d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.716718:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352651d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.716742:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352651d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431563.717081:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008e:0x0]: returning size 260096
00000004:00200000:2.0:1789431563.717088:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431563.717118:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352651d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.717132:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352651d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.717148:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352650f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.717155:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352650f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.717164:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352650f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.717171:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.717177:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352650f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.717185:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352650f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.717200:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431563.717204:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.717209:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352650f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.717216:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352650f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.717237:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.717245:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526516 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.717251:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.717257:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.717260:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.717267:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526516 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.717274:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x6428115e (ffff90cf13195f00)
00010000:00010000:2.0:1789431563.717279:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.717282:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526516 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.717288:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526516 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.717338:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526508 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cc3 expref: 313 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.717367:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352651d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cc3 expref: 312 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.717376:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:2.0:1789431563.717379:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431563.717382:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62ce00, rc 0)
00000100:00100000:2.0:1789431563.719021:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+312:14617:x1876351933492864:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4247us (5661us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.719037:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296026
00000100:00100000:1.0:1789431563.725619:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.728240:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933492992
00000100:00100000:3.0:1789431563.728270:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933492992
00000100:00100000:3.0:1789431563.728375:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296027
00000100:00100000:3.0:1789431563.728388:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+312:14616:x1876351933492992:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431563.728418:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431563.728448:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526524 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8cca expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.728537:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352652b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x100e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.728556:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352652b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100e9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.728571:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352652b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100e9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431563.728619:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x100e9:0x0]: returning size 16384
00000004:00200000:3.0:1789431563.728624:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431563.728646:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352652b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x100e9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.728675:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526524 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cca expref: 314 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.728695:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352652b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x100e9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cca expref: 313 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.728705:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100e9:0x0].0x0 (ffff90ce214bc100)
00010000:00010000:3.0:1789431563.728709:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431563.728713:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb800, rc 0)
00000100:00100000:3.0:1789431563.728821:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14616:x1876351933492992:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 437us (3217us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431563.728829:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296027
00000100:00100000:2.0:1789431563.733245:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.734021:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933493248
00000100:00100000:3.0:1789431563.734036:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933493248
00000100:00100000:2.0:1789431563.734604:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296028
00000100:00100000:2.0:1789431563.734620:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14617:x1876351933493248:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431563.734698:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431563.734754:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352651d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cc3 expref: 313 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.734790:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635264ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cb5 expref: 312 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.734802:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:2.0:1789431563.734809:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431563.734883:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526532 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.734900:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.734912:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431563.735159:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000099a6c239 reply state 000000008276331d transno 4295120999 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.735171:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431563.735689:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14617:x1876351933493248:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1068us (2455us total) trans 4295120999 rc 0/0
00000100:00100000:2.0:1789431563.735697:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296028
00000100:00100000:0.0:1789431563.737738:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.737846:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933493376
00000100:00100000:2.0:1789431563.737859:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933493376
00000100:00100000:2.0:1789431563.737926:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12474
00000100:00100000:2.0:1789431563.737938:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14616:x1876351933493376:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431563.745570:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431563.745646:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.745662:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526532 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.745673:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526532 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.745679:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.745684:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526532 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.745693:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526532 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.745713:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:0.0:1789431563.745716:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.745732:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526532 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.745738:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526532 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.746274:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933493504
00000100:00100000:2.0:1789431563.746290:0:14490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933493504
00000100:00100000:3.0:1789431563.747551:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+312:14616:x1876351933493376:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 9598us (9821us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431563.747567:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12474
00000100:00100000:2.0:1789431563.748099:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8267
00000100:00100000:2.0:1789431563.748116:0:14490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+99:2347:x1876351933493504:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:2.0:1789431563.748453:0:14490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb size from disk: 260096 -> 260096
00002000:00010000:2.0:1789431563.748458:0:14490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb mtime from disk: 1789431495 -> 1789431483
00002000:00010000:2.0:1789431563.748461:0:14490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb atime from disk: 1789431487 -> 1789431553
00002000:00010000:2.0:1789431563.748464:0:14490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb ctime from disk: 1789431507 -> 1789431563
00002000:00010000:2.0:1789431563.748466:0:14490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb blocks from disk: 515 -> 515
00000100:00100000:2.0:1789431563.748525:0:14490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+100:2347:x1876351933493504:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 414us (2971us total) trans 4294969616 rc 0/0
00000100:00100000:2.0:1789431563.748532:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8267
00000100:00080000:1.0:1789431563.749025:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1789431563.759211:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.759402:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933493760
00000100:00100000:1.0:1789431563.759417:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933493760
00000100:00100000:1.0:1789431563.759499:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12475
00000100:00100000:1.0:1789431563.759513:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+312:14617:x1876351933493760:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431563.759895:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14617:x1876351933493760:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 384us (696us total) trans 4295121000 rc 0/0
00000100:00100000:1.0:1789431563.759903:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12475
00000100:00100000:0.0:1789431563.767623:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.767923:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933493888
00000100:00100000:1.0:1789431563.767937:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933493888
00000100:00100000:1.0:1789431563.768020:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296029
00000100:00100000:1.0:1789431563.768034:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14617:x1876351933493888:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431563.768122:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431563.768152:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526539 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8cd1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.768244:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526540 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.768263:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526540 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.768277:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526540 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.768293:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526547 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.768300:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.768307:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.768447:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352654e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.768457:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352654e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.768465:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352654e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431563.768508:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008e:0x0]: returning size 260096
00000004:00200000:1.0:1789431563.768514:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431563.769504:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352654e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.769537:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352654e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.769677:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526540 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.769686:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526540 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.769694:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526540 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.769702:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.771851:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526540 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.771868:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526540 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.771891:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431563.771894:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.771901:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526540 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.771909:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526540 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.771937:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.771949:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526547 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.771956:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.771962:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.771965:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.771971:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526547 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.771979:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x6428115e (ffff90ce03149300)
00010000:00010000:1.0:1789431563.771982:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.771985:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526547 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.771992:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526547 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.772101:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526539 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cd1 expref: 315 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.772118:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352654e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cd1 expref: 314 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.772125:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:1.0:1789431563.772128:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431563.772131:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309e00, rc 0)
00000100:00100000:1.0:1789431563.772230:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+314:14617:x1876351933493888:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4198us (4620us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431563.772241:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296029
00000100:00100000:0.0:1789431563.775987:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.776973:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933494144
00000100:00100000:2.0:1789431563.776990:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933494144
00000100:00100000:2.0:1789431563.777266:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296030
00000100:00100000:2.0:1789431563.777286:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+314:14616:x1876351933494144:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431563.777357:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431563.777392:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2ae58a00/0xd8e438fb635206c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c726e expref: 314 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.777422:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a42:0x0].0x0 (ffff90ce2d731500)
00010000:00010000:2.0:1789431563.777446:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352652b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x100e9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cca expref: 313 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.777462:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100e9:0x0].0x0 (ffff90ce214bc100)
00010000:00010000:2.0:1789431563.777467:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431563.777496:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526555 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.777512:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526555 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.777523:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526555 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.777553:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352655c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100e9:0x0].0xd4ab1204 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.777569:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352655c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100e9:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.777576:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352655c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100e9:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.777952:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526563 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.777963:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526563 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.777971:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526563 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431563.778793:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1244, 64 off87808
00010000:00010000:2.0:1789431563.778881:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352656a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.778896:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352656a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.778906:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352656a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.778915:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352656a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.778921:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352656a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.778929:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352656a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.778961:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431563.778993:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526563 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.779000:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526563 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.779008:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526563 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.779014:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.779019:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526563 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.779028:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526563 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.779040:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a42:0x0].0x0 (ffff90cf13195900)
00010000:00010000:2.0:1789431563.779044:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431563.779073:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526563 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.779080:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526563 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.779103:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431563.779103:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526555 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.779118:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352656a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.779118:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526555 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.779130:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526555 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.779135:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431563.779141:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352656a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.779142:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.779149:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526555 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.779156:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352656a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.779159:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526555 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.779176:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100e9:0x0].0x0 (ffff90ce214bc100)
00010000:00010000:2.0:1789431563.779180:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.779182:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a42:0x0].0x0 (ffff90cf13195900)
00010000:00010000:2.0:1789431563.779185:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526555 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.779188:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431563.779194:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352656a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.779196:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526555 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.779211:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352656a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431563.779225:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000303cffa8 reply state 00000000ceb82b93 transno 4295121001 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352655c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100e9:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.779235:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431563.779236:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.779240:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.779242:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431563.779360:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+314:14616:x1876351933494144:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2079us (3383us total) trans 4295121001 rc 0/0
00000100:00100000:2.0:1789431563.779370:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296030
00000100:00100000:0.0:1789431563.784641:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431563.784855:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352655c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100e9:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.784872:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352655c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100e9:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.784882:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352655c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100e9:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.784888:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62ce00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.784895:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352655c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100e9:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.784904:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352655c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100e9:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.784929:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100e9:0x0].0xd4ab1204 (ffff90cf13195f00)
00010000:00010000:1.0:1789431563.784932:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.784939:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352655c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100e9:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.784946:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352655c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100e9:0x0].0xd4ab1204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.786979:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933494400
00000100:00100000:3.0:1789431563.787003:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933494400
00000100:00100000:3.0:1789431563.787121:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296031
00000100:00100000:3.0:1789431563.787134:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+313:14617:x1876351933494400:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431563.787164:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431563.787194:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526571 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8cd8 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.787343:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526578 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.787362:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352654e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cd1 expref: 314 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.787372:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526578 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.787423:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352654e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cd1 expref: 314 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.787440:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352654e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cd1 expref: 314 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.787457:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce35e44700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894220544:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431563.787572:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf377c6f00 going to sleep for 11 seconds
00000100:00100000:3.0:1789431563.791899:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce35e44700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894220544:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431563.791955:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526578 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.793544:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.793904:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933494528
00000100:00100000:3.0:1789431563.793916:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933494528
00010000:00010000:3.0:1789431563.793989:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352654e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cd1 expref: 315 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.794149:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16517
00000100:00100000:3.0:1789431563.794160:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+315:2348:x1876351933494528:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431563.794181:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431563.794188:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352654e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cd1 expref: 315 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.794203:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352654e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cd1 expref: 315 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.794236:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352654e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cd1 expref: 315 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.794524:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:3.0:1789431563.794534:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526578 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.794546:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526578 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.794554:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526578 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.794604:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431563.794731:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526578 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.794741:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526578 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431563.794777:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008e:0x0]: returning size 260096
00010000:00010000:0.0:1789431563.794988:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca800/0xd8e438fb63526571 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cd8 expref: 316 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.795008:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526578 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cd8 expref: 315 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.795016:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:0.0:1789431563.795018:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431563.795021:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb600, rc 0)
00000100:00100000:0.0:1789431563.795133:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+315:14617:x1876351933494400:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8002us (10516us total) trans 4295121002 rc 0/0
00000100:00100000:0.0:1789431563.795144:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296031
00000100:00100000:3.0:1789431563.795597:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+314:2348:x1876351933494528:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1435us (2062us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431563.795608:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16517
00000100:00100000:1.0:1789431563.804481:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.804680:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.805654:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933494784
00000100:00100000:3.0:1789431563.805669:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933494784
00000100:00100000:3.0:1789431563.805753:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933494912
00000100:00100000:3.0:1789431563.805758:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933494912
00000100:00100000:3.0:1789431563.805821:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296032
00000100:00100000:3.0:1789431563.805832:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+315:14616:x1876351933494784:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431563.805908:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431563.806455:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b5e1600/0xd8e438fb635208cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c731d expref: 315 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.806488:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a45:0x0].0x0 (ffff90cf03dd3b00)
00010000:00010000:3.0:1789431563.806504:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431563.806536:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526586 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.806554:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526586 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.806567:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526586 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.806604:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352658d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100e9:0x0].0x2f16ddac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.806613:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352658d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100e9:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.806630:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352658d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100e9:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.806811:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526594 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.806820:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.806827:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.808114:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296033
00000100:00100000:2.0:1789431563.808139:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+314:14617:x1876351933494912:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431563.808173:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431563.808195:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352659b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8cdf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.808371:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635265a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.808388:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526578 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cd8 expref: 315 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.808397:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635265a2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.808442:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526578 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cd8 expref: 315 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.808459:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526578 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cd8 expref: 315 pid: 6797 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.808481:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894220672:192.168.203.4@tcp:104:
00000040:00080000:3.0:1789431563.808803:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1243, 64 off87808
00010000:00010000:3.0:1789431563.808885:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635265a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.808898:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635265a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.808910:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635265a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.808920:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635265a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.808928:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635265a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.809103:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38240 going to sleep for 11 seconds
00010000:00010000:3.0:1789431563.809495:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635265a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.809530:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431563.809560:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.809567:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526594 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.809573:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526594 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.809580:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.809589:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526594 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.809598:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526594 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.809613:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a45:0x0].0x0 (ffff90cf18b78700)
00010000:00010000:3.0:1789431563.809732:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431563.809741:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526594 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.809818:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526594 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.809844:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526586 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.809851:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526586 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.809858:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526586 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.809863:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.809866:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526586 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.809871:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526586 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.809881:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100e9:0x0].0x0 (ffff90ce214bc100)
00010000:00010000:3.0:1789431563.809883:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.809886:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526586 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.809892:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526586 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431563.809907:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006c31f399 reply state 000000002051fa17 transno 4295121003 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352658d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100e9:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.809917:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:2.0:1789431563.810262:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431563.810269:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635265a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.810276:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431563.810280:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635265a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.810288:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635265a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.810298:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a45:0x0].0x0 (ffff90cf18b78700)
00010000:00010000:2.0:1789431563.810301:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431563.810303:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635265a9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.810309:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635265a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.810329:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431563.810331:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431563.810333:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431563.810369:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+317:14616:x1876351933494784:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 4533us (5898us total) trans 4295121003 rc 0/0
00000100:00100000:3.0:1789431563.810380:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296032
00010000:00010000:0.0:1789431563.813549:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352658d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100e9:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.813573:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352658d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100e9:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.813582:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352658d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100e9:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.813588:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.813595:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352658d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100e9:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.813603:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352658d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100e9:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.813636:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100e9:0x0].0x2f16ddac (ffff90cf18b78f00)
00010000:00010000:0.0:1789431563.813640:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.813647:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352658d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100e9:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.813653:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb6352658d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100e9:0x0].0x2f16ddac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.817818:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.817836:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894220672:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431563.817874:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635265a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.817923:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933495040
00000100:00100000:0.0:1789431563.817933:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933495040
00010000:00010000:0.0:1789431563.818326:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526578 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cd8 expref: 316 pid: 6797 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.818378:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16518
00000100:00100000:0.0:1789431563.818390:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e950450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+316:2347:x1876351933495040:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431563.818409:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431563.818417:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526578 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cd8 expref: 316 pid: 6797 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.818431:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526578 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cd8 expref: 316 pid: 6797 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.818458:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb63526578 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cd8 expref: 316 pid: 6797 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.818480:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:0.0:1789431563.818487:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635265a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.818499:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635265a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.818508:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635265a2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.818652:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431563.818775:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e950450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+315:2347:x1876351933495040:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 385us (971us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431563.818784:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16518
00010000:00010000:1.0:1789431563.818931:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635265a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.818949:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635265a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431563.819008:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008e:0x0]: returning size 260096
00000004:00200000:1.0:1789431563.819014:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431563.819042:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635265a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.819112:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb6352659b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cdf expref: 315 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.819130:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635265a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cdf expref: 314 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.819137:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:1.0:1789431563.819141:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431563.819143:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62c200, rc 0)
00000100:00100000:1.0:1789431563.819176:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+314:14617:x1876351933494912:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11050us (14497us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431563.819183:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296033
00000100:00100000:1.0:1789431563.825820:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.826885:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933495424
00000100:00100000:2.0:1789431563.826903:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933495424
00000100:00100000:2.0:1789431563.827494:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296034
00000100:00100000:2.0:1789431563.827509:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+314:14617:x1876351933495424:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431563.827544:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431563.827575:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635265b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ce6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.827665:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635265b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.827684:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635265b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.827698:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635265b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.827717:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635265be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.827734:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635265be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.827741:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635265be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.827875:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635265c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.827884:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635265c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.827892:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635265c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431563.827934:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008e:0x0]: returning size 260096
00000004:00200000:2.0:1789431563.827952:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431563.827977:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635265c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.827990:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635265c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.827999:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635265b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.828006:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635265b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.828015:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635265b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.828022:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62dc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.828028:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635265b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.828036:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635265b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.828083:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431563.828087:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.828093:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635265b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.828100:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635265b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.828116:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635265be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.828126:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635265be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.828131:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635265be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.828137:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.828140:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635265be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.828146:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635265be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.828153:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x6428115e (ffff90cf13195f00)
00010000:00010000:2.0:1789431563.828156:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.828160:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635265be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.828165:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb635265be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.828202:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb635265b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ce6 expref: 316 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.828217:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635265c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ce6 expref: 315 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.828225:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:2.0:1789431563.828227:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431563.828232:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62ce00, rc 0)
00000100:00100000:2.0:1789431563.828331:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+315:14617:x1876351933495424:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 825us (2526us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.828339:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296034
00000100:00100000:3.0:1789431563.830668:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.833885:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933495296
00000100:00100000:0.0:1789431563.833907:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933495296
00000100:00100000:0.0:1789431563.833995:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296035
00000100:00100000:0.0:1789431563.834008:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+315:14616:x1876351933495296:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431563.834310:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431563.834345:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2a7e3600/0xd8e438fb63520a71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10a47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c73a2 expref: 315 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.834370:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a47:0x0].0x0 (ffff90ce2154d100)
00010000:00010000:0.0:1789431563.834385:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431563.834414:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635265cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.834430:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635265cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.834443:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635265cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.834459:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635265d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x100e9:0x0].0x3b73c5df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.834466:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635265d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100e9:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.834472:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635265d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100e9:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.834624:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10a47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.834637:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.834644:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:0.0:1789431563.835438:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1244, 64 off87872
00010000:00010000:0.0:1789431563.835522:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635265e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10a47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835537:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635265e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835549:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635265e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10a47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835558:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635265e1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835565:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635265e1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10a47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835572:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635265e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835661:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431563.835689:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10a47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835696:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265da lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10a47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835709:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835715:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.835721:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10a47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835739:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265da lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10a47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835749:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a47:0x0].0x0 (ffff90ce07190d00)
00010000:00010000:0.0:1789431563.835753:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431563.835758:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265da lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10a47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835764:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265da lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10a47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835787:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635265cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835793:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635265cc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835799:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635265cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835803:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.835806:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635265cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835816:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635265cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835824:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100e9:0x0].0x0 (ffff90ce214bc100)
00010000:00010000:0.0:1789431563.835826:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.835830:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635265cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.835835:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635265cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x100e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431563.835845:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001e6d1e6f reply state 00000000545a25b0 transno 4295121004 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635265d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100e9:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.835855:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431563.835975:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+316:14616:x1876351933495296:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1966us (5319us total) trans 4295121004 rc 0/0
00010000:00010000:1.0:1789431563.836225:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431563.836234:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635265e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.836242:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431563.836246:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635265e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10a47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.836254:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635265e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10a47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.836264:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10a47:0x0].0x0 (ffff90ce07190d00)
00010000:00010000:1.0:1789431563.836266:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431563.836269:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635265e1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10a47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.836275:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635265e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10a47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.836296:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431563.836298:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431563.836299:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431563.838180:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296035
00000100:00100000:1.0:1789431563.839995:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.840161:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933495680
00000100:00100000:3.0:1789431563.840175:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933495680
00000100:00100000:3.0:1789431563.840249:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296036
00000100:00100000:3.0:1789431563.840268:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+316:14617:x1876351933495680:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431563.840340:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:3.0:1789431563.840376:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635265c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ce6 expref: 316 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.840403:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb635265a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cdf expref: 315 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.840415:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:3.0:1789431563.840422:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431563.840480:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635265e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.840497:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635265e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.840508:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635265e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431563.840696:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005eea77da reply state 00000000885a68fa transno 4295121005 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635265e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.840708:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431563.841485:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+316:14617:x1876351933495680:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1220us (1565us total) trans 4295121005 rc 0/0
00000100:00100000:3.0:1789431563.841494:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296036
00010000:00010000:2.0:1789431563.841622:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635265d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x100e9:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.841635:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635265d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x100e9:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.841643:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635265d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100e9:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.841649:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.841655:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635265d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x100e9:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.841664:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635265d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x100e9:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.841680:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x100e9:0x0].0x3b73c5df (ffff90ce07190700)
00010000:00010000:2.0:1789431563.841683:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.841689:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635265d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x100e9:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.841695:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635265d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x100e9:0x0].0x3b73c5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.846421:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635265e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.846446:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635265e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.846457:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635265e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.846465:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.846471:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635265e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.846487:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635265e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.846510:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:0.0:1789431563.846513:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.846520:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635265e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.846528:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635265e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.849979:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.850149:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933495808
00000100:00100000:2.0:1789431563.850164:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933495808
00000100:00100000:2.0:1789431563.850241:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8268
00000100:00100000:2.0:1789431563.850254:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+100:2348:x1876351933495808:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:2.0:1789431563.850536:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb size from disk: 260096 -> 260096
00002000:00010000:2.0:1789431563.850541:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb mtime from disk: 1789431483 -> 1789431551
00002000:00010000:2.0:1789431563.850545:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb atime from disk: 1789431553 -> 1789431543
00002000:00010000:2.0:1789431563.850547:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb ctime from disk: 1789431563 -> 1789431563
00002000:00010000:2.0:1789431563.850549:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb blocks from disk: 515 -> 515
00000100:00100000:2.0:1789431563.850640:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+101:2348:x1876351933495808:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 388us (677us total) trans 4294969617 rc 0/0
00000100:00100000:2.0:1789431563.850650:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8268
00000100:00100000:1.0:1789431563.851458:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.851621:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933495936
00000100:00100000:0.0:1789431563.851630:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933495936
00000100:00100000:0.0:1789431563.851686:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296037
00000100:00100000:0.0:1789431563.851697:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+314:14616:x1876351933495936:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431563.851732:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431563.851758:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635265ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ced expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.851845:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.851865:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.851879:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.851897:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635265fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x39269a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.851906:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635265fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x39269a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.851914:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635265fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x39269a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.851978:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.851986:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.851994:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.852001:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.852007:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.852015:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.852030:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431563.852033:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.852040:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.852095:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb635265f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.852112:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635265fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x39269a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.852122:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635265fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x39269a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.852129:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635265fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x39269a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.852134:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.852137:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635265fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x39269a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.852143:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635265fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x39269a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.852151:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x39269a67 (ffff90ce07190500)
00010000:00010000:0.0:1789431563.852154:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.852157:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635265fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x39269a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.852162:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635265fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x39269a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.852199:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635265ef lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ced expref: 315 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.852209:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431563.852212:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.852216:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635265ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ced expref: 315 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.852232:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7acc00, rc 0)
00000100:00100000:1.0:1789431563.852483:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+314:14616:x1876351933495936:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 786us (1027us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431563.852492:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296037
00000100:00100000:1.0:1789431563.855997:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.856205:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.856877:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933496320
00000100:00100000:0.0:1789431563.856893:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933496320
00000100:00100000:0.0:1789431563.856986:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296038
00000100:00100000:0.0:1789431563.857000:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+314:14616:x1876351933496320:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431563.857028:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431563.857093:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526604 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8cf4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.857189:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352660b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.857208:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352660b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.857223:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352660b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431563.857274:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008d:0x0]: returning size 16384
00000004:00200000:0.0:1789431563.857278:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431563.857302:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352660b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.857335:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526604 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cf4 expref: 316 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.857358:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352660b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cf4 expref: 315 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.857375:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431563.857378:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431563.857383:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ac600, rc 0)
00000100:00100000:0.0:1789431563.857459:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+315:14616:x1876351933496320:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 463us (1254us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431563.857468:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296038
00000100:00100000:3.0:1789431563.859103:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933496192
00000100:00100000:3.0:1789431563.859119:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933496192
00000100:00100000:3.0:1789431563.859195:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12476
00000100:00100000:3.0:1789431563.859207:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+315:14617:x1876351933496192:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431563.860362:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+316:14617:x1876351933496192:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 1149us (4371us total) trans 4295121006 rc 0/0
00000100:00100000:3.0:1789431563.860374:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12476
00000100:00100000:1.0:1789431563.865239:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.865349:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933496448
00000100:00100000:2.0:1789431563.865362:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933496448
00000100:00100000:2.0:1789431563.865441:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296039
00000100:00100000:2.0:1789431563.865454:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+316:14617:x1876351933496448:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431563.865489:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431563.865517:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb63526612 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8cfb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.865604:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526619 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.865623:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526619 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.865637:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526619 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.865654:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63526620 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.865666:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63526620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.865673:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63526620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.866190:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.866292:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933496576
00000100:00100000:0.0:1789431563.866301:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933496576
00000100:00100000:0.0:1789431563.866345:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12477
00000100:00100000:0.0:1789431563.866355:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+318:14616:x1876351933496576:12345-192.168.203.4@tcp:37:dbench.0
00010000:00010000:2.0:1789431563.867970:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526627 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.867992:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868005:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431563.868069:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008e:0x0]: returning size 260096
00000004:00200000:2.0:1789431563.868074:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431563.868098:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868112:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868123:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526619 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868131:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526619 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868138:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526619 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868150:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62dc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.868155:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526619 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868163:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526619 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868176:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431563.868179:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.868184:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526619 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868190:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526619 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868207:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63526620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868215:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63526620 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868221:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63526620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868226:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.868229:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63526620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868236:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63526620 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868247:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x6428115e (ffff90cf13195f00)
00010000:00010000:2.0:1789431563.868250:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.868253:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63526620 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868259:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb63526620 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868310:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d600/0xd8e438fb63526612 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cfb expref: 319 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868326:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526627 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cfb expref: 318 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.868334:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:2.0:1789431563.868336:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431563.868339:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62c400, rc 0)
00000100:00100000:2.0:1789431563.868437:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+318:14617:x1876351933496448:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2985us (3213us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.868447:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296039
00000100:00100000:0.0:1789431563.872821:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+317:14616:x1876351933496576:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 6452us (6619us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431563.872838:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12477
00000100:00100000:1.0:1789431563.877288:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.877769:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933496832
00000100:00100000:3.0:1789431563.877783:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933496832
00000100:00100000:3.0:1789431563.877867:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296040
00000100:00100000:3.0:1789431563.877880:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+317:14617:x1876351933496832:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431563.877910:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431563.877941:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352662e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d02 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.878103:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526635 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.878123:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526627 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cfb expref: 318 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.878134:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526635 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.878183:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526627 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cfb expref: 318 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.878201:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526627 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cfb expref: 318 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.878220:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce35e44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894220800:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431563.878359:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf377c6f00 going to sleep for 11 seconds
00000100:00100000:2.0:1789431563.878696:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.878976:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933496960
00000100:00100000:0.0:1789431563.878985:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933496960
00000100:00100000:0.0:1789431563.879045:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296041
00000100:00100000:0.0:1789431563.879081:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+319:14616:x1876351933496960:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431563.879098:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431563.879114:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352663c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d09 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879184:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526643 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879201:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526643 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879217:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526643 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879235:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352664a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879244:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352664a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879250:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352664a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879421:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63526651 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879431:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63526651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879439:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63526651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431563.879480:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008f:0x0]: returning size 260096
00000004:00200000:0.0:1789431563.879487:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431563.879515:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63526651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879530:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63526651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879541:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526643 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879555:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526643 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879563:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526643 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879570:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.879577:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526643 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879586:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526643 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879601:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431563.879605:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.879610:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526643 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879618:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526643 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879636:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352664a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879642:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352664a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879647:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352664a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879652:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431563.879656:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352664a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879662:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352664a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879670:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x6428115e (ffff90ce07190500)
00010000:00010000:0.0:1789431563.879673:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431563.879676:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352664a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879682:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352664a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879735:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352663c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d09 expref: 321 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879751:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63526651 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d09 expref: 320 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.879760:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:0.0:1789431563.879762:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431563.879765:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ac400, rc 0)
00000100:00100000:0.0:1789431563.879844:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+320:14616:x1876351933496960:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 766us (1149us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431563.879852:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296041
00000100:00100000:2.0:1789431563.895516:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.895666:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.895768:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933497344
00000100:00100000:1.0:1789431563.895782:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933497344
00000100:00100000:1.0:1789431563.895866:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14354
00000100:00100000:1.0:1789431563.895878:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+320:2349:x1876351933497344:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431563.895900:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431563.895935:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63526651 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d09 expref: 320 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.895959:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:1.0:1789431563.895972:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431563.896106:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+319:2349:x1876351933497344:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 230us (439us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431563.896114:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14354
00000100:00100000:3.0:1789431563.896471:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933497216
00000100:00100000:3.0:1789431563.896480:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933497216
00000100:00100000:1.0:1789431563.897351:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.897392:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933497472
00000100:00100000:1.0:1789431563.897398:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933497472
00010000:00010000:1.0:1789431563.897433:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526627 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cfb expref: 320 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.897476:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16519
00000100:00100000:1.0:1789431563.897487:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+320:2348:x1876351933497472:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431563.897505:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431563.897512:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526627 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cfb expref: 320 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.897527:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526627 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cfb expref: 320 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.897557:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:1.0:1789431563.897565:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526635 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.897579:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526635 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.897589:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526635 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.897614:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431563.897670:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+320:2348:x1876351933497472:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 185us (325us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431563.897678:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16519
00000100:00100000:0.0:1789431563.898513:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296042
00000100:00100000:0.0:1789431563.898534:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+319:14616:x1876351933497216:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431563.898560:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431563.898586:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526658 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d10 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.898734:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352665f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.898808:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c800/0xd8e438fb635111b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c24e2 expref: 320 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.898819:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352665f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.898864:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c800/0xd8e438fb635111b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c24e2 expref: 320 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.898880:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c800/0xd8e438fb635111b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c24e2 expref: 320 pid: 12775 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.898897:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894220928:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431563.899006:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ac1ff00 going to sleep for 11 seconds
00010000:00010000:3.0:1789431563.899412:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526627 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cfb expref: 320 pid: 5847 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.899433:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce35e44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894220800:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431563.899458:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526635 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.899470:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526635 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.899476:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526635 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431563.899498:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008e:0x0]: returning size 260096
00010000:00010000:3.0:1789431563.899689:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb6352662e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d02 expref: 321 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.899708:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526635 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d02 expref: 320 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.899719:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:3.0:1789431563.899732:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431563.899737:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb200, rc 0)
00000100:00100000:3.0:1789431563.899783:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+320:14617:x1876351933496832:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 21905us (22511us total) trans 4295121007 rc 0/0
00000100:00100000:3.0:1789431563.899792:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296040
00000100:00100000:1.0:1789431563.910019:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.910265:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933497600
00000100:00100000:0.0:1789431563.910288:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933497600
00000100:00100000:0.0:1789431563.910361:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296043
00000100:00100000:0.0:1789431563.910374:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+320:14617:x1876351933497600:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431563.910405:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431563.910433:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352666d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d17 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.910549:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63526674 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.910568:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526635 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d02 expref: 321 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.910578:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63526674 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.910623:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526635 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d02 expref: 321 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.910637:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526635 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d02 expref: 321 pid: 12181 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.910653:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894221056:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431563.910770:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ac1f180 going to sleep for 11 seconds
00000100:00100000:2.0:1789431563.911302:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894220928:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431563.911332:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352665f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.913469:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.913573:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933497728
00000100:00100000:3.0:1789431563.913584:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933497728
00010000:00010000:3.0:1789431563.913643:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c800/0xd8e438fb635111b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c24e2 expref: 322 pid: 12775 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.913700:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16520
00000100:00100000:3.0:1789431563.913711:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+322:2347:x1876351933497728:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431563.913747:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431563.913755:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c800/0xd8e438fb635111b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c24e2 expref: 322 pid: 12775 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.913773:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c800/0xd8e438fb635111b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c24e2 expref: 322 pid: 12775 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.913801:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c800/0xd8e438fb635111b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c24e2 expref: 322 pid: 12775 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.913823:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:3.0:1789431563.913830:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352665f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.913840:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352665f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.913848:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352665f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.913884:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431563.914109:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352665f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.914118:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352665f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431563.914143:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008f:0x0]: returning size 260096
00010000:00010000:2.0:1789431563.914378:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526658 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d10 expref: 323 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.914410:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352665f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d10 expref: 322 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.914418:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:2.0:1789431563.914421:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431563.914424:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7acc00, rc 0)
00000100:00100000:3.0:1789431563.914522:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+322:2347:x1876351933497728:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 812us (1068us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431563.914532:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16520
00000100:00100000:2.0:1789431563.914968:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+321:14616:x1876351933497216:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 16441us (19467us total) trans 4295121008 rc 0/0
00000100:00100000:2.0:1789431563.914978:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296042
00000100:00100000:1.0:1789431563.921733:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.921862:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.921968:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933497856
00000100:00100000:3.0:1789431563.921979:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933497984
00000100:00100000:2.0:1789431563.921982:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933497856
00000100:00100000:3.0:1789431563.921984:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933497984
00010000:00010000:2.0:1789431563.922036:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526635 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d02 expref: 322 pid: 12181 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.922074:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296044
00000100:00100000:3.0:1789431563.922087:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+322:14616:x1876351933497984:12345-192.168.203.4@tcp:101:dbench.0
00000100:00100000:2.0:1789431563.922089:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16521
00000100:00100000:2.0:1789431563.922096:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+322:2347:x1876351933497856:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431563.922115:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431563.922115:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431563.922123:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526635 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d02 expref: 322 pid: 12181 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.922138:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526635 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d02 expref: 322 pid: 12181 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.922138:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526682 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d1e expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.922164:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:2.0:1789431563.922171:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63526674 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.922181:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63526674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.922189:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63526674 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.922212:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431563.922251:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526689 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.922265:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352665f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d10 expref: 323 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.922277:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+323:2347:x1876351933497856:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 182us (570us total) trans 0 rc 0/0
00010000:00010000:3.0:1789431563.922278:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526689 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.922295:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16521
00010000:00010000:3.0:1789431563.922312:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352665f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d10 expref: 322 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.922326:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352665f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d10 expref: 322 pid: 12775 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.922342:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce35e44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894221184:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431563.922405:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf377c6600 going to sleep for 11 seconds
00010000:00010000:0.0:1789431563.922800:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb63526635 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d02 expref: 322 pid: 12181 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.922820:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894221056:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431563.922843:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63526674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.922852:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63526674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.922858:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63526674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431563.922906:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008e:0x0]: returning size 260096
00000004:00200000:0.0:1789431563.922912:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431563.922937:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63526674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.922972:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352666d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d17 expref: 322 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.922987:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac400/0xd8e438fb63526674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d17 expref: 321 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.922995:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008e:0x0].0x0 (ffff90ce15f08200)
00010000:00010000:0.0:1789431563.922998:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431563.923000:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ac400, rc 0)
00000100:00100000:0.0:1789431563.923147:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+321:14617:x1876351933497600:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12776us (13143us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431563.923155:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296043
00000100:00100000:1.0:1789431563.929171:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.929438:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce35e44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894221184:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431563.929474:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526689 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.929688:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933498112
00000100:00100000:2.0:1789431563.929699:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933498112
00010000:00010000:2.0:1789431563.929819:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352665f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d10 expref: 321 pid: 12775 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.929909:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16522
00000100:00100000:2.0:1789431563.929921:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+321:2350:x1876351933498112:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431563.929943:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431563.929951:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352665f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d10 expref: 321 pid: 12775 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.929966:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352665f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d10 expref: 321 pid: 12775 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.929993:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352665f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d10 expref: 321 pid: 12775 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.930014:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:2.0:1789431563.930021:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526689 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.930032:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.930042:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526689 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.930671:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431563.930765:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+320:2350:x1876351933498112:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 845us (1608us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.930775:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16522
00010000:00010000:3.0:1789431563.930850:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.930859:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431563.930921:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008f:0x0]: returning size 260096
00000004:00200000:3.0:1789431563.930927:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431563.930954:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.930998:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526682 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d1e expref: 320 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.931024:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d1e expref: 319 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.931033:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:3.0:1789431563.931036:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431563.931038:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cbc00, rc 0)
00000100:00100000:3.0:1789431563.931094:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+319:14616:x1876351933497984:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9010us (9232us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431563.931102:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296044
00000100:00100000:2.0:1789431563.939928:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.940596:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.940913:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933498240
00000100:00100000:3.0:1789431563.940927:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933498240
00000100:00100000:3.0:1789431563.941010:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296045
00000100:00100000:3.0:1789431563.941023:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+319:14617:x1876351933498240:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431563.941081:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431563.941110:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526690 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d25 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.941203:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526697 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.941222:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526697 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.941236:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526697 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.941575:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933498496
00000100:00100000:1.0:1789431563.941583:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933498496
00000100:00100000:1.0:1789431563.941629:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12478
00000100:00100000:1.0:1789431563.941638:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+321:14616:x1876351933498496:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431563.942104:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+322:14616:x1876351933498496:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 465us (1511us total) trans 4295121009 rc 0/0
00000100:00100000:1.0:1789431563.942113:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12478
00010000:00010000:2.0:1789431563.942479:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352669e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.942500:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352669e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.942513:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352669e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.942580:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526697 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.942588:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526697 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.942596:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526697 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.942603:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.942608:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526697 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.942618:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526697 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.942633:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431563.942636:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.942642:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526697 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.942648:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb400/0xd8e438fb63526697 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.942661:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352669e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.942668:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352669e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.942675:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352669e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.942681:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.942683:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352669e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.942689:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352669e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.942696:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90cf18b78100)
00010000:00010000:2.0:1789431563.942699:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.942702:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352669e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.942708:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb200/0xd8e438fb6352669e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.945561:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526690 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d25 expref: 321 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.945590:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431563.945594:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.945602:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb800/0xd8e438fb63526690 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d25 expref: 321 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.945633:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cb800, rc 0)
00000100:00100000:2.0:1789431563.945732:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+320:14617:x1876351933498240:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4698us (5807us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431563.946165:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296045
00000100:00100000:0.0:1789431563.947695:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431563.948038:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933498624
00000100:00100000:1.0:1789431563.948162:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933498624
00000100:00100000:1.0:1789431563.948275:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296046
00000100:00100000:1.0:1789431563.948294:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+320:14616:x1876351933498624:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431563.948322:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431563.948350:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635266a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d2c expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948427:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635266ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948445:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635266ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948457:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635266ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948472:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635266b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948478:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635266b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948485:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635266b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948610:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635266ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948620:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635266ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948628:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635266ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431563.948670:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008f:0x0]: returning size 260096
00000004:00200000:1.0:1789431563.948675:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431563.948702:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635266ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948715:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635266ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948736:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635266ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948818:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635266ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948825:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635266ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948833:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.948839:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635266ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948848:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635266ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948864:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431563.948867:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.948872:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635266ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948878:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635266ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948898:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635266b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948905:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635266b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948912:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635266b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948917:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.948920:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635266b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948926:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635266b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948933:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x6428115e (ffff90ce03149300)
00010000:00010000:1.0:1789431563.948936:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.948938:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635266b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948945:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635266b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948982:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635266a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d2c expref: 322 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.948996:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635266ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d2c expref: 321 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.949008:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:1.0:1789431563.949010:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431563.949013:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:1.0:1789431563.949271:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+321:14616:x1876351933498624:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 979us (1585us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431563.949289:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296046
00000100:00100000:0.0:1789431563.955617:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.955938:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.956151:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933499008
00000100:00100000:2.0:1789431563.956167:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933499008
00000100:00100000:2.0:1789431563.956251:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14355
00000100:00100000:2.0:1789431563.956270:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+321:2349:x1876351933499008:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431563.956290:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431563.956323:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635266ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d2c expref: 321 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.956348:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:2.0:1789431563.956355:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431563.956423:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+320:2349:x1876351933499008:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 156us (485us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.956430:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14355
00000100:00100000:1.0:1789431563.956730:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933498880
00000100:00100000:1.0:1789431563.956736:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933498880
00000100:00100000:1.0:1789431563.956785:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296047
00000100:00100000:1.0:1789431563.956799:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+320:14616:x1876351933498880:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431563.956829:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431563.956849:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635266c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d33 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.956979:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635266c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.956997:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526689 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d1e expref: 321 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.957007:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635266c8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.957046:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d1e expref: 321 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.957077:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526689 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d1e expref: 321 pid: 6797 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431563.957096:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1a569500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894221312:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431563.957170:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05eadb40 going to sleep for 11 seconds
00000100:00100000:0.0:1789431563.960034:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.960363:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933499264
00000100:00100000:3.0:1789431563.960377:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933499264
00000100:00100000:3.0:1789431563.960443:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296048
00000100:00100000:3.0:1789431563.960454:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+322:14617:x1876351933499264:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431563.960481:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431563.960485:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431563.960520:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbe00/0xd8e438fb63526333 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8c53 expref: 322 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.960542:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431563.960549:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431563.960565:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635266cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d3a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.960731:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635266d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.960759:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635266d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.960770:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635266d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.960789:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635266dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.960796:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635266dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.960803:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635266dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:3.0:1789431563.961492:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x515:0x0], index 0: 0
00010000:00010000:3.0:1789431563.961713:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635266e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.961737:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635266e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.961748:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635266e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.961794:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635266d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.961802:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635266d6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.961810:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635266d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.961817:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431563.961823:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635266d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.961832:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635266d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.961845:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431563.961848:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431563.961854:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635266d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.961864:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb600/0xd8e438fb635266d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431563.961881:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000047a5f9f6 reply state 00000000b4753a3f transno 4295121010 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635266dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.961892:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431563.961933:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb635266cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d3a expref: 324 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.961948:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635266e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d3a expref: 323 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.961955:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa6:0x0].0x0 (ffff90cf18b78700)
00010000:00010000:3.0:1789431563.961957:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431563.961959:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cac00, rc 0)
00000100:00100000:3.0:1789431563.962041:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+324:14617:x1876351933499264:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1589us (2022us total) trans 4295121010 rc 0/0
00000100:00100000:3.0:1789431563.962083:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296048
00000100:00100000:1.0:1789431563.964898:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1a569500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894221312:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431563.964940:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635266c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.966504:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431563.966668:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933499392
00000100:00100000:3.0:1789431563.966681:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933499392
00010000:00010000:3.0:1789431563.966750:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526689 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d1e expref: 324 pid: 6797 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431563.966796:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16523
00000100:00100000:3.0:1789431563.966807:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e951c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+324:2348:x1876351933499392:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431563.966826:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431563.966835:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526689 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d1e expref: 324 pid: 6797 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.966850:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d1e expref: 324 pid: 6797 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.966878:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526689 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d1e expref: 324 pid: 6797 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.966900:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:3.0:1789431563.966907:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635266c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.966919:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635266c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.966928:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635266c8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431563.966963:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431563.967023:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e951c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+323:2348:x1876351933499392:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 217us (530us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431563.967030:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16523
00010000:00010000:1.0:1789431563.967164:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635266c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.967174:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635266c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431563.967200:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008f:0x0]: returning size 260096
00010000:00010000:1.0:1789431563.967404:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635266c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d33 expref: 324 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.967423:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635266c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d33 expref: 323 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.967431:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:1.0:1789431563.967434:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431563.967437:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308600, rc 0)
00000100:00100000:1.0:1789431563.967463:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+323:14616:x1876351933498880:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10672us (11861us total) trans 4295121011 rc 0/0
00000100:00100000:1.0:1789431563.967470:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296047
00010000:00010000:1.0:1789431563.978851:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635266dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.978880:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635266dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.978890:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635266dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.978898:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.978904:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635266dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.978913:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635266dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.978938:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90cf18b78f00)
00010000:00010000:1.0:1789431563.978942:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.978948:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635266dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.978956:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb635266dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431563.979393:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431563.979479:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.979854:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933499520
00000100:00100000:2.0:1789431563.979869:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933499520
00000100:00100000:2.0:1789431563.979946:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8269
00000100:00100000:2.0:1789431563.979959:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+101:2348:x1876351933499520:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431563.979983:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431563.980009:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087c926ad/0xd8e438fb635266f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d41 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789431563.980079:0:14469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x515:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:2.0:1789431563.980107:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x515:0x0].0x0 since=3022s v=(0 0)
00010000:00010000:2.0:1789431563.980112:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x515:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431563.980124:0:14469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087c926ad/0xd8e438fb635266f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d41 expref: 102 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.980146:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000087c926ad/0xd8e438fb635266f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d41 expref: 102 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.980162:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62d600, rc 0)
00000100:00100000:2.0:1789431563.980239:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+102:2348:x1876351933499520:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 282us (852us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431563.980247:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8269
00000100:00100000:3.0:1789431563.982396:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933499648
00000100:00100000:3.0:1789431563.982417:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933499648
00000100:00100000:3.0:1789431563.983518:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.983641:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296049
00000100:00100000:2.0:1789431563.983660:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+322:14616:x1876351933499648:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431563.983698:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431563.983735:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526700 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d48 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.983864:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.983882:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635266c8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d33 expref: 323 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.983899:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526707 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.983944:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635266c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d33 expref: 323 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.983961:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635266c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d33 expref: 323 pid: 5847 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.983976:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894221440:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431563.984150:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933499904
00000100:00100000:0.0:1789431563.984161:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933499904
00000100:00100000:0.0:1789431563.984218:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12479
00000100:00100000:0.0:1789431563.984228:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+324:14617:x1876351933499904:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431563.984629:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+325:14617:x1876351933499904:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 401us (1121us total) trans 4295121012 rc 0/0
00000100:00100000:0.0:1789431563.984638:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12479
00000100:00100000:2.0:1789431563.986004:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38780 going to sleep for 11 seconds
00000100:00100000:1.0:1789431563.990762:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431563.991030:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933500160
00000100:00100000:2.0:1789431563.991045:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933500160
00000100:00100000:2.0:1789431563.991152:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296050
00000100:00100000:2.0:1789431563.991164:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+325:14617:x1876351933500160:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431563.991242:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431563.991298:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cac00/0xd8e438fb635266e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d3a expref: 325 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.991324:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa6:0x0].0x0 (ffff90cf18b78700)
00010000:00010000:2.0:1789431563.991338:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431563.991372:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352670e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.991392:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352670e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.991409:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352670e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.991425:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526715 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.991431:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.991437:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.991581:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352671c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aa6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.991590:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352671c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.991597:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352671c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431563.992303:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1245, 64 off87872
00010000:00010000:2.0:1789431563.992391:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526723 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aa6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992404:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992414:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992423:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526723 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992430:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526723 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992436:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526723 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992459:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431563.992483:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352671c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992490:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352671c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aa6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992497:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352671c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992504:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62ce00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.992509:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352671c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992517:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352671c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aa6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992529:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa6:0x0].0x0 (ffff90cf13195500)
00010000:00010000:2.0:1789431563.992532:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431563.992537:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352671c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aa6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992544:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb6352671c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aa6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992569:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352670e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992576:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352670e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992581:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352670e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992587:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62cc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431563.992591:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352670e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992597:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352670e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992605:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431563.992608:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431563.992611:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352670e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431563.992617:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352670e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431563.992628:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004a5d4a6c reply state 000000008c878bc4 transno 4295121013 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431563.992636:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431563.992743:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+326:14617:x1876351933500160:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1577us (1999us total) trans 4295121013 rc 0/0
00000100:00100000:2.0:1789431563.992756:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296050
00010000:00010000:0.0:1789431563.993344:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431563.993353:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526723 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.993363:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431563.993367:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526723 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.993374:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526723 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.993386:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa6:0x0].0x0 (ffff90cf13195500)
00010000:00010000:0.0:1789431563.993389:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431563.993392:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526723 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10aa6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.993399:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526723 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aa6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431563.993419:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.993421:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431563.993422:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431563.999167:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.999190:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526715 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.999198:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526715 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.999210:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431563.999216:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526715 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.999225:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526715 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.999249:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90cf13195c00)
00010000:00010000:1.0:1789431563.999262:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431563.999268:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526715 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431563.999276:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb63526715 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.005233:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.005701:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933500288
00000100:00100000:2.0:1789431564.005716:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933500288
00000100:00080000:1.0:1789431564.005956:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:2.0:1789431564.006002:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296051
00000100:00100000:2.0:1789431564.006016:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+325:14617:x1876351933500288:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431564.006045:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431564.006098:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352672a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d4f expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006183:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526731 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006201:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526731 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006214:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526731 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006232:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526738 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006238:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006245:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006339:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526731 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006350:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526731 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006357:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526731 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006363:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62ce00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431564.006368:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526731 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006377:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526731 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006390:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431564.006394:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431564.006400:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526731 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006407:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526731 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006420:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006425:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526738 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006431:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526738 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006436:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431564.006440:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526738 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006446:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526738 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006454:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90cf13195700)
00010000:00010000:2.0:1789431564.006457:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431564.006459:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526738 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006465:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb63526738 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006506:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352672a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d4f expref: 326 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006517:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431564.006519:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431564.006523:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352672a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d4f expref: 326 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.006532:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62cc00, rc 0)
00000100:00100000:2.0:1789431564.006611:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+325:14617:x1876351933500288:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 598us (1393us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431564.006620:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296051
00000100:00100000:0.0:1789431564.008996:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.009126:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894221440:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.009164:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.009337:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933500416
00000100:00100000:3.0:1789431564.009347:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933500416
00010000:00010000:3.0:1789431564.009394:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635266c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d33 expref: 325 pid: 5847 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.009477:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16524
00000100:00100000:3.0:1789431564.009489:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+325:2347:x1876351933500416:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431564.009508:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431564.009517:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635266c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d33 expref: 325 pid: 5847 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.009531:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635266c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d33 expref: 325 pid: 5847 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.009558:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635266c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d33 expref: 325 pid: 5847 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.009577:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:3.0:1789431564.009582:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.009594:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.009603:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526707 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.009634:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431564.009697:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+324:2347:x1876351933500416:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 210us (715us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431564.009705:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16524
00010000:00010000:0.0:1789431564.009820:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.009829:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431564.009889:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008f:0x0]: returning size 260096
00000004:00200000:0.0:1789431564.009894:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431564.009921:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.009961:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526700 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d48 expref: 324 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.009980:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d48 expref: 323 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.009988:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:0.0:1789431564.009991:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431564.009994:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62d200, rc 0)
00000100:00100000:0.0:1789431564.010025:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+323:14616:x1876351933499648:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 26372us (30545us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.010032:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296049
00000100:00100000:3.0:1789431564.015164:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.015676:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933500544
00000100:00100000:1.0:1789431564.015690:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933500544
00000100:00100000:1.0:1789431564.015788:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296052
00000100:00100000:1.0:1789431564.015801:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+323:14617:x1876351933500544:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431564.015827:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431564.015855:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352673f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d56 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.015946:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526746 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.015964:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.015980:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431564.016028:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008c:0x0]: returning size 16384
00000004:00200000:1.0:1789431564.016032:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431564.016094:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.016127:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352673f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d56 expref: 325 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.016150:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d56 expref: 324 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.016160:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431564.016163:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431564.016167:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309000, rc 0)
00000100:00100000:1.0:1789431564.016263:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+324:14617:x1876351933500544:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 456us (1105us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.016271:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296052
00000100:00100000:1.0:1789431564.027584:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.030592:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933500800
00000100:00100000:3.0:1789431564.030615:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933500800
00000100:00100000:2.0:1789431564.030843:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12480
00000100:00100000:2.0:1789431564.030858:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+324:14616:x1876351933500800:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431564.031174:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+325:14616:x1876351933500800:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 318us (3605us total) trans 4295121014 rc 0/0
00000100:00100000:2.0:1789431564.031183:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12480
00000100:00100000:3.0:1789431564.032540:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.032699:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933500928
00000100:00100000:0.0:1789431564.032711:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933500928
00000100:00100000:0.0:1789431564.032803:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12481
00000100:00100000:0.0:1789431564.032814:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+325:14617:x1876351933500928:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431564.038309:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.038669:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933501056
00000100:00100000:0.0:1789431564.038684:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933501056
00000100:00100000:0.0:1789431564.038775:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296053
00000100:00100000:0.0:1789431564.038787:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+327:14616:x1876351933501056:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431564.038822:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431564.038864:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352674d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d5d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.038950:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526754 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.038968:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.038982:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.038999:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352675b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039007:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352675b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039014:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352675b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039188:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526762 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039198:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039206:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431564.039250:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008f:0x0]: returning size 260096
00000004:00200000:0.0:1789431564.039581:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431564.039611:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039627:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039636:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039643:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526754 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039650:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039657:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431564.039661:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039670:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526754 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039684:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431564.039687:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431564.039693:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526754 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039700:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526754 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039717:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352675b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039732:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352675b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039738:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352675b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039744:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431564.039747:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352675b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039753:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352675b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039762:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x6428115e (ffff90ce07190500)
00010000:00010000:0.0:1789431564.039765:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431564.039768:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352675b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039773:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352675b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039815:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb6352674d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d5d expref: 329 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039830:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d5d expref: 328 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.039837:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:0.0:1789431564.039839:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431564.039842:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad400, rc 0)
00000100:00100000:0.0:1789431564.039934:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+328:14616:x1876351933501056:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1149us (1640us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.039943:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296053
00000100:00100000:0.0:1789431564.045497:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+326:14617:x1876351933500928:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 12668us (12951us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.045514:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12481
00000100:00100000:1.0:1789431564.049093:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.049189:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933501184
00000100:00100000:2.0:1789431564.049202:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933501184
00000100:00100000:2.0:1789431564.049293:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14356
00000100:00100000:2.0:1789431564.049306:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+326:2350:x1876351933501184:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431564.049324:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431564.049359:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526762 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d5d expref: 326 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.049383:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:2.0:1789431564.049390:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.049462:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+325:2350:x1876351933501184:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 159us (430us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.049470:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14356
00000100:00100000:2.0:1789431564.055747:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.055825:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.055902:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933501696
00000100:00100000:3.0:1789431564.055902:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933501440
00000100:00100000:0.0:1789431564.055915:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933501696
00000100:00100000:3.0:1789431564.055915:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933501440
00000100:00100000:0.0:1789431564.055986:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296054
00000100:00100000:3.0:1789431564.055992:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296055
00000100:00100000:0.0:1789431564.055998:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+326:14617:x1876351933501696:12345-192.168.203.4@tcp:101:dbench.0
00000100:00100000:3.0:1789431564.055999:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+326:14616:x1876351933501440:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431564.056026:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431564.056026:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431564.056077:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526770 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d6b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.056077:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526769 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d64 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056177:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526777 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056194:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526777 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056207:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526777 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056223:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352677e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056230:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352677e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056236:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352677e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056322:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526777 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056331:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526777 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056339:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526777 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056346:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431564.056349:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526785 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056351:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526777 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056360:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526777 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.056364:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526707 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d48 expref: 328 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.056373:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526785 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056375:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431564.056378:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431564.056384:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526777 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056390:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526777 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056404:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352677e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056410:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352677e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.056414:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d48 expref: 328 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056416:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352677e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056422:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431564.056425:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352677e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056431:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352677e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.056431:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526707 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d48 expref: 328 pid: 5848 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056438:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce07190500)
00010000:00010000:0.0:1789431564.056441:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431564.056443:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352677e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.056448:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce35e46a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894221568:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431564.056449:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352677e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056485:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526770 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d6b expref: 328 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056493:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431564.056495:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:0.0:1789431564.056498:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526770 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d6b expref: 328 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.056506:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad800, rc 0)
00000100:00100000:0.0:1789431564.056536:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+327:14617:x1876351933501696:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 541us (712us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431564.056544:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296054
00000100:00100000:3.0:1789431564.056559:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf377c6780 going to sleep for 11 seconds
00000100:00100000:1.0:1789431564.060403:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.060435:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce35e46a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894221568:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.060475:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526785 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.061532:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933501824
00000100:00100000:0.0:1789431564.061548:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933501824
00010000:00010000:0.0:1789431564.061610:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526707 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d48 expref: 327 pid: 5848 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.062097:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16525
00000100:00100000:0.0:1789431564.062111:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+327:2349:x1876351933501824:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431564.062130:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431564.062139:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526707 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d48 expref: 327 pid: 5848 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.062156:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d48 expref: 327 pid: 5848 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.062185:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d200/0xd8e438fb63526707 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d48 expref: 327 pid: 5848 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.062206:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:0.0:1789431564.062213:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526785 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.062225:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526785 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.062234:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526785 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.062272:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431564.062485:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526785 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.062496:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526785 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431564.062521:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008f:0x0]: returning size 260096
00010000:00010000:2.0:1789431564.062737:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cbc00/0xd8e438fb63526769 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d64 expref: 328 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.062756:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526785 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d64 expref: 327 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.062765:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:2.0:1789431564.062768:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431564.062771:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce035cba00, rc 0)
00000100:00100000:0.0:1789431564.062819:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+327:2349:x1876351933501824:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 711us (2429us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.062832:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16525
00000100:00100000:2.0:1789431564.063634:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+326:14616:x1876351933501440:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7628us (7915us total) trans 4295121015 rc 0/0
00000100:00100000:2.0:1789431564.063644:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296055
00000100:00100000:1.0:1789431564.067824:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.067921:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933502080
00000100:00100000:0.0:1789431564.067936:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933502080
00000100:00100000:0.0:1789431564.068014:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296056
00000100:00100000:0.0:1789431564.068026:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+326:14617:x1876351933502080:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431564.068115:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431564.068119:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431564.068156:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526746 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d56 expref: 326 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.068177:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431564.068184:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431564.068202:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526793 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d72 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.068358:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352679a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.068385:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352679a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.068398:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352679a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.068413:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635267a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.068420:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635267a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.068428:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635267a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431564.069154:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x515:0x0], index 1: 0
00010000:00010000:0.0:1789431564.069378:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635267a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.069397:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635267a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.069409:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635267a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.069460:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352679a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.069468:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352679a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.069476:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352679a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.069482:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431564.069486:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352679a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.069495:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352679a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.069506:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431564.069509:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431564.069515:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352679a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.069522:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352679a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431564.069537:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ce2c56bd reply state 0000000030ce18e7 transno 4295121016 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635267a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.069548:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431564.069589:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526793 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d72 expref: 328 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.069605:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635267a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d72 expref: 327 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.069611:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90ce07190000)
00010000:00010000:0.0:1789431564.069614:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431564.069617:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ace00, rc 0)
00000100:00100000:0.0:1789431564.069713:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+328:14617:x1876351933502080:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1688us (1904us total) trans 4295121016 rc 0/0
00000100:00100000:0.0:1789431564.069736:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296056
00000100:00100000:1.0:1789431564.075041:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431564.075394:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635267a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.075411:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635267a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.075421:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635267a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.075428:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431564.075434:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635267a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.075444:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635267a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.075463:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce07190500)
00010000:00010000:2.0:1789431564.075467:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431564.075474:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635267a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.075481:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635267a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.075612:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933502208
00000100:00100000:0.0:1789431564.075628:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933502208
00000100:00100000:0.0:1789431564.075741:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296057
00000100:00100000:0.0:1789431564.075755:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+327:14616:x1876351933502208:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431564.075786:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431564.075808:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635267b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d79 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.075925:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb635267bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.075941:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526785 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d64 expref: 328 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.075951:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb635267bd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.075991:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526785 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d64 expref: 328 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.076007:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526785 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d64 expref: 328 pid: 12181 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.076022:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce36219f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894221696:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431564.076279:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ac1f180 going to sleep for 11 seconds
00000100:00100000:0.0:1789431564.079987:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce36219f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894221696:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431564.080032:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb635267bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.083918:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.084036:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.084174:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933502336
00000100:00100000:2.0:1789431564.084189:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933502336
00010000:00010000:2.0:1789431564.084245:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526785 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d64 expref: 329 pid: 12181 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.084297:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16526
00000100:00100000:2.0:1789431564.084308:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+329:2348:x1876351933502336:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431564.084327:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431564.084336:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526785 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d64 expref: 329 pid: 12181 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.084351:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526785 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d64 expref: 329 pid: 12181 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.084381:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cba00/0xd8e438fb63526785 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d64 expref: 329 pid: 12181 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.084399:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:2.0:1789431564.084407:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb635267bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.084419:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb635267bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.084428:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb635267bd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.084463:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.084530:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+328:2348:x1876351933502336:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 223us (627us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.084538:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16526
00010000:00010000:3.0:1789431564.084663:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb635267bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.084673:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb635267bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.084714:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933502464
00000100:00100000:0.0:1789431564.084719:0:14464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933502464
00000004:00200000:3.0:1789431564.084750:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008f:0x0]: returning size 260096
00000004:00200000:3.0:1789431564.084756:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000100:00100000:0.0:1789431564.084781:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8270
00000004:00010000:3.0:1789431564.084783:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb635267bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.084789:0:14464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+95:2348:x1876351933502464:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431564.084806:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431564.084821:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635267b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d79 expref: 328 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.084829:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb635267c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d80 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.084839:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb635267bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d79 expref: 327 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.084846:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:3.0:1789431564.084848:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431564.084850:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce19859200, rc 0)
00002000:00010000:0.0:1789431564.084862:0:14464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x515:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431564.084881:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x515:0x0].0x0 since=3022s v=(0 0)
00000100:00100000:3.0:1789431564.084883:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+327:14616:x1876351933502208:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9133us (9857us total) trans 0 rc 0/0
00010000:00010000:0.0:1789431564.084886:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x515:0x0].0x0 since=0s v=(0 0)
00000100:00100000:3.0:1789431564.084890:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296057
00010000:00010000:0.0:1789431564.084896:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb635267c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d80 expref: 96 pid: 14464 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.084913:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb635267c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d80 expref: 96 pid: 14464 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.084925:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad000, rc 0)
00000100:00100000:0.0:1789431564.084948:0:14464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+96:2348:x1876351933502464:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 161us (912us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.084955:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8270
00000100:00080000:2.0:1789431564.085185:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1789431564.092016:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.092294:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933502720
00000100:00100000:2.0:1789431564.092308:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933502720
00000100:00100000:2.0:1789431564.092423:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8271
00000100:00100000:2.0:1789431564.092435:0:14500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+96:14617:x1876351933502720:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431564.092460:0:14500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431564.092485:0:14500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ced543ee/0xd8e438fb635267cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d8e expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.092533:0:14500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb635267c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d80 expref: 97 pid: 14464 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.092544:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x515:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431564.092549:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x515:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431564.092556:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ced543ee/0xd8e438fb635267cb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d8e expref: 97 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.092765:0:14500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb635267c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d80 expref: 97 pid: 14464 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.092783:0:14500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb635267c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d80 expref: 97 pid: 14464 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.092801:0:14500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:14500:1876351894221824:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.092921:0:14500:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38240 going to sleep for 11 seconds
00000100:00100000:3.0:1789431564.093356:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.093703:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933502592
00000100:00100000:2.0:1789431564.093712:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933502592
00000100:00100000:2.0:1789431564.093782:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296058
00000100:00100000:2.0:1789431564.093793:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+327:14616:x1876351933502592:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431564.093816:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431564.093840:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635267d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d87 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.093915:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635267d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.093934:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635267d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.093948:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635267d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.093968:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635267e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.093975:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635267e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.093982:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635267e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094146:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635267e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094157:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635267e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094164:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635267e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431564.094208:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008f:0x0]: returning size 260096
00000004:00200000:2.0:1789431564.094213:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431564.094237:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635267e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094249:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635267e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094270:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635267d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094277:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635267d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094283:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635267d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094290:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62dc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431564.094295:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635267d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094304:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635267d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094318:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431564.094321:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431564.094327:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635267d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094338:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb635267d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094352:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635267e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094358:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635267e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094364:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635267e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094370:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62ce00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431564.094373:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635267e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094379:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635267e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094386:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x6428115e (ffff90cf13195700)
00010000:00010000:2.0:1789431564.094389:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431564.094392:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635267e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094397:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb635267e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094433:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb635267d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d87 expref: 329 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094453:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635267e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d87 expref: 328 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.094462:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:2.0:1789431564.094464:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431564.094467:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62de00, rc 0)
00000100:00100000:2.0:1789431564.094535:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+328:14616:x1876351933502592:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 744us (1180us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.094544:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296058
00000100:00100000:0.0:1789431564.100126:0:14500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:14500:1876351894221824:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431564.100126:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431564.100173:0:14500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ced543ee/0xd8e438fb635267cb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d8e expref: 97 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.100202:0:14500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62c800, rc 0)
00000100:00100000:0.0:1789431564.100289:0:14500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+97:14617:x1876351933502720:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7856us (8286us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.100299:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8271
00000100:00100000:1.0:1789431564.100401:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933502848
00000100:00100000:1.0:1789431564.100411:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933502848
00010000:00010000:1.0:1789431564.100452:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb635267c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d80 expref: 97 pid: 14464 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.100492:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16527
00000100:00100000:1.0:1789431564.100504:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+97:2348:x1876351933502848:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.100523:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.100553:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb635267c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x515:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d80 expref: 97 pid: 14464 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.100568:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb635267c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x515:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d80 expref: 97 pid: 14464 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.100604:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb635267c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x515:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d80 expref: 97 pid: 14464 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.100630:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x515:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.100635:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x515:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.100645:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ced543ee/0xd8e438fb635267cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d8e expref: 96 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.100662:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ced543ee/0xd8e438fb635267cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d8e expref: 96 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.100703:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ced543ee/0xd8e438fb635267cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d8e expref: 96 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.100729:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1a56a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5832:1876351894221952:192.168.203.4@tcp:105:
00000100:00100000:1.0:1789431564.100810:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05eadb40 going to sleep for 11 seconds
00000100:00100000:3.0:1789431564.107779:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.107838:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.108091:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933502976
00000100:00100000:0.0:1789431564.108104:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933502976
00000100:00100000:0.0:1789431564.108181:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14357
00000100:00100000:0.0:1789431564.108194:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+328:2348:x1876351933502976:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431564.108218:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431564.108250:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62de00/0xd8e438fb635267e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d87 expref: 328 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.108275:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:0.0:1789431564.108294:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431564.108361:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+327:2348:x1876351933502976:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 170us (599us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.108370:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14357
00000100:00100000:2.0:1789431564.108677:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1a56a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5832:1876351894221952:192.168.203.4@tcp:105:
00010000:00010000:2.0:1789431564.108705:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.108753:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+96:2348:x1876351933502848:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 8252us (8638us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.108761:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16527
00000100:00100000:1.0:1789431564.109816:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933503232
00000100:00100000:1.0:1789431564.109830:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933503232
00000100:00100000:1.0:1789431564.109889:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296059
00000100:00100000:1.0:1789431564.109899:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+327:14616:x1876351933503232:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431564.109965:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.109996:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb635267bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d79 expref: 327 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.110019:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:1.0:1789431564.110025:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431564.111586:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635267ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.111613:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635267ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.111627:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635267ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431564.111845:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000076689224 reply state 0000000003147a12 transno 4295121017 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635267ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.111857:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431564.112004:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+328:14616:x1876351933503232:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2100us (4159us total) trans 4295121017 rc 0/0
00000100:00100000:1.0:1789431564.112014:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296059
00010000:00010000:1.0:1789431564.115713:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635267ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.115751:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635267ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.115761:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635267ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.115768:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431564.115775:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635267ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.115784:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635267ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.115805:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:1.0:1789431564.115808:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431564.115814:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635267ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.115822:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635267ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.117958:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.118145:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.118461:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933503616
00000100:00100000:2.0:1789431564.118476:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933503616
00000100:00100000:2.0:1789431564.118549:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12482
00000100:00100000:2.0:1789431564.118562:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+327:14617:x1876351933503616:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431564.119040:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+328:14617:x1876351933503616:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 478us (892us total) trans 4295121018 rc 0/0
00000100:00100000:2.0:1789431564.119477:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12482
00000100:00100000:3.0:1789431564.121013:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933503360
00000100:00100000:3.0:1789431564.121028:0:14502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933503360
00000100:00100000:3.0:1789431564.123934:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.124124:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933503872
00000100:00100000:1.0:1789431564.124136:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933503872
00000100:00100000:2.0:1789431564.124164:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8272
00000100:00100000:2.0:1789431564.124178:0:14502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+96:2347:x1876351933503360:12345-192.168.203.4@tcp:2:dbench.0
00000100:00100000:1.0:1789431564.124180:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296060
00000100:00100000:1.0:1789431564.124186:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+328:14617:x1876351933503872:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431564.124220:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431564.124251:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635267f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d95 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.124373:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635267fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.124390:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635267a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d72 expref: 329 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.124401:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635267fc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.124441:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635267a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d72 expref: 329 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.124456:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635267a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d72 expref: 329 pid: 5849 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.124471:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1a569c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894222080:192.168.203.4@tcp:104:
00002000:00010000:2.0:1789431564.124529:0:14502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb size from disk: 260096 -> 260096
00002000:00010000:2.0:1789431564.124532:0:14502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb mtime from disk: 1789431497 -> 1789431485
00002000:00010000:2.0:1789431564.124535:0:14502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb atime from disk: 1789431489 -> 1789431553
00002000:00010000:2.0:1789431564.124537:0:14502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb ctime from disk: 1789431509 -> 1789431563
00002000:00010000:2.0:1789431564.124539:0:14502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb blocks from disk: 515 -> 515
00000100:00100000:1.0:1789431564.124572:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05eadd80 going to sleep for 11 seconds
00000100:00100000:2.0:1789431564.124574:0:14502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+97:2347:x1876351933503360:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 398us (6629us total) trans 4294970003 rc 0/0
00000100:00100000:2.0:1789431564.124581:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8272
00000100:00100000:1.0:1789431564.127777:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1a569c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894222080:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.127821:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635267fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.129315:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.129552:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933504000
00000100:00100000:0.0:1789431564.129567:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933504000
00010000:00010000:0.0:1789431564.129623:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635267a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d72 expref: 330 pid: 5849 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.129665:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16528
00000100:00100000:0.0:1789431564.129677:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e952c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+330:2348:x1876351933504000:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431564.129697:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431564.129705:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635267a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d72 expref: 330 pid: 5849 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.129729:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635267a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d72 expref: 330 pid: 5849 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.129769:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635267a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d72 expref: 330 pid: 5849 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.129791:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90ce07190000)
00010000:00010000:0.0:1789431564.129797:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635267fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.129809:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635267fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.129819:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635267fc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.129856:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431564.129880:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635267fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.129889:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635267fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431564.129918:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000100:00100000:0.0:1789431564.129933:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e952c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+329:2348:x1876351933504000:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 259us (633us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.129941:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16528
00010000:00010000:1.0:1789431564.130155:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635267f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d95 expref: 330 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.130175:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635267fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d95 expref: 329 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.130183:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90ce07190000)
00010000:00010000:1.0:1789431564.130186:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431564.130189:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308200, rc 0)
00000100:00100000:1.0:1789431564.130233:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+329:14617:x1876351933503872:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6047us (6315us total) trans 4295121019 rc 0/0
00000100:00100000:1.0:1789431564.130241:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296060
00000100:00100000:3.0:1789431564.141421:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.141529:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933504128
00000100:00100000:2.0:1789431564.141545:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933504128
00000100:00100000:2.0:1789431564.141622:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296061
00000100:00100000:2.0:1789431564.141635:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+329:14617:x1876351933504128:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431564.141667:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431564.141696:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352680a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8d9c expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.141838:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526811 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.141857:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635267fc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d95 expref: 330 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.141868:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526811 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.141913:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635267fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d95 expref: 330 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.141935:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635267fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d95 expref: 330 pid: 12775 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.141951:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894222208:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.142092:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb386c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431564.144954:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894222208:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.144997:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526811 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.147362:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.148389:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933504256
00000100:00100000:1.0:1789431564.148404:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933504256
00010000:00010000:1.0:1789431564.148472:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635267fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d95 expref: 331 pid: 12775 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.148569:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16529
00000100:00100000:1.0:1789431564.148581:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+331:2348:x1876351933504256:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.148608:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.148617:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635267fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d95 expref: 331 pid: 12775 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.148635:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635267fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d95 expref: 331 pid: 12775 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.148668:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635267fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d95 expref: 331 pid: 12775 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.148687:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90ce07190000)
00010000:00010000:1.0:1789431564.148694:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526811 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.148705:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.148714:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526811 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.148772:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.148848:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+330:2348:x1876351933504256:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 268us (1500us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.148857:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16529
00010000:00010000:0.0:1789431564.148945:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.148955:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431564.149017:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000004:00200000:0.0:1789431564.149023:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431564.149071:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.149116:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62d000/0xd8e438fb6352680a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d9c expref: 330 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.149133:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d9c expref: 329 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.149142:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90ce07190000)
00010000:00010000:0.0:1789431564.149145:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431564.149148:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62ce00, rc 0)
00000100:00100000:0.0:1789431564.149180:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+329:14617:x1876351933504128:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7546us (7775us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.149187:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296061
00000100:00100000:3.0:1789431564.149200:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.149231:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933504512
00000100:00100000:3.0:1789431564.149237:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933504512
00000100:00100000:3.0:1789431564.149290:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12483
00000100:00100000:3.0:1789431564.149299:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+329:14616:x1876351933504512:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431564.149536:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+330:14616:x1876351933504512:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 238us (335us total) trans 4295121020 rc 0/0
00000100:00100000:3.0:1789431564.149543:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12483
00000100:00100000:0.0:1789431564.157096:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.157897:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933504640
00000100:00100000:3.0:1789431564.157912:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933504640
00002000:00100000:3.0:1789431564.157987:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x515:0x0] (0->85514)  req@ffff90ce3621b800 x1876351933504640/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 488/0 e 0 to 0 dl 1789431575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431564.158000:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce3621b800 with x1876351933504640 ext(0->85514)
00002000:00010000:3.0:1789431564.158007:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce3621b800
00000100:00100000:1.0:1789431564.158286:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1537
00000100:00100000:1.0:1789431564.158304:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+97:2350:x1876351933504640:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:0.0:1789431564.159336:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.159509:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933504768
00000100:00100000:1.0:1789431564.159518:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933504768
00000100:00100000:1.0:1789431564.159559:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296062
00000100:00100000:1.0:1789431564.159565:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+330:14616:x1876351933504768:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431564.159589:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431564.159614:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526818 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8da3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.159694:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352681f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.159708:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352681f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.159729:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352681f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.162637:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526826 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.162674:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.162691:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.162870:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352682d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.162881:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352682d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.162889:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352682d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431564.162945:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008f:0x0]: returning size 260096
00000004:00200000:1.0:1789431564.162952:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431564.162981:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352682d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.162995:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352682d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.163006:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352681f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.163013:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352681f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.163021:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352681f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.163029:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431564.163034:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352681f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.163043:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352681f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.163091:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431564.163095:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431564.163101:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352681f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.163108:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352681f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.163129:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.163136:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526826 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.163142:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.163148:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431564.163151:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.163158:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526826 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.163166:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x6428115e (ffff90ce03149300)
00010000:00010000:1.0:1789431564.163169:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431564.163172:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526826 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.163178:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526826 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.163231:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526818 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8da3 expref: 332 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.163249:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352682d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8da3 expref: 331 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.163263:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:1.0:1789431564.163266:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431564.163269:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:1.0:1789431564.163354:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+331:14616:x1876351933504768:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3785us (4022us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.163366:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296062
00000100:00100000:2.0:1789431564.169377:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+99:2350:x1876351933504640:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 11058us (12314us total) trans 4294970004 rc 0/0
00000100:00100000:2.0:1789431564.169394:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1537
00002000:00100000:2.0:1789431564.169413:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x515:0x0] (0->85514)  req@ffff90ce3621b800 x1876351933504640/t4294970004(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 488/448 e 0 to 0 dl 1789431575 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431564.169423:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce3621b800 with x1876351933504640 ext(0->85514)
00002000:00010000:2.0:1789431564.169432:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce3621b800
00000100:00100000:3.0:1789431564.172517:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.172588:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933505024
00000100:00100000:1.0:1789431564.172601:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933505024
00000100:00100000:1.0:1789431564.172696:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296063
00000100:00100000:1.0:1789431564.172709:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+331:14616:x1876351933505024:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431564.172756:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431564.172786:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526834 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8daa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.172927:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352683b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.172944:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352682d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8da3 expref: 332 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.172954:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352683b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.172999:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352682d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8da3 expref: 332 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.173015:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352682d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8da3 expref: 332 pid: 5847 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.173032:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1a569c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894222336:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.173169:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead9c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431564.177216:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.177677:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933505152
00000100:00100000:2.0:1789431564.177692:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933505152
00000100:00100000:2.0:1789431564.177782:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296064
00000100:00100000:2.0:1789431564.177794:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+333:14617:x1876351933505152:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:1.0:1789431564.183171:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.183218:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933505280
00000100:00100000:1.0:1789431564.183231:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933505280
00010000:00010000:1.0:1789431564.183287:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352682d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8da3 expref: 334 pid: 5847 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.183334:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16530
00000100:00100000:1.0:1789431564.183345:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+334:2348:x1876351933505280:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.183363:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.183372:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352682d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8da3 expref: 334 pid: 5847 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.183386:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352682d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8da3 expref: 334 pid: 5847 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.183414:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:1.0:1789431564.183420:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352683b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.183431:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352683b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.183441:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352683b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.183468:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.183531:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+334:2348:x1876351933505280:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 187us (376us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.183539:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16530
00010000:00010000:1.0:1789431564.183688:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352682d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8da3 expref: 333 pid: 5847 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.183707:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1a569c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894222336:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.183750:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352683b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.183760:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352683b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.183766:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352683b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431564.183789:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008f:0x0]: returning size 260096
00010000:00010000:1.0:1789431564.184015:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526834 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8daa expref: 334 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.184032:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352683b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8daa expref: 333 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.184040:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:1.0:1789431564.184044:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431564.184085:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308600, rc 0)
00000100:00100000:1.0:1789431564.184133:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+333:14616:x1876351933505024:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11427us (11633us total) trans 4295121021 rc 0/0
00000100:00100000:1.0:1789431564.184141:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296063
00000100:00100000:1.0:1789431564.190943:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.191030:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933505408
00000100:00100000:0.0:1789431564.191043:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933505408
00000100:00100000:0.0:1789431564.191138:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296065
00000100:00100000:0.0:1789431564.191151:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+333:14616:x1876351933505408:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431564.191184:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431564.191213:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526849 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8db1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.191325:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526850 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.191343:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352683b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8daa expref: 334 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.191352:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526850 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.191397:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352683b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8daa expref: 334 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.191412:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352683b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8daa expref: 334 pid: 5848 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.191427:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce36219500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894222464:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431564.191534:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ac1ff00 going to sleep for 11 seconds
00000100:00100000:0.0:1789431564.197538:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce36219500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894222464:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431564.197576:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526850 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.205131:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.205277:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933505536
00000100:00100000:1.0:1789431564.205291:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933505536
00010000:00010000:1.0:1789431564.205344:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352683b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8daa expref: 335 pid: 5848 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.205437:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16531
00000100:00100000:1.0:1789431564.205449:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+335:2347:x1876351933505536:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.205467:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.205474:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352683b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8daa expref: 335 pid: 5848 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.205490:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352683b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8daa expref: 335 pid: 5848 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.205522:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352683b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8daa expref: 335 pid: 5848 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.205542:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:1.0:1789431564.205549:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526850 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.205560:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.205573:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526850 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.205687:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.205771:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+334:2347:x1876351933505536:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 323us (655us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.205779:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16531
00010000:00010000:1.0:1789431564.209860:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.209880:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431564.210003:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008f:0x0]: returning size 260096
00000004:00200000:1.0:1789431564.210009:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431564.210039:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.210102:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526849 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8db1 expref: 334 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.210128:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8db1 expref: 333 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.210138:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:1.0:1789431564.210142:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431564.210146:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ace00, rc 0)
00000100:00100000:1.0:1789431564.210279:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+333:14616:x1876351933505408:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 19128us (19347us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.210293:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296065
00000100:00100000:1.0:1789431564.215221:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.215373:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933505664
00000100:00100000:2.0:1789431564.215388:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933505664
00000100:00100000:2.0:1789431564.215459:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296066
00000100:00100000:2.0:1789431564.215471:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+333:14616:x1876351933505664:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431564.215500:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431564.215530:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526857 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8db8 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.215624:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352685e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.215642:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352685e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.215655:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352685e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.215673:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526865 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.215680:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.215687:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216025:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352686c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216036:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352686c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216044:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352686c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431564.216134:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008f:0x0]: returning size 260096
00000004:00200000:2.0:1789431564.216140:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431564.216164:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352686c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216179:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352686c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216188:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352685e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216194:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352685e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216201:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352685e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216208:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62cc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431564.216213:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352685e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216221:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352685e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216235:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431564.216238:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431564.216244:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352685e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216547:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62cc00/0xd8e438fb6352685e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216567:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216573:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526865 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216581:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216586:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431564.216590:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216597:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526865 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216605:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x6428115e (ffff90cf13195700)
00010000:00010000:2.0:1789431564.216608:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431564.216611:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526865 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216617:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c400/0xd8e438fb63526865 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216662:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62dc00/0xd8e438fb63526857 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8db8 expref: 335 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216678:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352686c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8db8 expref: 334 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.216686:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:2.0:1789431564.216689:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431564.216692:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3b62c200, rc 0)
00000100:00100000:2.0:1789431564.216889:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+334:14616:x1876351933505664:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1417us (1677us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.216898:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296066
00000100:00100000:3.0:1789431564.223520:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.223701:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933505920
00000100:00100000:1.0:1789431564.223715:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933505920
00000100:00100000:1.0:1789431564.223807:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296067
00000100:00100000:1.0:1789431564.223820:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+334:14616:x1876351933505920:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431564.223893:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:1.0:1789431564.223928:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62c200/0xd8e438fb6352686c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8db8 expref: 334 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.223956:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526850 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8db1 expref: 333 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.223969:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:1.0:1789431564.223975:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431564.224035:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526873 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.224069:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.224082:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431564.224479:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000972e08b reply state 00000000e57ed261 transno 4295121022 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.224490:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431564.224616:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+334:14616:x1876351933505920:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 797us (1108us total) trans 4295121022 rc 0/0
00000100:00100000:1.0:1789431564.224625:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296067
00010000:00010000:2.0:1789431564.227077:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.227100:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526873 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.227109:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526873 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.227116:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431564.227122:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526873 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.227131:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526873 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.227151:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:2.0:1789431564.227155:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431564.227161:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526873 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.227168:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63526873 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.234025:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.234771:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933506048
00000100:00100000:3.0:1789431564.234785:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933506048
00000100:00100000:3.0:1789431564.234853:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8273
00000100:00100000:3.0:1789431564.234864:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+99:2349:x1876351933506048:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:3.0:1789431564.235129:0:14497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb size from disk: 260096 -> 260096
00002000:00010000:3.0:1789431564.235134:0:14497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb mtime from disk: 1789431485 -> 1789431551
00002000:00010000:3.0:1789431564.235137:0:14497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb atime from disk: 1789431553 -> 1789431543
00002000:00010000:3.0:1789431564.235139:0:14497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb ctime from disk: 1789431563 -> 1789431563
00002000:00010000:3.0:1789431564.235141:0:14497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb blocks from disk: 515 -> 515
00000100:00100000:3.0:1789431564.235228:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+100:2349:x1876351933506048:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 364us (1215us total) trans 4294970005 rc 0/0
00000100:00100000:3.0:1789431564.235236:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8273
00000100:00100000:2.0:1789431564.239807:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.239852:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933506304
00000100:00100000:2.0:1789431564.239866:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933506304
00000100:00100000:2.0:1789431564.239939:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12484
00000100:00100000:2.0:1789431564.239952:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+333:14616:x1876351933506304:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431564.240297:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+334:14616:x1876351933506304:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 347us (503us total) trans 4295121023 rc 0/0
00000100:00100000:2.0:1789431564.240305:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12484
00000100:00100000:2.0:1789431564.244127:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.244242:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933506432
00000100:00100000:1.0:1789431564.244255:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933506432
00000100:00100000:1.0:1789431564.244321:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296068
00000100:00100000:1.0:1789431564.244334:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+334:14616:x1876351933506432:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431564.244363:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431564.244390:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352687a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8dbf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.244474:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526881 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.244493:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526881 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.244506:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526881 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.244522:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526888 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.244530:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.244537:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.244944:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352688f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.244956:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352688f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.244964:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352688f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431564.245008:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008f:0x0]: returning size 260096
00000004:00200000:1.0:1789431564.245014:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431564.245039:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352688f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.245077:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352688f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.245087:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526881 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.245094:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526881 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.245102:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526881 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.245108:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431564.245113:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526881 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.245122:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526881 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.245137:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431564.245141:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431564.245147:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526881 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.245154:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526881 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.245171:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.245176:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526888 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.245182:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.245187:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431564.245190:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.245196:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526888 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.245204:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x6428115e (ffff90ce03149300)
00010000:00010000:1.0:1789431564.245206:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431564.245209:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526888 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.245215:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526888 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.245962:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352687a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dbf expref: 336 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.245999:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352688f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dbf expref: 335 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.246010:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:1.0:1789431564.246013:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431564.246017:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309000, rc 0)
00000100:00100000:1.0:1789431564.246732:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+335:14616:x1876351933506432:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2386us (2606us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.246745:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296068
00000001:00080000:2.0:1789431564.256082:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121016 is committed
00000004:00080000:2.0:1789431564.256113:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 369 committed
00000100:00100000:2.0:1789431564.256440:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce35e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894222592:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431564.256530:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431564.256603:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894223104:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431564.257003:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431564.257038:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:2.0:1789431564.257045:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce35e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894222720:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431564.257099:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431564.257127:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894223232:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431564.257145:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431564.257178:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce35e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894222848:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431564.257203:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431564.257221:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894223360:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431564.257239:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431564.257507:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:2.0:1789431564.257516:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894222976:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431564.257540:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431564.257559:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894223488:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431564.257581:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431564.257953:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894222592
00000100:00100000:2.0:1789431564.257964:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894222592
00000100:00100000:2.0:1789431564.258156:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894223104
00000100:00100000:2.0:1789431564.258161:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894223104
00000100:00100000:2.0:1789431564.258182:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894222720
00000100:00100000:2.0:1789431564.258185:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894222720
00000100:00100000:2.0:1789431564.258203:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894223232
00000100:00100000:2.0:1789431564.258206:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894223232
00000100:00100000:2.0:1789431564.258222:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894222848
00000100:00100000:2.0:1789431564.258225:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894222848
00000100:00100000:2.0:1789431564.258243:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894223360
00000100:00100000:2.0:1789431564.258246:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894223360
00000100:00100000:2.0:1789431564.258278:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894222976
00000100:00100000:2.0:1789431564.258281:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894222976
00000100:00100000:2.0:1789431564.258298:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894223488
00000100:00100000:2.0:1789431564.258301:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894223488
00000100:00100000:2.0:1789431564.258323:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8274
00000100:00100000:2.0:1789431564.258333:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3311:x1876351894222592:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431564.258371:0:14471:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1294 count 1
00010000:00010000:2.0:1789431564.258408:0:14471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e644db6f/0xd8e438fb63526896 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x50e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.258435:0:14471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054447f51/0xd8e438fb635248ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x50e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8648 expref: 101 pid: 14486 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.258446:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50e:0x0].0x0 since=4s v=(0 0)
00010000:00010000:2.0:1789431564.258451:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431564.258456:0:14471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e644db6f/0xd8e438fb63526896 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x50e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.258494:0:14471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000054447f51/0xd8e438fb635248ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8648 expref: 101 pid: 14486 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.258511:0:14471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000054447f51/0xd8e438fb635248ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x50e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8648 expref: 101 pid: 14486 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.258524:0:14471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14471:1876351894223616:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.258608:0:14471:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38e40 going to sleep for 11 seconds
00000100:00100000:2.0:1789431564.258884:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8275
00000100:00100000:2.0:1789431564.258894:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3311:x1876351894223104:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431564.258910:0:14468:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1298 count 1
00010000:00010000:2.0:1789431564.258924:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c00a3b55/0xd8e438fb6352689d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x512:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.258938:0:14468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000020cafc2e/0xd8e438fb63524d99 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x512:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87b4 expref: 101 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.258946:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x512:0x0].0x0 since=4s v=(0 0)
00010000:00010000:2.0:1789431564.258949:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x512:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431564.258952:0:14468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c00a3b55/0xd8e438fb6352689d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x512:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.258972:0:14468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000020cafc2e/0xd8e438fb63524d99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x512:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87b4 expref: 101 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.258981:0:14468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000020cafc2e/0xd8e438fb63524d99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x512:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87b4 expref: 101 pid: 6700 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.258998:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14468:1876351894223744:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.259026:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38cc0 going to sleep for 11 seconds
00000100:00100000:2.0:1789431564.259069:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8276
00000100:00100000:2.0:1789431564.259077:0:14472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3311:x1876351894222720:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431564.259091:0:14472:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1295 count 1
00010000:00010000:2.0:1789431564.259103:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078b22602/0xd8e438fb635268a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x50f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.259115:0:14472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f75eeb0/0xd8e438fb635249da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x50f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86a3 expref: 101 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.259122:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50f:0x0].0x0 since=4s v=(0 0)
00010000:00010000:2.0:1789431564.259125:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50f:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431564.259128:0:14472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078b22602/0xd8e438fb635268a4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x50f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.259139:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8277
00010000:00010000:2.0:1789431564.259147:0:14472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f75eeb0/0xd8e438fb635249da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86a3 expref: 101 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.259148:0:14482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3311:x1876351894223232:12345-0@lo:6:osp-syn-0-0.0
00010000:00010000:2.0:1789431564.259157:0:14472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f75eeb0/0xd8e438fb635249da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x50f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86a3 expref: 101 pid: 14490 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00002000:00080000:3.0:1789431564.259162:0:14482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1299 count 1
00000100:00100000:2.0:1789431564.259168:0:14472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14472:1876351894223872:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.259175:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000677ed0fd/0xd8e438fb635268ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x513:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.259186:0:14482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb6352508d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x513:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8808 expref: 101 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.259194:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x513:0x0].0x0 since=3s v=(0 0)
00010000:00010000:3.0:1789431564.259196:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x513:0x0].0x0 since=0s v=(0 0)
00000100:00100000:2.0:1789431564.259199:0:14472:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38780 going to sleep for 11 seconds
00010000:00010000:3.0:1789431564.259201:0:14482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000677ed0fd/0xd8e438fb635268ab lrc: 4/0,1 mode: --/PW res: [0x240000400:0x513:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.259217:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8278
00010000:00010000:3.0:1789431564.259222:0:14482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb6352508d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x513:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8808 expref: 101 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.259224:0:14499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+12:3313:x1876351894222848:12345-0@lo:6:osp-syn-0-0.0
00010000:00010000:3.0:1789431564.259231:0:14482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb6352508d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x513:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8808 expref: 101 pid: 14500 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00002000:00080000:2.0:1789431564.259239:0:14499:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1296 count 1
00000100:00100000:3.0:1789431564.259241:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14482:1876351894224000:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431564.259264:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095b38ee6/0xd8e438fb635268b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x510:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.259268:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf14143000 going to sleep for 11 seconds
00010000:00010000:2.0:1789431564.259277:0:14499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63524b46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x510:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8705 expref: 101 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.259284:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x510:0x0].0x0 since=4s v=(0 0)
00010000:00010000:2.0:1789431564.259287:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x510:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431564.259290:0:14499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095b38ee6/0xd8e438fb635268b2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x510:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.259309:0:14499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63524b46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x510:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8705 expref: 101 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.259319:0:14499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63524b46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x510:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8705 expref: 101 pid: 14469 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.259329:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:14499:1876351894224128:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.259353:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38b40 going to sleep for 11 seconds
00000100:00100000:2.0:1789431564.259372:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8279
00000100:00100000:2.0:1789431564.259380:0:14491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+12:3313:x1876351894223360:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431564.259396:0:14491:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1300 count 1
00010000:00010000:2.0:1789431564.259409:0:14491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009f3ab8f/0xd8e438fb635268b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x514:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.259420:0:14491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb635252fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x514:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88cc expref: 101 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.259427:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x514:0x0].0x0 since=3s v=(0 0)
00010000:00010000:2.0:1789431564.259430:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x514:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431564.259433:0:14491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009f3ab8f/0xd8e438fb635268b9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x514:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.259452:0:14491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb635252fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x514:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88cc expref: 101 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.259461:0:14491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb635252fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x514:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88cc expref: 101 pid: 8217 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.259471:0:14491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:14491:1876351894224256:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.259526:0:14491:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38840 going to sleep for 11 seconds
00000100:00100000:2.0:1789431564.259547:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8280
00000100:00100000:2.0:1789431564.259554:0:14490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3313:x1876351894222976:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431564.259568:0:14490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1297 count 1
00010000:00010000:2.0:1789431564.259580:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb635268c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x511:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.259694:0:14490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008edd2dd6/0xd8e438fb63524c7a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x511:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8767 expref: 101 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.259702:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x511:0x0].0x0 since=4s v=(0 0)
00010000:00010000:2.0:1789431564.259706:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x511:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431564.259709:0:14490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb635268c0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x511:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.259807:0:14490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008edd2dd6/0xd8e438fb63524c7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x511:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8767 expref: 101 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.259819:0:14490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008edd2dd6/0xd8e438fb63524c7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x511:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8767 expref: 101 pid: 6698 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.259829:0:14490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:14490:1876351894224384:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.259855:0:14490:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38300 going to sleep for 11 seconds
00000100:00100000:2.0:1789431564.259877:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8281
00000100:00100000:2.0:1789431564.259885:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3313:x1876351894223488:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431564.259898:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1223 count 1
00010000:00010000:2.0:1789431564.259911:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb635268c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.259923:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb6351d27f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c620d expref: 101 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.259936:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4c7:0x0].0x0 since=22s v=(0 0)
00010000:00010000:2.0:1789431564.259939:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.259943:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb635268c7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.259963:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb6351d27f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c620d expref: 101 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.259972:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb6351d27f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c620d expref: 101 pid: 8217 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.259982:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1876351894224512:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.260007:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb389c0 going to sleep for 11 seconds
00000100:00100000:2.0:1789431564.260197:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000001:00080000:3.0:1789431564.260247:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121019 is committed
00000100:00100000:2.0:1789431564.260379:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933506688
00000100:00100000:2.0:1789431564.260386:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933506688
00000004:00080000:3.0:1789431564.260421:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 366 committed
00000100:00100000:2.0:1789431564.260433:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296069
00000100:00100000:2.0:1789431564.260440:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14616:x1876351933506688:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431564.260455:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00000004:00080000:3.0:1789431564.260464:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 367 committed
00010000:00010000:2.0:1789431564.260474:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635268ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8dc6 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789431564.260478:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121020 is committed
00000004:00080000:3.0:1789431564.260501:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 367 committed
00000004:00080000:3.0:1789431564.260521:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 368 committed
00010000:00010000:2.0:1789431564.260604:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635268d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.261129:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14617:x1876351933505152:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 83334us (83926us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.261139:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296064
00000100:00100000:1.0:1789431564.261384:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894224768:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.261436:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431564.261470:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894225280:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.261490:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431564.261512:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:1.0:1789431564.261517:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894224640:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.261537:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431564.261554:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894225152:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.261574:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431564.261604:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894224768
00000100:00100000:1.0:1789431564.261610:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894224768
00000100:00100000:3.0:1789431564.261626:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894225280
00000100:00100000:3.0:1789431564.261631:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894225280
00000100:00100000:1.0:1789431564.261661:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894224640
00000100:00100000:1.0:1789431564.261665:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894224640
00000100:00080000:0.0:1789431564.261826:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1789431564.262491:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352688f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dbf expref: 194 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.262504:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635268d5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.267915:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894225152
00000100:00100000:1.0:1789431564.267939:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894225152
00000100:00100000:1.0:1789431564.268013:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8282
00000100:00100000:1.0:1789431564.268027:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+8:3312:x1876351894224768:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431564.268091:0:14497:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1298 count 1
00010000:00010000:1.0:1789431564.268128:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000babb468b/0xd8e438fb635268dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x512:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.268156:0:14497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b5f4b29/0xd8e438fb63524ff3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x512:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87f3 expref: 99 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.268165:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x512:0x0].0x0 since=3s v=(0 0)
00010000:00010000:1.0:1789431564.268170:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x512:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.268176:0:14497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000babb468b/0xd8e438fb635268dc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x512:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.268223:0:14497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b5f4b29/0xd8e438fb63524ff3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x512:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87f3 expref: 99 pid: 14490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.268238:0:14497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b5f4b29/0xd8e438fb63524ff3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x512:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87f3 expref: 99 pid: 14490 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.268255:0:14497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:14497:1876351894225664:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.268373:0:14497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead3c0 going to sleep for 11 seconds
00000100:00080000:1.0:1789431564.268402:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1789431564.270173:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8283
00000100:00100000:2.0:1789431564.270206:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8284
00000100:00100000:2.0:1789431564.270226:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3312:x1876351894224640:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:2.0:1789431564.270275:0:6699:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1297 count 1
00010000:00010000:2.0:1789431564.270308:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fe21d5f/0xd8e438fb635268e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x511:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.270332:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c10f63cd/0xd8e438fb63524da0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x511:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87bb expref: 99 pid: 14472 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.270342:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x511:0x0].0x0 since=4s v=(0 0)
00010000:00010000:2.0:1789431564.270347:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x511:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431564.270351:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fe21d5f/0xd8e438fb635268e3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x511:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.270394:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c10f63cd/0xd8e438fb63524da0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x511:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87bb expref: 99 pid: 14472 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.270408:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c10f63cd/0xd8e438fb63524da0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x511:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87bb expref: 99 pid: 14472 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.270430:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6699:1876351894225792:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.270521:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38600 going to sleep for 11 seconds
00000100:00100000:2.0:1789431564.270545:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8285
00000100:00100000:2.0:1789431564.270554:0:14501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+8:3312:x1876351894225152:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:2.0:1789431564.270573:0:14501:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1190 count 1
00010000:00010000:2.0:1789431564.270589:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb635268ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.270614:0:14501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a7900d8/0xd8e438fb635140b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c330c expref: 99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.271114:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894225024:0@lo:6:osp-syn-1-0.0
00000100:00100000:3.0:1789431564.271178:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431564.271217:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894225536:0@lo:6:osp-syn-1-0.0
00000100:00100000:3.0:1789431564.271238:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431564.271276:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1789431564.271290:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894224896:0@lo:6:osp-syn-1-0.0
00000100:00100000:3.0:1789431564.271312:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431564.271330:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894225408:0@lo:6:osp-syn-1-0.0
00000100:00100000:3.0:1789431564.271350:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431564.271378:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894225024
00000100:00100000:3.0:1789431564.271387:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894225024
00000100:00100000:3.0:1789431564.271424:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894225536
00000100:00100000:3.0:1789431564.271427:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894225536
00000100:00100000:3.0:1789431564.271438:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894224896
00000100:00100000:3.0:1789431564.271441:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894224896
00000100:00100000:3.0:1789431564.271451:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894225408
00000100:00100000:3.0:1789431564.271453:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894225408
00000100:00100000:3.0:1789431564.271466:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8286
00000100:00100000:3.0:1789431564.271473:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3314:x1876351894225024:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:3.0:1789431564.271493:0:8217:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1300 count 1
00010000:00010000:3.0:1789431564.271513:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb635268f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x514:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.271530:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb635253b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x514:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8904 expref: 99 pid: 14471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.271538:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x514:0x0].0x0 since=3s v=(0 0)
00010000:00010000:3.0:1789431564.271542:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x514:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431564.271545:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb635268f1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x514:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.271546:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8287
00000100:00100000:0.0:1789431564.271557:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3314:x1876351894225536:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431564.271569:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1181 count 1
00010000:00010000:3.0:1789431564.271574:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb635253b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x514:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8904 expref: 99 pid: 14471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.271581:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635268f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.271586:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb635253b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x514:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8904 expref: 99 pid: 14471 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.271603:0:8217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8217:1876351894225920:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431564.271645:0:8217:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf377c6780 going to sleep for 11 seconds
00000100:00100000:3.0:1789431564.271664:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8288
00000100:00100000:3.0:1789431564.271671:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3314:x1876351894224896:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:3.0:1789431564.271685:0:14486:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1299 count 1
00010000:00010000:3.0:1789431564.271698:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd7dd64/0xd8e438fb635268ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x513:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.271711:0:14486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb635251f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x513:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8878 expref: 99 pid: 14505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.271744:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63511cb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c27f9 expref: 99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.271753:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x49d:0x0].0x0 since=52s v=(0 0)
00010000:00010000:0.0:1789431564.271757:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.271760:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635268f8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.271789:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63511cb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c27f9 expref: 99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.271799:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63511cb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c27f9 expref: 99 pid: 8217 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.271810:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce36219500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1876351894226048:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431564.271838:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf2ac35900 going to sleep for 11 seconds
00010000:00010000:2.0:1789431564.272006:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4a6:0x0].0x0 since=46s v=(0 0)
00010000:00010000:2.0:1789431564.272010:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.272015:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb635268ea lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.272038:0:14501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a7900d8/0xd8e438fb635140b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c330c expref: 99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.272063:0:14501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a7900d8/0xd8e438fb635140b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c330c expref: 99 pid: 14468 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.272074:0:14501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14501:1876351894226176:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.272112:0:14501:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38a80 going to sleep for 11 seconds
00000100:00100000:2.0:1789431564.272131:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8289
00000100:00100000:2.0:1789431564.272140:0:14502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+12:3314:x1876351894225408:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:2.0:1789431564.272154:0:14502:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1222 count 1
00010000:00010000:2.0:1789431564.272168:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b552df83/0xd8e438fb63526906 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.272181:0:14502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001aa9bc70/0xd8e438fb6351d1d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c61d5 expref: 99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.272187:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4c6:0x0].0x0 since=22s v=(0 0)
00010000:00010000:2.0:1789431564.272190:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.272194:0:14502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b552df83/0xd8e438fb63526906 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.272214:0:14502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001aa9bc70/0xd8e438fb6351d1d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c61d5 expref: 99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.272224:0:14502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001aa9bc70/0xd8e438fb6351d1d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c61d5 expref: 99 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.272234:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:14502:1876351894226304:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.272259:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38900 going to sleep for 11 seconds
00010000:00010000:3.0:1789431564.273389:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x513:0x0].0x0 since=3s v=(0 0)
00010000:00010000:3.0:1789431564.273403:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x513:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431564.273412:0:14486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bd7dd64/0xd8e438fb635268ff lrc: 4/0,1 mode: --/PW res: [0x280000400:0x513:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.273459:0:14486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb635251f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x513:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8878 expref: 99 pid: 14505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.273473:0:14486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb635251f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x513:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8878 expref: 99 pid: 14505 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.273489:0:14486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14486:1876351894226432:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431564.273546:0:14486:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1840 going to sleep for 11 seconds
00010000:00010000:3.0:1789431564.273607:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352688f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dbf expref: 194 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.273619:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352688f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dbf expref: 194 pid: 5849 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.273629:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894226560:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431564.273652:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1a878600 going to sleep for 11 seconds
00000100:00100000:1.0:1789431564.274772:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.274806:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.275125:0:14472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14472:1876351894223872:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431564.275169:0:14472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000078b22602/0xd8e438fb635268a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x50f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.275385:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.275408:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.275437:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933507456
00000100:00100000:1.0:1789431564.275445:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933507456
00010000:00010000:1.0:1789431564.275493:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008edd2dd6/0xd8e438fb63524c7a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x511:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8767 expref: 102 pid: 6698 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.275527:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933506944
00000100:00100000:1.0:1789431564.275530:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933506944
00010000:00010000:1.0:1789431564.275542:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb6352508d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x513:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8808 expref: 103 pid: 14500 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.275560:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933507200
00000100:00100000:1.0:1789431564.275563:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933507200
00010000:00010000:1.0:1789431564.275575:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63524b46 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x510:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8705 expref: 104 pid: 14469 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.275591:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933506816
00000100:00100000:1.0:1789431564.275593:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933506816
00010000:00010000:1.0:1789431564.275606:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f75eeb0/0xd8e438fb635249da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x50f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86a3 expref: 105 pid: 14490 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.275620:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16532
00000100:00100000:1.0:1789431564.275629:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+105:2349:x1876351933507456:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.275646:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.275652:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008edd2dd6/0xd8e438fb63524c7a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x511:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8767 expref: 105 pid: 6698 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.275670:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008edd2dd6/0xd8e438fb63524c7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x511:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8767 expref: 105 pid: 6698 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.275700:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x511:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.275705:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x511:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.275712:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb635268c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x511:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.275731:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb635268c0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x511:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.275756:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.275815:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+105:2349:x1876351933507456:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 187us (1053us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.275824:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16532
00000100:00100000:1.0:1789431564.275845:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16533
00000100:00100000:1.0:1789431564.275852:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+104:2347:x1876351933506944:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.275860:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.275865:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb6352508d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x513:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8808 expref: 104 pid: 14500 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.275874:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb6352508d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x513:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8808 expref: 104 pid: 14500 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.275892:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x513:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.275895:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x513:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.275899:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000677ed0fd/0xd8e438fb635268ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x513:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.275907:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000677ed0fd/0xd8e438fb635268ab lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x513:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.275919:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.275937:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+104:2347:x1876351933506944:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 86us (1130us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.275943:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16533
00000100:00100000:1.0:1789431564.275957:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16534
00000100:00100000:1.0:1789431564.275963:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+103:2347:x1876351933507200:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.275971:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.275976:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63524b46 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x510:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8705 expref: 103 pid: 14469 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.275986:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63524b46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x510:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8705 expref: 103 pid: 14469 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.275997:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x510:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.276000:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x510:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.276005:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095b38ee6/0xd8e438fb635268b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x510:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.276014:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095b38ee6/0xd8e438fb635268b2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x510:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.276026:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.276043:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+103:2347:x1876351933507200:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 80us (659us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.276073:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16534
00000100:00100000:1.0:1789431564.276087:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16535
00000100:00100000:1.0:1789431564.276094:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e951050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+102:2347:x1876351933506816:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.276102:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.276106:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f75eeb0/0xd8e438fb635249da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x50f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86a3 expref: 102 pid: 14490 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.276117:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f75eeb0/0xd8e438fb635249da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86a3 expref: 102 pid: 14490 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.276130:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f75eeb0/0xd8e438fb635249da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x50f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c86a3 expref: 102 pid: 14490 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.276146:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50f:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.276149:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50f:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.276153:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000078b22602/0xd8e438fb635268a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.276167:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078b22602/0xd8e438fb635268a4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x50f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.276186:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.276205:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e951050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+101:2347:x1876351933506816:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 110us (795us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.276212:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16535
00010000:00010000:3.0:1789431564.277129:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044a0d275/0xd8e438fb6352508d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x513:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8808 expref: 100 pid: 14500 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.277152:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14482:1876351894224000:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.277179:0:14482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000677ed0fd/0xd8e438fb635268ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.277191:0:14482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000677ed0fd/0xd8e438fb635268ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.277199:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000677ed0fd/0xd8e438fb635268ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.277278:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000677ed0fd/0xd8e438fb635268ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.277288:0:14482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000677ed0fd/0xd8e438fb635268ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.277312:0:14482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:1.0:1789431564.278440:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.278562:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.278596:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.278912:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933507072
00000100:00100000:0.0:1789431564.278924:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933507072
00010000:00010000:0.0:1789431564.278970:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000054447f51/0xd8e438fb635248ad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x50e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8648 expref: 100 pid: 14486 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.279004:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933507328
00000100:00100000:0.0:1789431564.279007:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933507328
00010000:00010000:0.0:1789431564.279022:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000020cafc2e/0xd8e438fb63524d99 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x512:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87b4 expref: 101 pid: 6700 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.279035:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933507584
00000100:00100000:1.0:1789431564.279155:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.279176:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933507712
00000100:00100000:1.0:1789431564.279181:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933507712
00010000:00010000:1.0:1789431564.279202:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb6351d27f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c620d expref: 102 pid: 8217 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.279222:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16536
00000100:00100000:1.0:1789431564.279233:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+102:2347:x1876351933507072:12345-192.168.203.4@tcp:103:ldlm_bl.0
00000100:00100000:0.0:1789431564.279337:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933507584
00010000:00010000:0.0:1789431564.279360:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb635252fc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x514:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88cc expref: 103 pid: 8217 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.279380:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16537
00000100:00100000:0.0:1789431564.279388:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+103:2347:x1876351933507328:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431564.279398:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:3.0:1789431564.279402:0:14482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3311:x1876351894223232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20252us (22251us total) trans 4294969618 rc 0/0
00010000:00010000:0.0:1789431564.279408:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000020cafc2e/0xd8e438fb63524d99 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x512:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87b4 expref: 103 pid: 6700 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.279417:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8277
00010000:00010000:0.0:1789431564.279430:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000020cafc2e/0xd8e438fb63524d99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x512:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87b4 expref: 103 pid: 6700 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.279462:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x512:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431564.279468:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x512:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431564.279475:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c00a3b55/0xd8e438fb6352689d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x512:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.279479:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431564.279491:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000677ed0fd/0xd8e438fb635268ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.279492:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c00a3b55/0xd8e438fb6352689d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x512:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.279513:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cbe00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431564.279521:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000677ed0fd/0xd8e438fb635268ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.279531:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431564.279534:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000677ed0fd/0xd8e438fb635268ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.279547:0:14471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14471:1876351894223616:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.279551:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000677ed0fd/0xd8e438fb635268ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.279562:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000677ed0fd/0xd8e438fb635268ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.279574:0:14471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e644db6f/0xd8e438fb63526896 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x50e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.279579:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+103:2347:x1876351933507328:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 192us (1016us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.279587:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16537
00010000:00010000:3.0:1789431564.279587:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.279592:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.279594:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431564.279607:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16538
00000100:00100000:0.0:1789431564.279615:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+102:2347:x1876351933507712:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431564.279626:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431564.279630:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb6351d27f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c620d expref: 102 pid: 8217 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.279640:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb6351d27f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c620d expref: 102 pid: 8217 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.279654:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.279657:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.279661:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb635268c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.279669:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb635268c7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.279682:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431564.279700:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+102:2347:x1876351933507712:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 87us (546us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.279707:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16538
00000100:00100000:2.0:1789431564.279736:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16539
00000100:00100000:2.0:1789431564.279745:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+101:2347:x1876351933507584:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.279749:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431564.279753:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.279755:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000054447f51/0xd8e438fb635248ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x50e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8648 expref: 101 pid: 14486 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.279757:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb635252fc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x514:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88cc expref: 101 pid: 8217 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.279768:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000054447f51/0xd8e438fb635248ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x50e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8648 expref: 101 pid: 14486 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.279768:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb635252fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x514:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88cc expref: 101 pid: 8217 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.279782:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x514:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431564.279785:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x514:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.279786:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054447f51/0xd8e438fb635248ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x50e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8648 expref: 101 pid: 14486 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.279790:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000009f3ab8f/0xd8e438fb635268b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x514:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.279797:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.279799:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431564.279799:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009f3ab8f/0xd8e438fb635268b9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x514:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.279804:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e644db6f/0xd8e438fb63526896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.279812:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e644db6f/0xd8e438fb63526896 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x50e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.279812:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431564.279829:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.279830:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+100:2347:x1876351933507584:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 87us (1234us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.279843:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+100:2347:x1876351933507072:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 613us (1412us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431564.281473:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969615 gen 2
00000004:00080000:3.0:1789431564.281512:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba1b100, transno 4294969584
00000004:00080000:3.0:1789431564.281538:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba18700, transno 4294969585
00000004:00080000:3.0:1789431564.281541:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba19f80, transno 4294969586
00000004:00080000:3.0:1789431564.281543:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba1a680, transno 4294969587
00000004:00080000:3.0:1789431564.281546:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba1bb80, transno 4294969588
00000004:00080000:3.0:1789431564.281549:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba1b800, transno 4294969589
00000004:00080000:3.0:1789431564.281553:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1ac76680, transno 4294969590
00000004:00080000:3.0:1789431564.281556:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba19180, transno 4294969591
00000004:00080000:3.0:1789431564.281559:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1c3e4700, transno 4294969592
00000004:00080000:3.0:1789431564.281575:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce3a045180, transno 4294969593
00000004:00080000:3.0:1789431564.281578:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce3a045c00, transno 4294969594
00000004:00080000:3.0:1789431564.281582:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1c3e5880, transno 4294969595
00000004:00080000:3.0:1789431564.281585:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1ac75180, transno 4294969596
00000004:00080000:3.0:1789431564.281588:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba1b480, transno 4294969597
00000004:00080000:3.0:1789431564.281591:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce156b1500, transno 4294969598
00000004:00080000:3.0:1789431564.281594:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce156b1880, transno 4294969599
00000004:00080000:3.0:1789431564.281598:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce156b0380, transno 4294969600
00000004:00080000:3.0:1789431564.281601:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce156b2680, transno 4294969601
00000004:00080000:3.0:1789431564.281603:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce156b2d80, transno 4294969602
00000004:00080000:3.0:1789431564.281607:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3bbf4380, transno 4294969603
00000004:00080000:3.0:1789431564.281610:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce156b2300, transno 4294969604
00000004:00080000:3.0:1789431564.281612:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce3a046d80, transno 4294969605
00000004:00080000:3.0:1789431564.282079:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce156b3b80, transno 4294969606
00000004:00080000:3.0:1789431564.282083:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2d509180, transno 4294969607
00000004:00080000:3.0:1789431564.282086:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1c3e4a80, transno 4294969608
00000004:00080000:3.0:1789431564.282089:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf37e90a80, transno 4294969609
00000004:00080000:3.0:1789431564.282093:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf37e93b80, transno 4294969610
00000004:00080000:3.0:1789431564.282097:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce029f4a80, transno 4294969611
00000004:00080000:3.0:1789431564.282100:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce029f6d80, transno 4294969612
00000004:00080000:3.0:1789431564.282103:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf37e90000, transno 4294969613
00000004:00080000:3.0:1789431564.282107:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2d50b480, transno 4294969614
00000004:00080000:3.0:1789431564.282110:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf37e94a80, transno 4294969615
00000100:00100000:3.0:1789431564.282122:0:3311:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search  req@ffff90cf3ba1a300 x1876351894223232/t4294969618(4294969618) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789431580 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295
00000004:00080000:3.0:1789431564.282139:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba1a300/2, rc 0, transno 4294969618
00000100:00100000:3.0:1789431564.282147:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894223232:0@lo:6:osp-syn-0-0.0
00010000:00010000:0.0:1789431564.282157:0:14472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000078b22602/0xd8e438fb635268a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.282175:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078b22602/0xd8e438fb635268a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.282189:0:14472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078b22602/0xd8e438fb635268a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.282199:0:14472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078b22602/0xd8e438fb635268a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.282231:0:14472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431564.282874:0:14472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3311:x1876351894222720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23794us (25769us total) trans 4294969619 rc 0/0
00000100:00100000:0.0:1789431564.282885:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8276
00010000:00010000:3.0:1789431564.283507:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431564.283518:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078b22602/0xd8e438fb635268a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.283531:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62cc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431564.283537:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b22602/0xd8e438fb635268a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.283549:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078b22602/0xd8e438fb635268a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.283576:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078b22602/0xd8e438fb635268a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.283585:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078b22602/0xd8e438fb635268a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.283611:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.283613:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.283615:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:3.0:1789431564.283670:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce35e45180/2, rc 0, transno 4294969619
00000100:00100000:3.0:1789431564.283679:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce35e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894222720:0@lo:6:osp-syn-0-0.0
00010000:00010000:0.0:1789431564.283805:0:14499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63524b46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x510:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8705 expref: 100 pid: 14469 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.283819:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:14499:1876351894224128:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431564.283846:0:14499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000095b38ee6/0xd8e438fb635268b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.283857:0:14499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000095b38ee6/0xd8e438fb635268b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.283865:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095b38ee6/0xd8e438fb635268b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.283876:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095b38ee6/0xd8e438fb635268b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.283884:0:14499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095b38ee6/0xd8e438fb635268b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.283914:0:14499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431564.284511:0:14499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+13:3313:x1876351894222848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25285us (27304us total) trans 4294969620 rc 0/0
00000100:00100000:0.0:1789431564.284521:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8278
00010000:00010000:0.0:1789431564.284575:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020cafc2e/0xd8e438fb63524d99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x512:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87b4 expref: 99 pid: 6700 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.284588:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14468:1876351894223744:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431564.284604:0:14468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c00a3b55/0xd8e438fb6352689d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.284613:0:14468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c00a3b55/0xd8e438fb6352689d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.284620:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c00a3b55/0xd8e438fb6352689d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.284629:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c00a3b55/0xd8e438fb6352689d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.284637:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c00a3b55/0xd8e438fb6352689d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.284654:0:14468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:0.0:1789431564.284939:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3311:x1876351894223104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26045us (27934us total) trans 4294969621 rc 0/0
00000100:00100000:0.0:1789431564.284946:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8275
00010000:00010000:0.0:1789431564.284967:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:0.0:1789431564.284974:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095b38ee6/0xd8e438fb635268b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.284983:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431564.284987:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095b38ee6/0xd8e438fb635268b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.284996:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095b38ee6/0xd8e438fb635268b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.285014:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095b38ee6/0xd8e438fb635268b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.285022:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095b38ee6/0xd8e438fb635268b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.285039:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431564.285043:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c00a3b55/0xd8e438fb6352689d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.285249:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:3.0:1789431564.285395:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce35e44000/2, rc 0, transno 4294969620
00000100:00100000:3.0:1789431564.285403:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce35e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894222848:0@lo:6:osp-syn-0-0.0
00000004:00080000:3.0:1789431564.285532:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba1aa00/2, rc 0, transno 4294969621
00000100:00100000:3.0:1789431564.285538:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894223104:0@lo:6:osp-syn-0-0.0
00010000:00010000:3.0:1789431564.286161:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb6351d27f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c620d expref: 98 pid: 8217 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.286180:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1876351894224512:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.286204:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb635268c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.286216:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb635268c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.286224:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb635268c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.286235:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb635268c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.286243:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb635268c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.286357:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431564.286362:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c00a3b55/0xd8e438fb6352689d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.286378:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c00a3b55/0xd8e438fb6352689d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.286396:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c00a3b55/0xd8e438fb6352689d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.286405:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c00a3b55/0xd8e438fb6352689d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.286425:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431564.286428:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431564.286430:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431564.286457:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008edd2dd6/0xd8e438fb63524c7a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x511:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8767 expref: 97 pid: 6698 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.286469:0:14490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:14490:1876351894224384:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431564.286486:0:14490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb635268c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.286495:0:14490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb635268c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.286502:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb635268c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.286516:0:14490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb635268c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.286523:0:14490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb635268c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.286547:0:14490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431564.287041:0:14490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3313:x1876351894222976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27484us (29496us total) trans 4294969622 rc 0/0
00000100:00100000:0.0:1789431564.287073:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8280
00000100:00100000:0.0:1789431564.287113:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3312:x1876351894225280:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431564.287156:0:14469:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1194 count 1
00010000:00010000:0.0:1789431564.287186:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb6352690d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.287207:0:14469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000def24b14/0xd8e438fb63514cd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c36e0 expref: 99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.287216:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4aa:0x0].0x0 since=44s v=(0 0)
00010000:00010000:0.0:1789431564.287221:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4aa:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.287227:0:14469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb6352690d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.287477:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:2.0:1789431564.287576:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16539
00000100:00100000:3.0:1789431564.287847:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3313:x1876351894223488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27961us (30263us total) trans 4294969623 rc 0/0
00000100:00100000:3.0:1789431564.287854:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8281
00010000:00010000:3.0:1789431564.287876:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:3.0:1789431564.287883:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb635268c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.287891:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62de00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431564.287894:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb635268c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.287904:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb635268c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.287922:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb635268c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.287930:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002d80445/0xd8e438fb635268c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.287950:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431564.287954:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb635268c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.287966:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62d000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431564.287969:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb635268c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.287976:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb635268c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.287986:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb635268c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.287992:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002796176a/0xd8e438fb635268c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.288006:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.288007:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.288009:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.288015:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:2.0:1789431564.288044:0:6793:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 29 changes, 8 in progress, 4 in flight, 32 done
00000004:00080000:3.0:1789431564.288074:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba18000/2, rc 0, transno 4294969622
00000100:00100000:3.0:1789431564.288081:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894222976:0@lo:6:osp-syn-0-0.0
00000004:00080000:3.0:1789431564.288093:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba19880/2, rc 0, transno 4294969623
00000100:00100000:3.0:1789431564.288096:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894223488:0@lo:6:osp-syn-0-0.0
00010000:00010000:3.0:1789431564.288127:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bad42b62/0xd8e438fb635252fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x514:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c88cc expref: 95 pid: 8217 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.288145:0:14491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:14491:1876351894224256:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.288165:0:14491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000009f3ab8f/0xd8e438fb635268b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.288174:0:14491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000009f3ab8f/0xd8e438fb635268b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.288177:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894227072:0@lo:6:osp-syn-0-0.0
00010000:00010000:3.0:1789431564.288182:0:14491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009f3ab8f/0xd8e438fb635268b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.288191:0:14491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009f3ab8f/0xd8e438fb635268b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.288198:0:14491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009f3ab8f/0xd8e438fb635268b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.288212:0:14491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1789431564.288220:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431564.288254:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1789431564.288260:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894226944:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431564.288287:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431564.288319:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894227072
00000100:00100000:2.0:1789431564.288326:0:14505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894227072
00000100:00100000:2.0:1789431564.288361:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894226944
00000100:00100000:2.0:1789431564.288364:0:14505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894226944
00000100:00100000:2.0:1789431564.288385:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8290
00000100:00100000:2.0:1789431564.288394:0:14505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+14:3314:x1876351894227072:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431564.288413:0:14505:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1229 count 1
00010000:00010000:2.0:1789431564.288432:0:14505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb63526914 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.288447:0:14505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003fb9a838/0xd8e438fb6351e0ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c665f expref: 94 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.288454:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4cd:0x0].0x0 since=20s v=(0 0)
00010000:00010000:2.0:1789431564.288458:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4cd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.288462:0:14505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb63526914 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.288485:0:14505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003fb9a838/0xd8e438fb6351e0ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c665f expref: 94 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.288498:0:14505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003fb9a838/0xd8e438fb6351e0ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c665f expref: 94 pid: 14490 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.288507:0:14491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+15:3313:x1876351894223360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29128us (31266us total) trans 4294969624 rc 0/0
00000100:00100000:2.0:1789431564.288510:0:14505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:14505:1876351894227456:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431564.288514:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8279
00000100:00100000:3.0:1789431564.288530:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8291
00000100:00100000:3.0:1789431564.288536:0:14491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+14:3314:x1876351894226944:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:3.0:1789431564.288547:0:14491:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1227 count 1
00010000:00010000:3.0:1789431564.288559:0:14491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a39309b/0xd8e438fb6352691b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.288571:0:14491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000011c52cfa/0xd8e438fb6351dcb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c651d expref: 94 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.288577:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4cb:0x0].0x0 since=20s v=(0 0)
00010000:00010000:3.0:1789431564.288580:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4cb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431564.288583:0:14491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a39309b/0xd8e438fb6352691b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.288586:0:14505:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38e40 going to sleep for 11 seconds
00010000:00010000:3.0:1789431564.288603:0:14491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000011c52cfa/0xd8e438fb6351dcb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c651d expref: 94 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.288613:0:14491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000011c52cfa/0xd8e438fb6351dcb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c651d expref: 94 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.288623:0:14491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:14491:1876351894227584:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431564.288646:0:14491:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf18a0bb40 going to sleep for 11 seconds
00010000:00010000:3.0:1789431564.288661:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431564.288666:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009f3ab8f/0xd8e438fb635268b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.288674:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62c200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431564.288678:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009f3ab8f/0xd8e438fb635268b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.288685:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009f3ab8f/0xd8e438fb635268b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.288698:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009f3ab8f/0xd8e438fb635268b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.288706:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009f3ab8f/0xd8e438fb635268b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.288735:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.288737:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.288739:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431564.289123:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16536
00010000:00010000:0.0:1789431564.289344:0:14469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000def24b14/0xd8e438fb63514cd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c36e0 expref: 99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.289366:0:14469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000def24b14/0xd8e438fb63514cd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c36e0 expref: 99 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.289380:0:14469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3621b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14469:1876351894227712:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431564.289417:0:14469:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf2ac35cc0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431564.289997:0:14497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:14497:1876351894225664:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.290022:0:14497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000babb468b/0xd8e438fb635268dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x512:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.290356:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.290395:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.290417:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.290453:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.290489:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.290509:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.290559:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.290577:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.290596:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.290622:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933507968
00000100:00100000:1.0:1789431564.290630:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933507968
00010000:00010000:1.0:1789431564.290674:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c10f63cd/0xd8e438fb63524da0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x511:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87bb expref: 100 pid: 14472 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.290698:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933508096
00000100:00100000:1.0:1789431564.290701:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933508096
00010000:00010000:1.0:1789431564.290714:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb635253b9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x514:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8904 expref: 101 pid: 14471 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.290746:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933507840
00000100:00100000:1.0:1789431564.290749:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933507840
00010000:00010000:1.0:1789431564.290762:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b5f4b29/0xd8e438fb63524ff3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x512:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87f3 expref: 102 pid: 14490 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.290773:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933508224
00000100:00100000:1.0:1789431564.290775:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933508224
00010000:00010000:1.0:1789431564.290786:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63511cb0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c27f9 expref: 103 pid: 8217 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.290796:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933508352
00000100:00100000:1.0:1789431564.290799:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933508352
00010000:00010000:1.0:1789431564.290809:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a7900d8/0xd8e438fb635140b3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c330c expref: 104 pid: 14468 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.290818:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933508480
00000100:00100000:1.0:1789431564.290820:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933508480
00010000:00010000:1.0:1789431564.290831:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001aa9bc70/0xd8e438fb6351d1d0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c61d5 expref: 105 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.290847:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933508608
00000100:00100000:1.0:1789431564.290849:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933508608
00010000:00010000:1.0:1789431564.290861:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb635251f9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x513:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8878 expref: 106 pid: 14505 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.290872:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933508736
00000100:00100000:1.0:1789431564.290874:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933508736
00010000:00010000:1.0:1789431564.290887:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352688f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dbf expref: 195 pid: 5849 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.290903:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16540
00000100:00100000:1.0:1789431564.290913:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+106:2347:x1876351933507968:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.290929:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.290935:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c10f63cd/0xd8e438fb63524da0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x511:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87bb expref: 106 pid: 14472 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.290949:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c10f63cd/0xd8e438fb63524da0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x511:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87bb expref: 106 pid: 14472 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.290976:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x511:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.290980:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x511:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.290987:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000fe21d5f/0xd8e438fb635268e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x511:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.290998:0:14506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fe21d5f/0xd8e438fb635268e3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x511:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291016:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.291088:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+106:2347:x1876351933507968:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 175us (732us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.291096:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16540
00000100:00100000:1.0:1789431564.291115:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16541
00000100:00100000:1.0:1789431564.291122:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+105:2347:x1876351933508096:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.291130:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.291135:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb635253b9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x514:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8904 expref: 105 pid: 14471 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291145:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb635253b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x514:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8904 expref: 105 pid: 14471 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291157:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x514:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.291160:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x514:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.291164:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb635268f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x514:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.291170:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c10f63cd/0xd8e438fb63524da0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x511:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87bb expref: 105 pid: 14472 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291171:0:14506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb635268f1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x514:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291184:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.291188:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6699:1876351894225792:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.291200:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+104:2347:x1876351933508096:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 80us (806us total) trans 0 rc 0/0
00010000:00010000:2.0:1789431564.291208:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000fe21d5f/0xd8e438fb635268e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.291209:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16541
00010000:00010000:2.0:1789431564.291218:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000fe21d5f/0xd8e438fb635268e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.291222:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16542
00010000:00010000:2.0:1789431564.291227:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fe21d5f/0xd8e438fb635268e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.291228:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e953c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+103:2348:x1876351933507840:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.291235:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431564.291239:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fe21d5f/0xd8e438fb635268e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291240:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b5f4b29/0xd8e438fb63524ff3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x512:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87f3 expref: 103 pid: 14490 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.291249:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fe21d5f/0xd8e438fb635268e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291251:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b5f4b29/0xd8e438fb63524ff3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x512:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87f3 expref: 103 pid: 14490 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291264:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b5f4b29/0xd8e438fb63524ff3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x512:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c87f3 expref: 103 pid: 14490 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.291270:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431564.291275:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x512:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.291277:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x512:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.291281:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000babb468b/0xd8e438fb635268dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x512:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291288:0:14506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000babb468b/0xd8e438fb635268dc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x512:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291304:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.291322:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e953c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+102:2348:x1876351933507840:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 95us (904us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.291328:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16542
00000100:00100000:1.0:1789431564.291363:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16543
00000100:00100000:1.0:1789431564.291369:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+101:2347:x1876351933508224:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.291376:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.291380:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63511cb0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c27f9 expref: 101 pid: 8217 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291389:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63511cb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c27f9 expref: 101 pid: 8217 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291401:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.291404:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.291408:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635268f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291415:0:14506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635268f8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291425:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.291441:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+101:2347:x1876351933508224:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 72us (988us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.291447:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16543
00000100:00100000:1.0:1789431564.291460:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16544
00000100:00100000:1.0:1789431564.291465:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+100:2347:x1876351933508352:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.291472:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.291476:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a7900d8/0xd8e438fb635140b3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c330c expref: 100 pid: 14468 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291491:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a7900d8/0xd8e438fb635140b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c330c expref: 100 pid: 14468 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291503:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.291506:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.291509:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb635268ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291516:0:14506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb635268ea lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291527:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.291543:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+100:2347:x1876351933508352:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 77us (1054us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.291549:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16544
00000100:00100000:1.0:1789431564.291560:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16545
00000100:00100000:1.0:1789431564.291565:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+99:2347:x1876351933508480:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.291572:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.291578:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001aa9bc70/0xd8e438fb6351d1d0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c61d5 expref: 99 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291587:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001aa9bc70/0xd8e438fb6351d1d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c61d5 expref: 99 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291604:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.291607:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.291611:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b552df83/0xd8e438fb63526906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291619:0:14506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b552df83/0xd8e438fb63526906 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291630:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.291647:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+99:2347:x1876351933508480:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 82us (1138us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.291653:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16545
00000100:00100000:1.0:1789431564.291667:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16546
00000100:00100000:1.0:1789431564.291673:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+98:2350:x1876351933508608:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.291681:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.291686:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb635251f9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x513:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8878 expref: 98 pid: 14505 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291697:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb635251f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x513:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8878 expref: 98 pid: 14505 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291709:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x513:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.291712:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x513:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.291716:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001bd7dd64/0xd8e438fb635268ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x513:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291737:0:14506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bd7dd64/0xd8e438fb635268ff lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x513:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291750:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.291768:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+98:2350:x1876351933508608:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 95us (1209us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.291775:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16546
00000100:00100000:1.0:1789431564.291789:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16547
00000100:00100000:1.0:1789431564.291797:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:2348:x1876351933508736:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.291805:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.291813:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352688f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dbf expref: 195 pid: 5849 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291824:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352688f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dbf expref: 195 pid: 5849 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291841:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:1.0:1789431564.291847:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635268d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291858:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635268d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291866:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635268d5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291884:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.291902:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:2348:x1876351933508736:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 106us (1324us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.291909:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16547
00010000:00010000:1.0:1789431564.291956:0:14497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000babb468b/0xd8e438fb635268dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291966:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000babb468b/0xd8e438fb635268dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291975:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000babb468b/0xd8e438fb635268dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.291983:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000babb468b/0xd8e438fb635268dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.292003:0:14497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:1.0:1789431564.292391:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+13:3312:x1876351894224768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24366us (30952us total) trans 4294970006 rc 0/0
00000100:00100000:1.0:1789431564.292401:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8282
00000100:00100000:1.0:1789431564.292417:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933508864
00000100:00100000:1.0:1789431564.292423:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933508864
00000100:00100000:1.0:1789431564.292459:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8292
00000100:00100000:1.0:1789431564.292466:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+98:2350:x1876351933508864:12345-192.168.203.4@tcp:16:dbench.0
00010000:00010000:1.0:1789431564.292531:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1789431564.292540:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fe21d5f/0xd8e438fb635268e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.292550:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e1800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.292556:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fe21d5f/0xd8e438fb635268e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.292567:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fe21d5f/0xd8e438fb635268e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.292582:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fe21d5f/0xd8e438fb635268e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.292590:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fe21d5f/0xd8e438fb635268e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.292611:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.292615:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000babb468b/0xd8e438fb635268dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.292621:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.292625:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000babb468b/0xd8e438fb635268dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.292631:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000babb468b/0xd8e438fb635268dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.292647:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000babb468b/0xd8e438fb635268dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.292655:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000babb468b/0xd8e438fb635268dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.292669:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.292672:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.292673:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.292713:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb6352688f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dbf expref: 194 pid: 5849 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.292740:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894226560:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.292761:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635268d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.292768:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635268d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.292773:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635268d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431564.292794:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008f:0x0]: returning size 260096
00000100:00100000:2.0:1789431564.292927:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3312:x1876351894224640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22713us (31387us total) trans 4294970007 rc 0/0
00000100:00100000:2.0:1789431564.292934:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8284
00010000:00010000:1.0:1789431564.292938:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0000/0xd8e438fb635268ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dc6 expref: 195 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.292954:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635268d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dc6 expref: 194 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.292962:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:1.0:1789431564.292965:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431564.292968:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce156e0200, rc 0)
00010000:00010000:2.0:1789431564.292973:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001aa9bc70/0xd8e438fb6351d1d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c61d5 expref: 98 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.292989:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+194:14616:x1876351933506688:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 32550us (32794us total) trans 4295121024 rc 0/0
00000100:00100000:2.0:1789431564.292990:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:14502:1876351894226304:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.292996:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296069
00010000:00010000:2.0:1789431564.293005:0:14502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b552df83/0xd8e438fb63526906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.293013:0:14502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b552df83/0xd8e438fb63526906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.293020:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b552df83/0xd8e438fb63526906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.293029:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b552df83/0xd8e438fb63526906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.293037:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b552df83/0xd8e438fb63526906 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.293077:0:14502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1789431564.293376:0:14502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+13:3314:x1876351894225408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21237us (22023us total) trans 4294970008 rc 0/0
00000100:00100000:2.0:1789431564.293384:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8289
00010000:00010000:1.0:1789431564.293675:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.293683:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b552df83/0xd8e438fb63526906 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.293694:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00030e00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.293698:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b552df83/0xd8e438fb63526906 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.293708:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b552df83/0xd8e438fb63526906 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00080000:2.0:1789431564.294216:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf37e3f800/2, rc 0, transno 4294970008
00000100:00100000:2.0:1789431564.294237:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894225408:0@lo:6:osp-syn-1-0.0
00010000:00010000:3.0:1789431564.294619:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b9f3956/0xd8e438fb635251f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x513:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8878 expref: 97 pid: 14505 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.294638:0:14486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14486:1876351894226432:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.294659:0:14486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001bd7dd64/0xd8e438fb635268ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.294670:0:14486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001bd7dd64/0xd8e438fb635268ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.294677:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bd7dd64/0xd8e438fb635268ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.294690:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd7dd64/0xd8e438fb635268ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.294699:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bd7dd64/0xd8e438fb635268ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.294717:0:14486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1789431564.294822:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1789431564.294839:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894227840:0@lo:6:osp-syn-1-0.0
00000100:00100000:2.0:1789431564.294903:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431564.296352:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3314:x1876351894224896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24672us (25028us total) trans 4294970009 rc 0/0
00000100:00100000:3.0:1789431564.296365:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8288
00000100:00100000:3.0:1789431564.296400:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894227840
00000100:00100000:3.0:1789431564.296410:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894227840
00000100:00100000:3.0:1789431564.296458:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8293
00000100:00100000:3.0:1789431564.296468:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3314:x1876351894227840:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:3.0:1789431564.296501:0:14486:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1187 count 1
00010000:00010000:3.0:1789431564.296531:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082fb03c4/0xd8e438fb63526929 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.296557:0:14486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091283423/0xd8e438fb63513338 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2ed6 expref: 96 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.296568:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4a3:0x0].0x0 since=48s v=(0 0)
00010000:00010000:3.0:1789431564.296574:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431564.296579:0:14486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082fb03c4/0xd8e438fb63526929 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.296624:0:14486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091283423/0xd8e438fb63513338 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2ed6 expref: 96 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.296640:0:14486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091283423/0xd8e438fb63513338 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2ed6 expref: 96 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.296654:0:14486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14486:1876351894227968:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431564.296727:0:14486:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2b7c1840 going to sleep for 11 seconds
00010000:00010000:1.0:1789431564.296838:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b552df83/0xd8e438fb63526906 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.296849:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b552df83/0xd8e438fb63526906 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.297166:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.297201:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.297294:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.297383:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933508992
00000100:00100000:1.0:1789431564.297389:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933508992
00010000:00010000:1.0:1789431564.297421:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003fb9a838/0xd8e438fb6351e0ef lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c665f expref: 94 pid: 14490 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.297446:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933509120
00000100:00100000:1.0:1789431564.297449:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933509120
00010000:00010000:1.0:1789431564.297464:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000011c52cfa/0xd8e438fb6351dcb9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c651d expref: 95 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.297480:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933509248
00000100:00100000:1.0:1789431564.297482:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933509248
00010000:00010000:1.0:1789431564.297495:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000def24b14/0xd8e438fb63514cd7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c36e0 expref: 97 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.297516:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16548
00000100:00100000:1.0:1789431564.297524:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+95:2348:x1876351933508992:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.297536:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.297543:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003fb9a838/0xd8e438fb6351e0ef lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c665f expref: 95 pid: 14490 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.297556:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003fb9a838/0xd8e438fb6351e0ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c665f expref: 95 pid: 14490 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.297578:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4cd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.297582:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4cd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.297589:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb63526914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.297600:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb63526914 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.297618:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.297654:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+95:2348:x1876351933508992:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 130us (488us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.297661:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16548
00000100:00100000:1.0:1789431564.297678:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16549
00000100:00100000:1.0:1789431564.297685:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e953050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+94:2347:x1876351933509120:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.297695:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.297700:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000011c52cfa/0xd8e438fb6351dcb9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c651d expref: 94 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.297709:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000011c52cfa/0xd8e438fb6351dcb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c651d expref: 94 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.298000:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894226816:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431564.298064:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431564.298091:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894227328:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431564.298112:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000004:00080000:3.0:1789431564.298156:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce156b1f80/2, rc 0, transno 4294970007
00000100:00100000:3.0:1789431564.298169:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894224640:0@lo:6:osp-syn-1-0.0
00000004:00080000:3.0:1789431564.298182:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce156b0700/2, rc 0, transno 4294970006
00000100:00100000:3.0:1789431564.298186:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894224768:0@lo:6:osp-syn-1-0.0
00000100:00100000:3.0:1789431564.298199:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1789431564.298205:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894226688:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431564.298229:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431564.298247:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894227200:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431564.298268:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1789431564.298494:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4cb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.298499:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4cb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.298505:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a39309b/0xd8e438fb6352691b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.298517:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a39309b/0xd8e438fb6352691b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.298532:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.298563:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e953050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+94:2347:x1876351933509120:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 877us (1360us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.298572:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16549
00000100:00100000:1.0:1789431564.298621:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16550
00000100:00100000:1.0:1789431564.298631:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+97:2348:x1876351933509248:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.298644:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.298650:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000def24b14/0xd8e438fb63514cd7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c36e0 expref: 97 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.298662:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000def24b14/0xd8e438fb63514cd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c36e0 expref: 97 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.298679:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4aa:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.298682:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4aa:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.298686:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb6352690d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.298694:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb6352690d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.298707:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.299003:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+97:2348:x1876351933509248:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 107us (1454us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.299012:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16550
00000100:00100000:1.0:1789431564.299044:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894226816
00000100:00100000:1.0:1789431564.299067:0:14499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894226816
00000100:00100000:1.0:1789431564.299100:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894227328
00000100:00100000:1.0:1789431564.299104:0:14499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894227328
00000100:00100000:1.0:1789431564.299114:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894226688
00000100:00100000:1.0:1789431564.299116:0:14499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894226688
00000100:00100000:1.0:1789431564.299124:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894227200
00000100:00100000:1.0:1789431564.299126:0:14499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894227200
00000100:00100000:1.0:1789431564.299136:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8294
00000100:00100000:1.0:1789431564.299141:0:14499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+18:3312:x1876351894226816:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:1.0:1789431564.299169:0:14499:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1221 count 1
00010000:00010000:1.0:1789431564.299197:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f94645f/0xd8e438fb63526930 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.299213:0:14499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000005adae1/0xd8e438fb6351d06b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6157 expref: 93 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.299221:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4c5:0x0].0x0 since=23s v=(0 0)
00010000:00010000:1.0:1789431564.299225:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.299229:0:14499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f94645f/0xd8e438fb63526930 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.299352:0:14499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000005adae1/0xd8e438fb6351d06b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6157 expref: 93 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.299367:0:14499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000005adae1/0xd8e438fb6351d06b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6157 expref: 93 pid: 6699 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.299381:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:14499:1876351894228096:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.299436:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead0c0 going to sleep for 11 seconds
00010000:00010000:0.0:1789431564.300599:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082d40a47/0xd8e438fb635253b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x514:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8904 expref: 96 pid: 14471 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.300625:0:8217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8217:1876351894225920:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431564.300652:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb635268f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.300663:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb635268f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.300671:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb635268f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.300684:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb635268f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.300692:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb635268f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.300732:0:8217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:1.0:1789431564.300871:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1789431564.300881:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bd7dd64/0xd8e438fb635268ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.300891:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035ca800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.300896:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd7dd64/0xd8e438fb635268ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.300908:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd7dd64/0xd8e438fb635268ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.300932:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bd7dd64/0xd8e438fb635268ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.300941:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bd7dd64/0xd8e438fb635268ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.300965:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.300969:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb635268f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.300976:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.300980:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb635268f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.300988:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb635268f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.301005:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb635268f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.301013:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000672ec75f/0xd8e438fb635268f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.301030:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.301032:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.301034:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:2.0:1789431564.301473:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce156b0a80/2, rc 0, transno 4294970009
00000100:00100000:2.0:1789431564.301484:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894224896:0@lo:6:osp-syn-1-0.0
00010000:00010000:1.0:1789431564.302389:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.302394:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.302396:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.304118:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.304163:0:14471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e644db6f/0xd8e438fb63526896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.304184:0:14471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e644db6f/0xd8e438fb63526896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.304199:0:14471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e644db6f/0xd8e438fb63526896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.304209:0:14471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e644db6f/0xd8e438fb63526896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.304237:0:14471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000004:00080000:1.0:1789431564.306036:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba19c00/2, rc 0, transno 4294969624
00000100:00100000:1.0:1789431564.306075:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894223360:0@lo:6:osp-syn-0-0.0
00010000:00010000:1.0:1789431564.306114:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.306125:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e644db6f/0xd8e438fb63526896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.306139:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3b62dc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.306144:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e644db6f/0xd8e438fb63526896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.306156:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e644db6f/0xd8e438fb63526896 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.306180:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e644db6f/0xd8e438fb63526896 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.306189:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e644db6f/0xd8e438fb63526896 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.306222:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.306224:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.306225:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.306233:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.306268:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63511cb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c27f9 expref: 95 pid: 8217 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.306284:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce36219500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1876351894226048:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.306310:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635268f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.306323:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635268f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.306330:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635268f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.306340:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635268f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.306348:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635268f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.306377:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:1.0:1789431564.306971:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3314:x1876351894225536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 35414us (35727us total) trans 4294970011 rc 0/0
00000100:00100000:1.0:1789431564.306984:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8287
00000100:00100000:1.0:1789431564.307026:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8295
00000100:00100000:1.0:1789431564.307040:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3312:x1876351894227328:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:1.0:1789431564.307110:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1197 count 1
00010000:00010000:1.0:1789431564.307140:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa6bbca6/0xd8e438fb63526937 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.307163:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6bbf184/0xd8e438fb63515543 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c396b expref: 93 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.307174:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4ad:0x0].0x0 since=43s v=(0 0)
00010000:00010000:1.0:1789431564.307179:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ad:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.307185:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6bbca6/0xd8e438fb63526937 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.307232:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6bbf184/0xd8e438fb63515543 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c396b expref: 93 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.307248:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6bbf184/0xd8e438fb63515543 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c396b expref: 93 pid: 14471 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.307265:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1876351894228224:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.307370:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead900 going to sleep for 11 seconds
00000004:00080000:1.0:1789431564.307423:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf37e3c380/2, rc 0, transno 4294970011
00000100:00100000:1.0:1789431564.307432:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894225536:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.307509:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1789431564.307525:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894228352:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431564.307564:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431564.307768:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894228352
00000100:00100000:1.0:1789431564.307777:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894228352
00000100:00100000:1.0:1789431564.307817:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8296
00000100:00100000:1.0:1789431564.307826:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3312:x1876351894226688:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:1.0:1789431564.307845:0:14468:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1218 count 1
00010000:00010000:1.0:1789431564.307861:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e09e4ac4/0xd8e438fb6352693e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.307876:0:14468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094865098/0xd8e438fb6351ca21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c5f7b expref: 93 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.307885:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4c2:0x0].0x0 since=24s v=(0 0)
00010000:00010000:1.0:1789431564.307889:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.307893:0:14468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e09e4ac4/0xd8e438fb6352693e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.307914:0:14468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094865098/0xd8e438fb6351ca21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c5f7b expref: 93 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.307926:0:14468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094865098/0xd8e438fb6351ca21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c5f7b expref: 93 pid: 14472 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.307944:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14468:1876351894228480:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.307979:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead300 going to sleep for 11 seconds
00010000:00010000:1.0:1789431564.308013:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.308021:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635268f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.308031:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ace00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.308036:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635268f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.308073:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635268f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.308098:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635268f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.308106:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635268f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.308130:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.308132:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.308133:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431564.308607:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3311:x1876351894222592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50182us (51983us total) trans 4294969625 rc 0/0
00000100:00100000:3.0:1789431564.308621:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8274
00000100:00100000:3.0:1789431564.308651:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8297
00000100:00100000:3.0:1789431564.308661:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3312:x1876351894227200:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:3.0:1789431564.308681:0:14471:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1193 count 1
00010000:00010000:3.0:1789431564.308697:0:14471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63526945 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.308711:0:14471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0aab669/0xd8e438fb6351482a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c356d expref: 93 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.308731:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4a9:0x0].0x0 since=45s v=(0 0)
00010000:00010000:3.0:1789431564.308786:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431564.308792:0:14471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63526945 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.308820:0:14471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e0aab669/0xd8e438fb6351482a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c356d expref: 93 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.308833:0:14471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e0aab669/0xd8e438fb6351482a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c356d expref: 93 pid: 6699 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.308845:0:14471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14471:1876351894228608:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431564.308895:0:14471:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf14143000 going to sleep for 11 seconds
00010000:00010000:3.0:1789431564.308937:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011c52cfa/0xd8e438fb6351dcb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c651d expref: 93 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.308949:0:14491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:14491:1876351894227584:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.308969:0:14491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a39309b/0xd8e438fb6352691b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.308979:0:14491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a39309b/0xd8e438fb6352691b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.308987:0:14491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a39309b/0xd8e438fb6352691b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.308998:0:14491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a39309b/0xd8e438fb6352691b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.309012:0:14491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a39309b/0xd8e438fb6352691b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.309031:0:14491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1789431564.309160:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8298
00000100:00100000:2.0:1789431564.309171:0:14482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3313:x1876351894228352:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431564.309186:0:14482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1258 count 1
00010000:00010000:2.0:1789431564.309202:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6fb0e20/0xd8e438fb6352694c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.309214:0:14482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a8425f1/0xd8e438fb6352149d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c76e3 expref: 92 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.309221:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4ea:0x0].0x0 since=11s v=(0 0)
00010000:00010000:2.0:1789431564.309224:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ea:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.309227:0:14482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6fb0e20/0xd8e438fb6352694c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.309247:0:14482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a8425f1/0xd8e438fb6352149d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c76e3 expref: 92 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.309529:0:14491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+20:3314:x1876351894226944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20992us (21246us total) trans 4294969626 rc 0/0
00000100:00100000:3.0:1789431564.309537:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8291
00010000:00010000:3.0:1789431564.309561:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431564.309568:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a39309b/0xd8e438fb6352691b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.309577:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cba00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431564.309581:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a39309b/0xd8e438fb6352691b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.309590:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a39309b/0xd8e438fb6352691b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.309607:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a39309b/0xd8e438fb6352691b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.309614:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a39309b/0xd8e438fb6352691b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.309630:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.309633:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.309634:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:1.0:1789431564.310005:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce20fd4700/2, rc 0, transno 4294969626
00000100:00100000:1.0:1789431564.310022:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894226944:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431564.310109:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1789431564.310125:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894228864:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431564.310173:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000004:00080000:1.0:1789431564.310219:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce35e44a80/2, rc 0, transno 4294969625
00000100:00100000:1.0:1789431564.310228:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce35e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894222592:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431564.310450:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3314:x1876351894225024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 38973us (39269us total) trans 4294970010 rc 0/0
00000100:00100000:0.0:1789431564.310462:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8286
00000100:00100000:0.0:1789431564.310485:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894228864
00000100:00100000:0.0:1789431564.310492:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894228864
00000100:00100000:1.0:1789431564.310806:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894228992:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431564.310838:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000004:00080000:1.0:1789431564.310923:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf37e3fb80/2, rc 0, transno 4294970010
00000100:00100000:1.0:1789431564.310930:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894225024:0@lo:6:osp-syn-1-0.0
00010000:00010000:2.0:1789431564.311019:0:14482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a8425f1/0xd8e438fb6352149d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c76e3 expref: 92 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.311037:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14482:1876351894228736:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.311115:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb383c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431564.311181:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894228992
00000100:00100000:0.0:1789431564.311187:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894228992
00000100:00100000:2.0:1789431564.311208:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8299
00000100:00100000:0.0:1789431564.311216:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8300
00000100:00100000:2.0:1789431564.311217:0:14502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+21:3312:x1876351894228864:12345-0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431564.311221:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3312:x1876351894228992:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431564.311245:0:8217:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1225 count 1
00002000:00080000:2.0:1789431564.311245:0:14502:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1224 count 1
00010000:00010000:0.0:1789431564.311271:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd11ad65/0xd8e438fb6352695a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.311272:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000709cba9d/0xd8e438fb63526953 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.311290:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6351d772 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6379 expref: 92 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.311290:0:14502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008a1ccd97/0xd8e438fb6351d534 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c62ca expref: 92 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.311300:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4c9:0x0].0x0 since=21s v=(0 0)
00010000:00010000:2.0:1789431564.311300:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4c8:0x0].0x0 since=22s v=(0 0)
00010000:00010000:0.0:1789431564.311305:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.311305:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.311311:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd11ad65/0xd8e438fb6352695a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.311311:0:14502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000709cba9d/0xd8e438fb63526953 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.311336:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6351d772 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6379 expref: 92 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.311336:0:14502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008a1ccd97/0xd8e438fb6351d534 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c62ca expref: 92 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.311348:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6351d772 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6379 expref: 92 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.311348:0:14502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008a1ccd97/0xd8e438fb6351d534 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c62ca expref: 92 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.311359:0:8217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3621aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8217:1876351894229888:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.311359:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:14502:1876351894229760:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431564.311388:0:8217:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf2ac35600 going to sleep for 11 seconds
00010000:00010000:0.0:1789431564.311438:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000def24b14/0xd8e438fb63514cd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c36e0 expref: 94 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.311454:0:14469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3621b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14469:1876351894227712:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431564.311475:0:14469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb6352690d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.311486:0:14469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb6352690d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.311494:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb6352690d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.311506:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb6352690d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.311515:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb6352690d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.311536:0:14469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431564.312277:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.312286:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb6352690d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.312298:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.312302:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb6352690d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.312314:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb6352690d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.312336:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb6352690d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.312344:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb6352690d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.312371:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.312373:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.312375:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431564.312394:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894229504:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.312445:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431564.312489:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1789431564.312495:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894229376:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.312520:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431564.312549:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894229120:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.312572:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431564.312582:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894229632:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.312599:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431564.312612:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1789431564.312617:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894229248:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.312636:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431564.312670:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38900 going to sleep for 11 seconds
00000100:00100000:1.0:1789431564.312674:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894229504
00000100:00100000:1.0:1789431564.312681:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894229504
00000100:00100000:1.0:1789431564.312711:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894229376
00000100:00100000:1.0:1789431564.312713:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894229376
00010000:00010000:2.0:1789431564.312750:0:14505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fb9a838/0xd8e438fb6351e0ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c665f expref: 92 pid: 14490 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.312764:0:14505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:14505:1876351894227456:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431564.312785:0:14505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb63526914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.312795:0:14505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb63526914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.312803:0:14505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb63526914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.312813:0:14505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb63526914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.312821:0:14505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb63526914 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.312840:0:14505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431564.312985:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3312:x1876351894225280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 42797us (51491us total) trans 4294970012 rc 0/0
00000100:00100000:0.0:1789431564.312997:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8283
00000100:00100000:0.0:1789431564.313017:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894229120
00000100:00100000:0.0:1789431564.313021:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894229120
00000100:00100000:0.0:1789431564.313034:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894229632
00000100:00100000:0.0:1789431564.313037:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894229632
00000100:00100000:0.0:1789431564.313046:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894229248
00000100:00100000:0.0:1789431564.313069:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894229248
00000100:00100000:0.0:1789431564.313085:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8301
00000100:00100000:0.0:1789431564.313092:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3312:x1876351894229504:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431564.313122:0:14469:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1255 count 1
00010000:00010000:0.0:1789431564.313143:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63526961 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.313159:0:14469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007955e986/0xd8e438fb63520d9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c74a5 expref: 93 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.313168:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4e7:0x0].0x0 since=12s v=(0 0)
00010000:00010000:0.0:1789431564.313172:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.313176:0:14469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63526961 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.313208:0:14469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007955e986/0xd8e438fb63520d9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c74a5 expref: 93 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.313220:0:14469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007955e986/0xd8e438fb63520d9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c74a5 expref: 93 pid: 14482 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.313236:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+22:3314:x1876351894227072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24843us (25015us total) trans 4294969627 rc 0/0
00000100:00100000:0.0:1789431564.313240:0:14469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3621b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14469:1876351894230016:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.313244:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8290
00000100:00100000:2.0:1789431564.313262:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8302
00000100:00100000:2.0:1789431564.313269:0:14505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+18:3312:x1876351894229376:12345-0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431564.313352:0:14469:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf2ac35900 going to sleep for 11 seconds
00000100:00100000:1.0:1789431564.313421:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8303
00000100:00100000:1.0:1789431564.313430:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3313:x1876351894229120:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431564.313443:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1225 count 1
00010000:00010000:1.0:1789431564.313457:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab95b4b2/0xd8e438fb63526968 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.313472:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000755738c5/0xd8e438fb6351d87c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c63d4 expref: 93 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.313484:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4c9:0x0].0x0 since=21s v=(0 0)
00010000:00010000:1.0:1789431564.313487:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.313491:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab95b4b2/0xd8e438fb63526968 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.313512:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000755738c5/0xd8e438fb6351d87c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c63d4 expref: 93 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.313522:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000755738c5/0xd8e438fb6351d87c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c63d4 expref: 93 pid: 14502 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.313532:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce35e44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1876351894230144:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.313558:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead840 going to sleep for 11 seconds
00000004:00080000:1.0:1789431564.313594:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf37e3f480/2, rc 0, transno 4294970012
00000100:00100000:1.0:1789431564.313616:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894225280:0@lo:6:osp-syn-1-0.0
00010000:00010000:1.0:1789431564.313632:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.313638:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb63526914 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.313647:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01520200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.313651:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb63526914 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.313660:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb63526914 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.313678:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb63526914 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.313690:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb63526914 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.313712:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.313714:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.313716:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431564.313898:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce36219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894230272:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.313933:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000004:00080000:1.0:1789431564.313960:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce20fd7480/2, rc 0, transno 4294969627
00000100:00100000:1.0:1789431564.313980:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894227072:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431564.314010:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894230272
00000100:00100000:1.0:1789431564.314015:0:14472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894230272
00000100:00100000:1.0:1789431564.314039:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8304
00000100:00100000:1.0:1789431564.314070:0:14472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3313:x1876351894229632:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431564.314087:0:14472:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1259 count 1
00010000:00010000:1.0:1789431564.314103:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb6352696f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.314117:0:14472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c27b3433/0xd8e438fb635219b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7887 expref: 93 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.314125:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4eb:0x0].0x0 since=10s v=(0 0)
00010000:00010000:1.0:1789431564.314129:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4eb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.314132:0:14472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb6352696f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.314155:0:14472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c27b3433/0xd8e438fb635219b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7887 expref: 93 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.314166:0:14472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c27b3433/0xd8e438fb635219b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7887 expref: 93 pid: 14505 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.314177:0:14472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14472:1876351894230400:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.314204:0:14472:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05eadc00 going to sleep for 11 seconds
00000100:00100000:1.0:1789431564.314220:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8305
00000100:00100000:1.0:1789431564.314229:0:14491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+19:3313:x1876351894229248:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431564.314242:0:14491:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1220 count 1
00000100:00100000:3.0:1789431564.314454:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8306
00000100:00100000:3.0:1789431564.314465:0:14490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3314:x1876351894230272:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:3.0:1789431564.314478:0:14490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1229 count 1
00010000:00010000:3.0:1789431564.314492:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ff37435/0xd8e438fb63526976 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.314506:0:14490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097a080c3/0xd8e438fb6351e2c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6700 expref: 93 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.314514:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4cd:0x0].0x0 since=20s v=(0 0)
00010000:00010000:3.0:1789431564.314517:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4cd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431564.314521:0:14490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ff37435/0xd8e438fb63526976 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.314543:0:14490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097a080c3/0xd8e438fb6351e2c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6700 expref: 93 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.314554:0:14490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097a080c3/0xd8e438fb6351e2c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6700 expref: 93 pid: 14468 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.314564:0:14490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14490:1876351894230656:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431564.314592:0:14490:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf066aacc0 going to sleep for 11 seconds
00002000:00080000:2.0:1789431564.314647:0:14505:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1260 count 1
00010000:00010000:2.0:1789431564.314663:0:14505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e9b5c43/0xd8e438fb6352697d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.314676:0:14505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab5444e4/0xd8e438fb63521d3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79ad expref: 93 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.314685:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4ec:0x0].0x0 since=10s v=(0 0)
00010000:00010000:2.0:1789431564.314688:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ec:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.314692:0:14505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e9b5c43/0xd8e438fb6352697d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.314712:0:14505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ab5444e4/0xd8e438fb63521d3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79ad expref: 93 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.314733:0:14505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ab5444e4/0xd8e438fb63521d3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79ad expref: 93 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.314742:0:14505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:14505:1876351894230784:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.314783:0:14505:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38240 going to sleep for 11 seconds
00010000:00010000:2.0:1789431564.314815:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a7900d8/0xd8e438fb635140b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c330c expref: 93 pid: 14468 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.314816:0:14491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000396dbf81/0xd8e438fb63526984 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.314829:0:14491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d06b4e68/0xd8e438fb6351d064 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6150 expref: 92 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.314829:0:14501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14501:1876351894226176:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.314836:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4c4:0x0].0x0 since=23s v=(0 0)
00010000:00010000:1.0:1789431564.314839:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.314842:0:14491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000396dbf81/0xd8e438fb63526984 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.314847:0:14501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb635268ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.314857:0:14501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb635268ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.314862:0:14491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d06b4e68/0xd8e438fb6351d064 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6150 expref: 92 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.314865:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb635268ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.314872:0:14491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d06b4e68/0xd8e438fb6351d064 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6150 expref: 92 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.314877:0:14501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb635268ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.314881:0:14491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3bbf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14491:1876351894230912:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431564.314886:0:14501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb635268ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.314903:0:14491:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ac1ff00 going to sleep for 11 seconds
00010000:00010000:2.0:1789431564.314914:0:14501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:1.0:1789431564.314922:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1789431564.314931:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce36218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894230528:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431564.314965:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:0.0:1789431564.315028:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431564.315035:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb635268ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.315043:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00031400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431564.315067:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb635268ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.315077:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb635268ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.315094:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb635268ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.315101:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f84e050/0xd8e438fb635268ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.315121:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431564.315123:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431564.315124:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431564.316232:0:14486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14486:1876351894227968:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.316327:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+20:3312:x1876351894225152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 45773us (54750us total) trans 4294970013 rc 0/0
00000100:00100000:0.0:1789431564.316336:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.316338:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8285
00000100:00100000:2.0:1789431564.316366:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894230528
00000100:00100000:0.0:1789431564.316370:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.316374:0:14501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894230528
00000100:00100000:0.0:1789431564.316386:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.316401:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.316406:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8307
00000100:00100000:2.0:1789431564.316414:0:14501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+22:3312:x1876351894230528:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431564.316444:0:14501:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1233 count 1
00010000:00010000:2.0:1789431564.316467:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f99604/0xd8e438fb6352698b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.316487:0:14501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007b412f85/0xd8e438fb6351ea03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c694c expref: 91 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.316496:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4d1:0x0].0x0 since=18s v=(0 0)
00010000:00010000:2.0:1789431564.316500:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.316505:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003f99604/0xd8e438fb6352698b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.316508:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933509504
00000100:00100000:1.0:1789431564.316512:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933509504
00010000:00010000:1.0:1789431564.316540:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000005adae1/0xd8e438fb6351d06b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6157 expref: 92 pid: 6699 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.316542:0:14501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007b412f85/0xd8e438fb6351ea03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c694c expref: 92 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.316557:0:14501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007b412f85/0xd8e438fb6351ea03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c694c expref: 92 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.316570:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933509632
00000100:00100000:2.0:1789431564.316572:0:14501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:14501:1876351894231040:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.316573:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933509632
00010000:00010000:1.0:1789431564.316586:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091283423/0xd8e438fb63513338 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2ed6 expref: 93 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.316605:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933509760
00000100:00100000:1.0:1789431564.316608:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933509760
00010000:00010000:1.0:1789431564.316622:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6bbf184/0xd8e438fb63515543 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c396b expref: 93 pid: 14471 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.316640:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16551
00000100:00100000:1.0:1789431564.316646:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+93:2349:x1876351933509504:12345-192.168.203.4@tcp:103:ldlm_bl.0
00000100:00100000:2.0:1789431564.316652:0:14501:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38600 going to sleep for 11 seconds
00010000:00010000:1.0:1789431564.316660:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.316666:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000005adae1/0xd8e438fb6351d06b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6157 expref: 93 pid: 6699 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.316677:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000005adae1/0xd8e438fb6351d06b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6157 expref: 93 pid: 6699 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.316698:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.316701:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.316707:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006f94645f/0xd8e438fb63526930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.316716:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f94645f/0xd8e438fb63526930 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.316825:0:14486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082fb03c4/0xd8e438fb63526929 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.316851:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933509376
00000100:00100000:3.0:1789431564.316854:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933509376
00000100:00100000:3.0:1789431564.316888:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296070
00000100:00100000:3.0:1789431564.316894:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+194:14616:x1876351933509376:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431564.316912:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431564.316930:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63526992 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8dcd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.317029:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63526999 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.317043:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635268d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dc6 expref: 195 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.317075:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63526999 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.317099:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635268d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dc6 expref: 195 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.317109:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635268d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dc6 expref: 195 pid: 6797 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.317120:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894231168:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431564.317152:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf066aa840 going to sleep for 11 seconds
00000100:00100000:3.0:1789431564.317181:0:14471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14471:1876351894228608:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.317198:0:14471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63526945 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.317430:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16552
00000100:00100000:0.0:1789431564.317444:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+93:2349:x1876351933509632:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431564.317457:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431564.317466:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091283423/0xd8e438fb63513338 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2ed6 expref: 93 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.317480:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091283423/0xd8e438fb63513338 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2ed6 expref: 93 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.317501:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091283423/0xd8e438fb63513338 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2ed6 expref: 93 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.317519:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.317523:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.317528:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082fb03c4/0xd8e438fb63526929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.317537:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082fb03c4/0xd8e438fb63526929 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.317568:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431564.317616:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+92:2349:x1876351933509632:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 175us (1226us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.317624:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16552
00000100:00100000:0.0:1789431564.317646:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16553
00000100:00100000:0.0:1789431564.317654:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+93:2348:x1876351933509760:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431564.317662:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431564.317667:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6bbf184/0xd8e438fb63515543 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c396b expref: 93 pid: 14471 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.317677:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6bbf184/0xd8e438fb63515543 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c396b expref: 93 pid: 14471 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.317690:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ad:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.317694:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ad:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.317698:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa6bbca6/0xd8e438fb63526937 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.317704:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6bbca6/0xd8e438fb63526937 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.317717:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431564.317847:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.317870:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+93:2349:x1876351933509504:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1225us (1498us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.317877:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16551
00000004:00080000:1.0:1789431564.317940:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf37e3ea00/2, rc 0, transno 4294970013
00000100:00100000:1.0:1789431564.317957:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894225152:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.318028:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3c157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894231296:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.318094:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431564.318140:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894231296
00000100:00100000:1.0:1789431564.318146:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894231296
00000100:00100000:1.0:1789431564.318178:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8308
00000100:00100000:1.0:1789431564.318186:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3312:x1876351894231296:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431564.318209:0:6699:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1231 count 1
00010000:00010000:1.0:1789431564.318231:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ca7c869/0xd8e438fb635269a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.318246:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aaea9290/0xd8e438fb6351e605 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c67f5 expref: 91 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.318254:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4cf:0x0].0x0 since=19s v=(0 0)
00010000:00010000:1.0:1789431564.318257:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4cf:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.318261:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ca7c869/0xd8e438fb635269a0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.318283:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aaea9290/0xd8e438fb6351e605 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c67f5 expref: 91 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.318295:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aaea9290/0xd8e438fb6351e605 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c67f5 expref: 91 pid: 14469 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.318307:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3c157100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6699:1876351894231424:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.318338:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf18a0bb40 going to sleep for 11 seconds
00010000:00010000:1.0:1789431564.318378:0:14499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000005adae1/0xd8e438fb6351d06b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6157 expref: 92 pid: 6699 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.318391:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:14499:1876351894228096:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.318407:0:14499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006f94645f/0xd8e438fb63526930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.318417:0:14499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006f94645f/0xd8e438fb63526930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.318424:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f94645f/0xd8e438fb63526930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.318435:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f94645f/0xd8e438fb63526930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.318442:0:14499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f94645f/0xd8e438fb63526930 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.318460:0:14499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431564.318867:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+91:2348:x1876351933509760:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1210us (2460us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.318877:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16553
00010000:00010000:3.0:1789431564.319664:0:14486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082fb03c4/0xd8e438fb63526929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.319682:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082fb03c4/0xd8e438fb63526929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.319694:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082fb03c4/0xd8e438fb63526929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.319702:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082fb03c4/0xd8e438fb63526929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.319834:0:14486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:3.0:1789431564.320511:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3314:x1876351894227840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24039us (25601us total) trans 4294970014 rc 0/0
00000100:00100000:3.0:1789431564.320522:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8293
00000100:00100000:1.0:1789431564.320884:0:14499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+23:3312:x1876351894226816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21740us (22832us total) trans 4294969628 rc 0/0
00000100:00100000:1.0:1789431564.320894:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8294
00000100:00100000:3.0:1789431564.321257:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14468:1876351894228480:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.321287:0:14468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e09e4ac4/0xd8e438fb6352693e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.321340:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6bbf184/0xd8e438fb63515543 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c396b expref: 90 pid: 14471 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.321364:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1876351894228224:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.321376:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aa6bbca6/0xd8e438fb63526937 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.321386:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aa6bbca6/0xd8e438fb63526937 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.321395:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa6bbca6/0xd8e438fb63526937 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.321408:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa6bbca6/0xd8e438fb63526937 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.321417:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6bbca6/0xd8e438fb63526937 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.322080:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp.  (2 blwis in pool)
00010000:00010000:0.0:1789431564.322093:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f94645f/0xd8e438fb63526930 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.322106:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309e00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431564.322111:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f94645f/0xd8e438fb63526930 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.322125:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f94645f/0xd8e438fb63526930 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.322152:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f94645f/0xd8e438fb63526930 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.322161:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f94645f/0xd8e438fb63526930 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.322188:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:0.0:1789431564.322193:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082fb03c4/0xd8e438fb63526929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.322200:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cbc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431564.322203:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082fb03c4/0xd8e438fb63526929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.322211:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082fb03c4/0xd8e438fb63526929 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.322224:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082fb03c4/0xd8e438fb63526929 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.322231:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082fb03c4/0xd8e438fb63526929 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.322268:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431564.322272:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa6bbca6/0xd8e438fb63526937 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.322279:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431564.322282:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa6bbca6/0xd8e438fb63526937 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.322290:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa6bbca6/0xd8e438fb63526937 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.322300:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa6bbca6/0xd8e438fb63526937 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.322309:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431564.322311:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431564.322313:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.322421:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:1.0:1789431564.322474:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce20fd7b80/2, rc 0, transno 4294970014
00000100:00100000:1.0:1789431564.322490:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894227840:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.322587:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3c157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894231552:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.322656:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431564.322712:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894231552
00000100:00100000:1.0:1789431564.322734:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894231552
00000100:00100000:1.0:1789431564.322901:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8309
00000100:00100000:1.0:1789431564.322911:0:14500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+21:3313:x1876351894231552:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431564.322948:0:14500:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1182 count 1
00010000:00010000:1.0:1789431564.322977:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb635269a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.323000:0:14500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d64bafd/0xd8e438fb63512267 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c29b2 expref: 91 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.323010:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x49e:0x0].0x0 since=51s v=(0 0)
00010000:00010000:1.0:1789431564.323015:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.323021:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb635269a7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.323074:0:14500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d64bafd/0xd8e438fb63512267 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c29b2 expref: 91 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.323090:0:14500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d64bafd/0xd8e438fb63512267 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c29b2 expref: 91 pid: 14471 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.323103:0:14500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3c155f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:14500:1876351894231680:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.323180:0:14500:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1a878600 going to sleep for 11 seconds
00000004:00080000:1.0:1789431564.323222:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce20fd5f80/2, rc 0, transno 4294969628
00000100:00100000:1.0:1789431564.323234:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894226816:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431564.323426:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3c154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894231808:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431564.323460:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:3.0:1789431564.324074:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool
00010000:00010000:3.0:1789431564.324087:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa6bbca6/0xd8e438fb63526937 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.324501:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3312:x1876351894227328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17464us (26385us total) trans 4294969629 rc 0/0
00000100:00100000:3.0:1789431564.324513:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8295
00000100:00100000:3.0:1789431564.324544:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894231808
00000100:00100000:3.0:1789431564.324551:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894231808
00000100:00100000:3.0:1789431564.324587:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8310
00000100:00100000:3.0:1789431564.324596:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3314:x1876351894231808:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:3.0:1789431564.324621:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1235 count 1
00010000:00010000:3.0:1789431564.324642:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc643d4e/0xd8e438fb635269ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.324663:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082fdd044/0xd8e438fb6351ecaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6a33 expref: 89 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.324672:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4d3:0x0].0x0 since=18s v=(0 0)
00010000:00010000:3.0:1789431564.324676:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431564.324681:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc643d4e/0xd8e438fb635269ae lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.324714:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082fdd044/0xd8e438fb6351ecaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6a33 expref: 89 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.324865:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.324907:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082fdd044/0xd8e438fb6351ecaa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6a33 expref: 89 pid: 8217 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.324925:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1876351894231936:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431564.325030:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf066aac00 going to sleep for 11 seconds
00000004:00080000:2.0:1789431564.328328:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce20fd5500/2, rc 0, transno 4294969629
00000100:00100000:2.0:1789431564.328362:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894227328:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431564.330586:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.330622:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.330710:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14482:1876351894228736:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431564.330764:0:14482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6fb0e20/0xd8e438fb6352694c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.331520:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933509888
00000100:00100000:0.0:1789431564.331533:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933509888
00010000:00010000:0.0:1789431564.331588:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e0aab669/0xd8e438fb6351482a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c356d expref: 90 pid: 6699 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.331633:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933510016
00000100:00100000:0.0:1789431564.331638:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933510016
00010000:00010000:0.0:1789431564.331654:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094865098/0xd8e438fb6351ca21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c5f7b expref: 91 pid: 14472 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.331682:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16554
00000100:00100000:0.0:1789431564.331693:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+91:2348:x1876351933509888:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431564.331710:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431564.331730:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e0aab669/0xd8e438fb6351482a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c356d expref: 91 pid: 6699 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.331745:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e0aab669/0xd8e438fb6351482a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c356d expref: 91 pid: 6699 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.331776:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0aab669/0xd8e438fb6351482a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c356d expref: 91 pid: 6699 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.331798:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.331803:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.331811:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63526945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.331825:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63526945 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.331856:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431564.331924:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+90:2348:x1876351933509888:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 232us (1353us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.331937:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16554
00000100:00100000:0.0:1789431564.331958:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16555
00000100:00100000:0.0:1789431564.331966:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+89:2348:x1876351933510016:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431564.331975:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431564.331981:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094865098/0xd8e438fb6351ca21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c5f7b expref: 89 pid: 14472 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.331992:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094865098/0xd8e438fb6351ca21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c5f7b expref: 89 pid: 14472 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.332005:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094865098/0xd8e438fb6351ca21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c5f7b expref: 89 pid: 14472 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.332018:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.332022:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.332026:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e09e4ac4/0xd8e438fb6352693e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.332033:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e09e4ac4/0xd8e438fb6352693e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.332073:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431564.332094:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+88:2348:x1876351933510016:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 128us (1471us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.332101:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16555
00010000:00010000:3.0:1789431564.332923:0:14471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63526945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.332940:0:14471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63526945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.332954:0:14471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63526945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.332963:0:14471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63526945 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.332987:0:14471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1789431564.333419:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.333632:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.333651:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.333672:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.333689:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.333703:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.333705:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3312:x1876351894227200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25044us (35432us total) trans 4294969630 rc 0/0
00000100:00100000:2.0:1789431564.333714:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.333717:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8297
00000100:00100000:2.0:1789431564.333744:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.334021:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:14502:1876351894229760:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431564.334079:0:14502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000709cba9d/0xd8e438fb63526953 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.334115:0:14505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:14505:1876351894230784:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431564.334135:0:14505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005e9b5c43/0xd8e438fb6352697d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00080000:2.0:1789431564.334175:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce20fd5c00/2, rc 0, transno 4294969630
00000100:00100000:2.0:1789431564.334183:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894227200:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431564.334206:0:14501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:14501:1876351894231040:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431564.334219:0:14501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003f99604/0xd8e438fb6352698b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.334239:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933510144
00000100:00100000:2.0:1789431564.334246:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933510144
00000100:00100000:3.0:1789431564.334249:0:14490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14490:1876351894230656:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.334270:0:14490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005ff37435/0xd8e438fb63526976 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.334282:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a8425f1/0xd8e438fb6352149d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c76e3 expref: 88 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.334290:0:14468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e09e4ac4/0xd8e438fb6352693e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.334298:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e09e4ac4/0xd8e438fb6352693e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.334300:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933510400
00000100:00100000:2.0:1789431564.334303:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933510400
00010000:00010000:3.0:1789431564.334309:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e09e4ac4/0xd8e438fb6352693e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.334313:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008a1ccd97/0xd8e438fb6351d534 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c62ca expref: 89 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.334319:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e09e4ac4/0xd8e438fb6352693e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.334324:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933510656
00000100:00100000:2.0:1789431564.334326:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933510656
00010000:00010000:2.0:1789431564.334337:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000755738c5/0xd8e438fb6351d87c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c63d4 expref: 92 pid: 14502 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.334338:0:14468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:2.0:1789431564.334348:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933511040
00000100:00100000:2.0:1789431564.334351:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933511040
00010000:00010000:2.0:1789431564.334361:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ab5444e4/0xd8e438fb63521d3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79ad expref: 93 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.334370:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933510272
00000100:00100000:2.0:1789431564.334372:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933510272
00010000:00010000:2.0:1789431564.334382:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6351d772 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6379 expref: 90 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.334392:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933510528
00000100:00100000:2.0:1789431564.334395:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933510528
00010000:00010000:2.0:1789431564.334406:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007955e986/0xd8e438fb63520d9d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c74a5 expref: 94 pid: 14482 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.334416:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933510784
00000100:00100000:2.0:1789431564.334419:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933510784
00010000:00010000:2.0:1789431564.334429:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c27b3433/0xd8e438fb635219b3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7887 expref: 95 pid: 14505 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.334441:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933510912
00000100:00100000:2.0:1789431564.334443:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933510912
00010000:00010000:2.0:1789431564.334452:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097a080c3/0xd8e438fb6351e2c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6700 expref: 96 pid: 14468 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.334466:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16556
00000100:00100000:2.0:1789431564.334475:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e952850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+90:2347:x1876351933510144:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431564.334491:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431564.334496:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a8425f1/0xd8e438fb6352149d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c76e3 expref: 90 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.334509:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a8425f1/0xd8e438fb6352149d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c76e3 expref: 90 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.334534:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a8425f1/0xd8e438fb6352149d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c76e3 expref: 90 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.334552:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ea:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.334556:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ea:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.334563:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6fb0e20/0xd8e438fb6352694c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.334573:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6fb0e20/0xd8e438fb6352694c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.334599:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.334647:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e952850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+89:2347:x1876351933510144:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 172us (1233us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.334654:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16556
00000100:00100000:3.0:1789431564.334682:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3312:x1876351894226688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26857us (36451us total) trans 4294969631 rc 0/0
00000100:00100000:3.0:1789431564.334688:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8296
00000100:00100000:2.0:1789431564.334696:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16557
00000100:00100000:2.0:1789431564.334702:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+88:2348:x1876351933510400:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431564.334709:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431564.334711:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:2.0:1789431564.334715:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008a1ccd97/0xd8e438fb6351d534 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c62ca expref: 88 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.334731:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63526945 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.334742:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008a1ccd97/0xd8e438fb6351d534 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c62ca expref: 88 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.334755:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1ccd97/0xd8e438fb6351d534 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c62ca expref: 88 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.334764:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.334768:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.334772:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000709cba9d/0xd8e438fb63526953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.334780:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000709cba9d/0xd8e438fb63526953 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.334798:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.334818:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+87:2348:x1876351933510400:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 115us (1185us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.334824:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16557
00000100:00100000:2.0:1789431564.334838:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16558
00000100:00100000:2.0:1789431564.334845:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+96:2348:x1876351933510656:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431564.334853:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431564.334859:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000755738c5/0xd8e438fb6351d87c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c63d4 expref: 96 pid: 14502 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.334874:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000755738c5/0xd8e438fb6351d87c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c63d4 expref: 96 pid: 14502 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.334888:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.334891:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.334895:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab95b4b2/0xd8e438fb63526968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.334903:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab95b4b2/0xd8e438fb63526968 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.334914:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.334932:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+96:2348:x1876351933510656:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 88us (1280us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.334939:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16558
00000100:00100000:2.0:1789431564.334951:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16559
00000100:00100000:2.0:1789431564.334958:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+95:2348:x1876351933511040:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431564.334965:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431564.334970:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ab5444e4/0xd8e438fb63521d3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79ad expref: 95 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.334979:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ab5444e4/0xd8e438fb63521d3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79ad expref: 95 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.334997:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab5444e4/0xd8e438fb63521d3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c79ad expref: 95 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335008:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ec:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.335012:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ec:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.335016:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e9b5c43/0xd8e438fb6352697d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335023:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e9b5c43/0xd8e438fb6352697d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335040:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.335085:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+94:2348:x1876351933511040:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 127us (1411us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.335092:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16559
00000100:00100000:2.0:1789431564.335106:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16560
00000100:00100000:2.0:1789431564.335112:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+86:2348:x1876351933510272:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431564.335121:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431564.335127:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6351d772 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6379 expref: 86 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335137:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6351d772 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6379 expref: 86 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335155:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.335158:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.335162:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd11ad65/0xd8e438fb6352695a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335169:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd11ad65/0xd8e438fb6352695a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335180:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.335200:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+86:2348:x1876351933510272:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 88us (1508us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.335206:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16560
00000100:00100000:2.0:1789431564.335220:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16561
00000100:00100000:2.0:1789431564.335225:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+93:2348:x1876351933510528:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431564.335233:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431564.335238:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007955e986/0xd8e438fb63520d9d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c74a5 expref: 93 pid: 14482 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335248:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007955e986/0xd8e438fb63520d9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c74a5 expref: 93 pid: 14482 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335260:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.335264:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.335269:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63526961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335283:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63526961 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335294:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.335313:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+93:2348:x1876351933510528:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 87us (1609us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.335320:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16561
00000100:00100000:2.0:1789431564.335333:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16562
00000100:00100000:2.0:1789431564.335340:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+92:2348:x1876351933510784:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431564.335348:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431564.335353:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c27b3433/0xd8e438fb635219b3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7887 expref: 92 pid: 14505 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335364:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c27b3433/0xd8e438fb635219b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7887 expref: 92 pid: 14505 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335376:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4eb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.335379:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4eb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.335383:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb6352696f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335391:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb6352696f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335408:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.335424:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+92:2348:x1876351933510784:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 84us (1708us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.335431:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16562
00000100:00100000:2.0:1789431564.335444:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16563
00000100:00100000:2.0:1789431564.335450:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e952450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+91:2348:x1876351933510912:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431564.335458:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431564.335464:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097a080c3/0xd8e438fb6351e2c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6700 expref: 91 pid: 14468 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335474:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097a080c3/0xd8e438fb6351e2c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6700 expref: 91 pid: 14468 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335486:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097a080c3/0xd8e438fb6351e2c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6700 expref: 91 pid: 14468 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335497:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4cd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.335500:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4cd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.335506:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ff37435/0xd8e438fb63526976 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335515:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ff37435/0xd8e438fb63526976 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335541:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.335560:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e952450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+90:2348:x1876351933510912:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 109us (1814us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.335566:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16563
00010000:00010000:2.0:1789431564.335607:0:14482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6fb0e20/0xd8e438fb6352694c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335617:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6fb0e20/0xd8e438fb6352694c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335627:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6fb0e20/0xd8e438fb6352694c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335636:0:14482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6fb0e20/0xd8e438fb6352694c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.335656:0:14482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:3.0:1789431564.336178:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cac00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431564.336183:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63526945 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.336195:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63526945 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.336210:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63526945 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.336218:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b12ccf6/0xd8e438fb63526945 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.336240:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6351d772 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6379 expref: 85 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.336240:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:3.0:1789431564.336246:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e09e4ac4/0xd8e438fb6352693e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.336258:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431564.336261:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e09e4ac4/0xd8e438fb6352693e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.336263:0:8217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3621aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8217:1876351894229888:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.336269:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e09e4ac4/0xd8e438fb6352693e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.336278:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e09e4ac4/0xd8e438fb6352693e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.336286:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cd11ad65/0xd8e438fb6352695a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.336286:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e09e4ac4/0xd8e438fb6352693e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.336295:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cd11ad65/0xd8e438fb6352695a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.336301:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431564.336302:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd11ad65/0xd8e438fb6352695a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.336305:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6fb0e20/0xd8e438fb6352694c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.336312:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd11ad65/0xd8e438fb6352695a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.336312:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01521a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431564.336315:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6fb0e20/0xd8e438fb6352694c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.336321:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd11ad65/0xd8e438fb6352695a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.336323:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6fb0e20/0xd8e438fb6352694c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.336331:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6fb0e20/0xd8e438fb6352694c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.336337:0:8217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431564.336339:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6fb0e20/0xd8e438fb6352694c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.336352:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431564.336355:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd11ad65/0xd8e438fb6352695a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.336361:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431564.336364:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd11ad65/0xd8e438fb6352695a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.336371:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd11ad65/0xd8e438fb6352695a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.336380:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd11ad65/0xd8e438fb6352695a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.336387:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd11ad65/0xd8e438fb6352695a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.336399:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.336400:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.336403:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.336416:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431564.336584:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3312:x1876351894228992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25360us (25744us total) trans 4294969632 rc 0/0
00000100:00100000:0.0:1789431564.336592:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8300
00000100:00100000:0.0:1789431564.336736:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.336770:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933511168
00000100:00100000:1.0:1789431564.336778:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933511168
00000100:00100000:0.0:1789431564.336779:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431564.336810:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d06b4e68/0xd8e438fb6351d064 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6150 expref: 90 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.336837:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933511424
00000100:00100000:1.0:1789431564.336839:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933511424
00010000:00010000:1.0:1789431564.336853:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082fdd044/0xd8e438fb6351ecaa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6a33 expref: 85 pid: 8217 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.336866:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16564
00000100:00100000:1.0:1789431564.336873:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+90:2347:x1876351933511168:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.336885:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.336890:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d06b4e68/0xd8e438fb6351d064 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6150 expref: 90 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.336901:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d06b4e68/0xd8e438fb6351d064 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6150 expref: 90 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.336913:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007955e986/0xd8e438fb63520d9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c74a5 expref: 90 pid: 14482 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.336918:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.336922:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c4:0x0].0x0 since=0s v=(1 0)
00000100:00100000:0.0:1789431564.336925:0:14469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3621b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14469:1876351894230016:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.336927:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000396dbf81/0xd8e438fb63526984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.336935:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000396dbf81/0xd8e438fb63526984 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.336945:0:14469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63526961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.336952:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431564.336953:0:14469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63526961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.336961:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63526961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.336969:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63526961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.336976:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63526961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.336990:0:14469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:1.0:1789431564.336992:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+89:2347:x1876351933511168:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 120us (257us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.337002:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16564
00000100:00100000:1.0:1789431564.337015:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16565
00000100:00100000:1.0:1789431564.337021:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+85:2347:x1876351933511424:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.337029:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.337034:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082fdd044/0xd8e438fb6351ecaa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6a33 expref: 85 pid: 8217 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.337044:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082fdd044/0xd8e438fb6351ecaa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6a33 expref: 85 pid: 8217 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.337129:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.337132:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.337136:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc643d4e/0xd8e438fb635269ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.337145:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc643d4e/0xd8e438fb635269ae lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.337158:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.337186:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+85:2347:x1876351933511424:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 164us (406us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.337193:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16565
00010000:00010000:1.0:1789431564.337212:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.337219:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63526961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.337234:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.337237:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63526961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.337245:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63526961 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.337257:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63526961 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.337265:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1bf7dc6/0xd8e438fb63526961 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.337378:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.337380:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.337382:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.337390:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431564.337412:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3c155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894232064:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431564.337457:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431564.337493:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1789431564.337498:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3c155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894232192:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431564.337517:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431564.337544:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894232064
00000100:00100000:1.0:1789431564.337549:0:14464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894232064
00000100:00100000:1.0:1789431564.337574:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894232192
00000100:00100000:1.0:1789431564.337577:0:14464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894232192
00000100:00100000:1.0:1789431564.337594:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8311
00000100:00100000:1.0:1789431564.337600:0:14464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3311:x1876351894232064:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:1.0:1789431564.337626:0:14464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1241 count 1
00010000:00010000:1.0:1789431564.337651:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb635269b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.337668:0:14464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004976014e/0xd8e438fb6351f6e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6d5f expref: 84 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.337675:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4d9:0x0].0x0 since=16s v=(0 0)
00010000:00010000:1.0:1789431564.337679:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.337683:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb635269b5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.337707:0:14464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004976014e/0xd8e438fb6351f6e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6d5f expref: 84 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.337732:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3312:x1876351894229504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24627us (25274us total) trans 4294970015 rc 0/0
00000100:00100000:0.0:1789431564.337741:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8301
00000100:00100000:0.0:1789431564.337757:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8312
00000100:00100000:0.0:1789431564.337764:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3311:x1876351894232192:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431564.337777:0:14469:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1243 count 1
00010000:00010000:0.0:1789431564.337790:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb635269bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.337804:0:14469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb6351f945 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6e2a expref: 84 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.337810:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4db:0x0].0x0 since=15s v=(0 0)
00010000:00010000:0.0:1789431564.337813:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4db:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.337816:0:14469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb635269bc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.337834:0:14469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb6351f945 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6e2a expref: 84 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.337844:0:14469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb6351f945 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6e2a expref: 84 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.337856:0:14469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3621b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14469:1876351894232448:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431564.337930:0:14469:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf2ac35cc0 going to sleep for 11 seconds
00010000:00010000:1.0:1789431564.338152:0:14464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004976014e/0xd8e438fb6351f6e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6d5f expref: 84 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.338167:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14464:1876351894232320:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.338201:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1a1fb000 going to sleep for 11 seconds
00010000:00010000:1.0:1789431564.338247:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c27b3433/0xd8e438fb635219b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7887 expref: 88 pid: 14505 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.338260:0:14472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14472:1876351894230400:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.338279:0:14472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb6352696f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.338289:0:14472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb6352696f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.338297:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb6352696f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.338307:0:14472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb6352696f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.338316:0:14472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb6352696f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.338333:0:14472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:1.0:1789431564.338682:0:14472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3313:x1876351894229632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24634us (26079us total) trans 4294970016 rc 0/0
00000100:00100000:1.0:1789431564.338692:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8304
00010000:00010000:3.0:1789431564.339822:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431564.339838:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb6352696f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.339854:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431564.339859:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb6352696f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.339873:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb6352696f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.339897:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb6352696f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.339905:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b2e0b95/0xd8e438fb6352696f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.339928:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.339930:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.339932:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.340111:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082fdd044/0xd8e438fb6351ecaa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6a33 expref: 84 pid: 8217 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.340124:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1876351894231936:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.340148:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc643d4e/0xd8e438fb635269ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.340159:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc643d4e/0xd8e438fb635269ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.340169:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc643d4e/0xd8e438fb635269ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.340179:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc643d4e/0xd8e438fb635269ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.340187:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc643d4e/0xd8e438fb635269ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.340250:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:3.0:1789431564.340600:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3314:x1876351894231808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16004us (17137us total) trans 4294969633 rc 0/0
00000100:00100000:3.0:1789431564.340611:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8310
00000004:00080000:3.0:1789431564.340794:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3c154700/2, rc 0, transno 4294969633
00000100:00100000:3.0:1789431564.340808:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3c154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894231808:0@lo:6:osp-syn-0-0.0
00000004:00080000:1.0:1789431564.341013:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba1b800/2, rc 0, transno 4294970016
00000100:00100000:1.0:1789431564.341033:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894229632:0@lo:6:osp-syn-1-0.0
00010000:00010000:1.0:1789431564.341069:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.341076:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc643d4e/0xd8e438fb635269ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.341087:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b274400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.341091:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc643d4e/0xd8e438fb635269ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.341102:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc643d4e/0xd8e438fb635269ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.341121:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc643d4e/0xd8e438fb635269ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.341128:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc643d4e/0xd8e438fb635269ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.341149:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.341151:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.341153:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431564.341236:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894232576:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431564.341288:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431564.341341:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894232576
00000100:00100000:1.0:1789431564.341350:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894232576
00000100:00100000:1.0:1789431564.341400:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8313
00000100:00100000:1.0:1789431564.341411:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3313:x1876351894232576:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:1.0:1789431564.341441:0:14468:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1260 count 1
00010000:00010000:1.0:1789431564.341465:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb635269c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.341483:0:14468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e230ba3/0xd8e438fb63521b0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c78fe expref: 83 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.341500:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4ec:0x0].0x0 since=10s v=(0 0)
00010000:00010000:1.0:1789431564.341504:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ec:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.341509:0:14468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb635269c3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.341539:0:14468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e230ba3/0xd8e438fb63521b0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c78fe expref: 83 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.341553:0:14468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e230ba3/0xd8e438fb63521b0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c78fe expref: 83 pid: 14469 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.341566:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14468:1876351894232704:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.341631:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf0620e180 going to sleep for 11 seconds
00010000:00010000:1.0:1789431564.341670:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d06b4e68/0xd8e438fb6351d064 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6150 expref: 87 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.341682:0:14491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3bbf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14491:1876351894230912:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.341701:0:14491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000396dbf81/0xd8e438fb63526984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.341709:0:14491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000396dbf81/0xd8e438fb63526984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.341717:0:14491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000396dbf81/0xd8e438fb63526984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.341739:0:14491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000396dbf81/0xd8e438fb63526984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.341748:0:14491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000396dbf81/0xd8e438fb63526984 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.341763:0:14491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:1.0:1789431564.342255:0:14491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+22:3313:x1876351894229248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28025us (29615us total) trans 4294970017 rc 0/0
00000100:00100000:1.0:1789431564.342265:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8305
00000004:00080000:1.0:1789431564.342314:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba19f80/2, rc 0, transno 4294970017
00000100:00100000:1.0:1789431564.342320:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894229248:0@lo:6:osp-syn-1-0.0
00010000:00010000:1.0:1789431564.342338:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.342344:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000396dbf81/0xd8e438fb63526984 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.342354:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.342358:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000396dbf81/0xd8e438fb63526984 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.342367:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000396dbf81/0xd8e438fb63526984 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.342383:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000396dbf81/0xd8e438fb63526984 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.342390:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000396dbf81/0xd8e438fb63526984 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.342412:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.342414:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.342415:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.342438:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000755738c5/0xd8e438fb6351d87c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c63d4 expref: 86 pid: 14502 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.342449:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce35e44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1876351894230144:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.342464:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ab95b4b2/0xd8e438fb63526968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.342472:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ab95b4b2/0xd8e438fb63526968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.342479:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab95b4b2/0xd8e438fb63526968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.342488:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab95b4b2/0xd8e438fb63526968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.342495:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab95b4b2/0xd8e438fb63526968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.342517:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431564.342786:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.342812:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000004:00080000:2.0:1789431564.343705:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba1bb80/2, rc 0, transno 4294970015
00000100:00100000:2.0:1789431564.343730:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894229504:0@lo:6:osp-syn-1-0.0
00000004:00080000:2.0:1789431564.343753:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2a7eb100/2, rc 0, transno 4294969632
00000100:00100000:2.0:1789431564.343772:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894228992:0@lo:6:osp-syn-0-0.0
00000004:00080000:2.0:1789431564.343788:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce20fd5180/2, rc 0, transno 4294969631
00000100:00100000:2.0:1789431564.343792:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894226688:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431564.343798:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1789431564.343815:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894232960:0@lo:6:osp-syn-1-0.0
00000100:00100000:2.0:1789431564.343874:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:2.0:1789431564.343928:0:14505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005e9b5c43/0xd8e438fb6352697d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.343944:0:14505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e9b5c43/0xd8e438fb6352697d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.343956:0:14505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e9b5c43/0xd8e438fb6352697d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.343965:0:14505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e9b5c43/0xd8e438fb6352697d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.343984:0:14505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:3.0:1789431564.344175:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894233088:0@lo:6:osp-syn-1-0.0
00000100:00100000:3.0:1789431564.344204:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431564.344286:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.344320:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894231168:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.344344:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63526999 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.344478:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+22:3312:x1876351894229376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31207us (31955us total) trans 4294970018 rc 0/0
00000100:00100000:2.0:1789431564.344489:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8302
00000100:00100000:2.0:1789431564.344517:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894232960
00000004:00080000:3.0:1789431564.344559:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba1a680/2, rc 0, transno 4294970018
00000100:00100000:3.0:1789431564.344569:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894229376:0@lo:6:osp-syn-1-0.0
00000100:00100000:2.0:1789431564.344609:0:14505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894232960
00000100:00100000:2.0:1789431564.344656:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894233088
00000100:00100000:2.0:1789431564.344660:0:14505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894233088
00000100:00100000:2.0:1789431564.344682:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8314
00000100:00100000:2.0:1789431564.344692:0:14505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+23:3312:x1876351894232960:12345-0@lo:6:osp-syn-1-0.0
00000100:00100000:3.0:1789431564.344730:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8315
00002000:00080000:2.0:1789431564.344733:0:14505:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1188 count 1
00000100:00100000:3.0:1789431564.344746:0:14472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3312:x1876351894233088:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:3.0:1789431564.344758:0:14472:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1242 count 1
00010000:00010000:2.0:1789431564.344761:0:14505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054447f51/0xd8e438fb635269ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.344770:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019b16bbd/0xd8e438fb635269d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.344786:0:14505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dff3304a/0xd8e438fb63513a23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c30f8 expref: 85 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.344786:0:14472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb6351f8c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6df9 expref: 85 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.344797:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4a4:0x0].0x0 since=47s v=(0 0)
00010000:00010000:3.0:1789431564.344797:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4da:0x0].0x0 since=15s v=(0 0)
00010000:00010000:2.0:1789431564.344802:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431564.344802:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4da:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.344808:0:14505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054447f51/0xd8e438fb635269ca lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.344808:0:14472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019b16bbd/0xd8e438fb635269d1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.344837:0:14505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dff3304a/0xd8e438fb63513a23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c30f8 expref: 85 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.344837:0:14472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb6351f8c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6df9 expref: 85 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.344853:0:14505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dff3304a/0xd8e438fb63513a23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c30f8 expref: 85 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.344853:0:14472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb6351f8c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6df9 expref: 85 pid: 14471 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.344868:0:14505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:14505:1876351894233472:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431564.344868:0:14472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0e615f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14472:1876351894233344:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431564.344937:0:14472:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf066aa840 going to sleep for 11 seconds
00000100:00100000:3.0:1789431564.345034:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1789431564.345044:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce36219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894233728:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431564.345207:0:14500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3c155f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:14500:1876351894231680:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431564.345226:0:14500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb635269a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.345260:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933511552
00000100:00100000:0.0:1789431564.345268:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933511552
00010000:00010000:0.0:1789431564.345303:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aaea9290/0xd8e438fb6351e605 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c67f5 expref: 86 pid: 14469 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.345327:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933511680
00000100:00100000:0.0:1789431564.345330:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933511680
00010000:00010000:0.0:1789431564.345342:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d64bafd/0xd8e438fb63512267 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c29b2 expref: 87 pid: 14471 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.345353:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933511808
00000100:00100000:0.0:1789431564.345356:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933511808
00010000:00010000:0.0:1789431564.345369:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635268d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dc6 expref: 196 pid: 6797 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.345388:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16566
00000100:00100000:0.0:1789431564.345396:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+87:2347:x1876351933511552:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431564.345406:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431564.345412:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aaea9290/0xd8e438fb6351e605 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c67f5 expref: 87 pid: 14469 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.345427:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aaea9290/0xd8e438fb6351e605 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c67f5 expref: 87 pid: 14469 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.345452:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4cf:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.345455:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4cf:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.345463:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ca7c869/0xd8e438fb635269a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.345475:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ca7c869/0xd8e438fb635269a0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.345716:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.345902:0:14505:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38300 going to sleep for 11 seconds
00000100:00100000:2.0:1789431564.346012:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431564.346115:0:14502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000709cba9d/0xd8e438fb63526953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.346128:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000709cba9d/0xd8e438fb63526953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.346141:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000709cba9d/0xd8e438fb63526953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.346151:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000709cba9d/0xd8e438fb63526953 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.346174:0:14502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool
00000100:00100000:1.0:1789431564.346309:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3313:x1876351894229120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32878us (33732us total) trans 4294970019 rc 0/0
00000100:00100000:1.0:1789431564.346320:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8303
00010000:00010000:1.0:1789431564.346354:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp.  (2 blwis in pool)
00010000:00010000:1.0:1789431564.346362:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab95b4b2/0xd8e438fb63526968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.346370:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.346374:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab95b4b2/0xd8e438fb63526968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.346385:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab95b4b2/0xd8e438fb63526968 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.346401:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab95b4b2/0xd8e438fb63526968 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.346409:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab95b4b2/0xd8e438fb63526968 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.346432:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1789431564.346436:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e9b5c43/0xd8e438fb6352697d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.346449:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f897000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.346451:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e9b5c43/0xd8e438fb6352697d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.346458:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e9b5c43/0xd8e438fb6352697d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.346467:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e9b5c43/0xd8e438fb6352697d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.346474:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e9b5c43/0xd8e438fb6352697d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.346487:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.346490:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000709cba9d/0xd8e438fb63526953 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.346497:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f897200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.346499:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000709cba9d/0xd8e438fb63526953 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.346506:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000709cba9d/0xd8e438fb63526953 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.346515:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000709cba9d/0xd8e438fb63526953 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.346522:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000709cba9d/0xd8e438fb63526953 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.346536:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.346538:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.346540:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431564.346563:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894233216:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.346602:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000004:00080000:1.0:1789431564.346641:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba18700/2, rc 0, transno 4294970019
00000100:00100000:1.0:1789431564.346654:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894229120:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.346666:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:1.0:1789431564.346673:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894232832:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.346697:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431564.346713:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce36219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894233600:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431564.346749:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1789431564.346774:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431564.346832:0:14502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+27:3312:x1876351894228864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35615us (36658us total) trans 4294969634 rc 0/0
00000100:00100000:1.0:1789431564.346838:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894233216
00000100:00100000:2.0:1789431564.346840:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8299
00000100:00100000:1.0:1789431564.346844:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894233216
00000100:00100000:2.0:1789431564.346854:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894232832
00000100:00100000:2.0:1789431564.346857:0:14502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894232832
00000100:00100000:1.0:1789431564.346871:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894233600
00000100:00100000:1.0:1789431564.346874:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894233600
00000100:00100000:2.0:1789431564.346875:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8316
00000100:00100000:2.0:1789431564.346883:0:14502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+25:3313:x1876351894233216:12345-0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.346886:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8317
00000100:00100000:1.0:1789431564.346891:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3313:x1876351894232832:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431564.346904:0:8217:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1234 count 1
00002000:00080000:2.0:1789431564.346904:0:14502:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1263 count 1
00010000:00010000:1.0:1789431564.346926:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6bbf184/0xd8e438fb635269d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.346926:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090fe46f0/0xd8e438fb635269df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.346944:0:14502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021b8b20c/0xd8e438fb635223df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b90 expref: 87 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.346945:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c473188f/0xd8e438fb6351eb4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c69b5 expref: 87 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.346954:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4d2:0x0].0x0 since=18s v=(0 0)
00010000:00010000:2.0:1789431564.346954:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4ef:0x0].0x0 since=9s v=(0 0)
00010000:00010000:1.0:1789431564.346959:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4d2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.346959:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ef:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.346964:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6bbf184/0xd8e438fb635269d8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.346964:0:14502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090fe46f0/0xd8e438fb635269df lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.346988:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c473188f/0xd8e438fb6351eb4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c69b5 expref: 87 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.346988:0:14502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021b8b20c/0xd8e438fb635223df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b90 expref: 87 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.347003:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c473188f/0xd8e438fb6351eb4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c69b5 expref: 87 pid: 14472 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.347003:0:14502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021b8b20c/0xd8e438fb635223df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b90 expref: 87 pid: 14468 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.347017:0:8217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8217:1876351894233984:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.347017:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:14502:1876351894234112:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.347474:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38b40 going to sleep for 11 seconds
00000100:00100000:1.0:1789431564.348173:0:8217:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf0620e6c0 going to sleep for 11 seconds
00000100:00100000:1.0:1789431564.348204:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8318
00000100:00100000:1.0:1789431564.348224:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3313:x1876351894233600:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:1.0:1789431564.348252:0:14486:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1199 count 1
00010000:00010000:1.0:1789431564.348276:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb635269e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348294:0:14486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb63515f14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3c74 expref: 83 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.348298:0:14490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005ff37435/0xd8e438fb63526976 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348309:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4af:0x0].0x0 since=42s v=(0 0)
00010000:00010000:2.0:1789431564.348310:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ff37435/0xd8e438fb63526976 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348313:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4af:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.348317:0:14486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb635269e6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.348322:0:14490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ff37435/0xd8e438fb63526976 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.348329:0:14490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ff37435/0xd8e438fb63526976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348343:0:14486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb63515f14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3c74 expref: 83 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.348351:0:14490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431564.348354:0:14486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb63515f14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3c74 expref: 83 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.348366:0:14486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14486:1876351894234240:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.348424:0:14486:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ac1ff00 going to sleep for 11 seconds
00010000:00010000:1.0:1789431564.348437:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.348443:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ff37435/0xd8e438fb63526976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348451:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce035cb800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.348455:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ff37435/0xd8e438fb63526976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348464:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ff37435/0xd8e438fb63526976 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348481:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ff37435/0xd8e438fb63526976 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348489:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ff37435/0xd8e438fb63526976 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348509:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.348511:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.348512:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431564.348526:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933511296
00000100:00100000:1.0:1789431564.348532:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933511296
00010000:00010000:1.0:1789431564.348562:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007b412f85/0xd8e438fb6351ea03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c694c expref: 84 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.348582:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16567
00000100:00100000:1.0:1789431564.348589:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+87:2347:x1876351933511680:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.348601:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.348607:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d64bafd/0xd8e438fb63512267 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c29b2 expref: 87 pid: 14471 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348619:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d64bafd/0xd8e438fb63512267 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c29b2 expref: 87 pid: 14471 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348636:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d64bafd/0xd8e438fb63512267 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c29b2 expref: 87 pid: 14471 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348646:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.348649:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.348656:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb635269a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348666:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb635269a7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348690:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.348717:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+86:2347:x1876351933511680:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 128us (5903us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.348745:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16567
00000100:00100000:1.0:1789431564.348764:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16568
00000100:00100000:1.0:1789431564.348772:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:2347:x1876351933511808:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.348781:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.348789:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635268d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dc6 expref: 196 pid: 6797 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.348796:0:14490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+26:3314:x1876351894230272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 34334us (34862us total) trans 4294970020 rc 0/0
00010000:00010000:1.0:1789431564.348800:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635268d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dc6 expref: 196 pid: 6797 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.348804:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8306
00010000:00010000:1.0:1789431564.348815:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce156e0200/0xd8e438fb635268d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dc6 expref: 196 pid: 6797 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348829:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:1.0:1789431564.348836:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63526999 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348846:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63526999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348853:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63526999 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348874:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.348893:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:2347:x1876351933511808:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 123us (4609us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.348899:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16568
00000100:00100000:1.0:1789431564.348912:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16569
00000100:00100000:1.0:1789431564.348919:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+84:2348:x1876351933511296:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.348927:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.348932:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007b412f85/0xd8e438fb6351ea03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c694c expref: 84 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348943:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007b412f85/0xd8e438fb6351ea03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c694c expref: 84 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348956:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b412f85/0xd8e438fb6351ea03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c694c expref: 84 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348966:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.348969:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.348973:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003f99604/0xd8e438fb6352698b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348982:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003f99604/0xd8e438fb6352698b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.348999:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.349022:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+83:2348:x1876351933511296:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 104us (3013us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.349028:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16569
00010000:00010000:1.0:1789431564.349071:0:14500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb635269a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.349080:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb635269a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.349088:0:14500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb635269a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.349096:0:14500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb635269a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.349110:0:14500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1789431564.349248:0:14482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3313:x1876351894228352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 40079us (41684us total) trans 4294969635 rc 0/0
00000100:00100000:2.0:1789431564.349255:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8298
00010000:00010000:2.0:1789431564.349277:0:14501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003f99604/0xd8e438fb6352698b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.349287:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003f99604/0xd8e438fb6352698b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.349296:0:14501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f99604/0xd8e438fb6352698b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.349304:0:14501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003f99604/0xd8e438fb6352698b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.349317:0:14501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:1.0:1789431564.349392:0:14500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+26:3313:x1876351894231552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26483us (26737us total) trans 4294970021 rc 0/0
00000100:00100000:1.0:1789431564.349399:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8309
00010000:00010000:1.0:1789431564.349422:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63526999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.349429:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63526999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.349436:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+28:3312:x1876351894230528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 33022us (34470us total) trans 4294969636 rc 0/0
00000100:00100000:2.0:1789431564.349442:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8307
00000004:00200000:1.0:1789431564.349486:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008f:0x0]: returning size 260096
00000004:00200000:1.0:1789431564.349492:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431564.349518:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63526999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.349555:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca200/0xd8e438fb63526992 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dcd expref: 195 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.349571:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bad0400/0xd8e438fb63526999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dcd expref: 194 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.349580:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008f:0x0].0x0 (ffff90cf22548b00)
00010000:00010000:1.0:1789431564.349583:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431564.349585:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3bad0400, rc 0)
00000100:00100000:1.0:1789431564.349610:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+194:14616:x1876351933509376:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 32717us (33275us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.349617:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296070
00010000:00010000:1.0:1789431564.349641:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1789431564.349646:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb635269a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.349655:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.349659:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb635269a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.349668:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb635269a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.349681:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb635269a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.349689:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb635269a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.349705:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.349709:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003f99604/0xd8e438fb6352698b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.349715:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f897400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.349732:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f99604/0xd8e438fb6352698b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.349740:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f99604/0xd8e438fb6352698b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.349750:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003f99604/0xd8e438fb6352698b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.349758:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003f99604/0xd8e438fb6352698b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.349774:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.349776:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.349778:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:1.0:1789431564.349821:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3c157480/2, rc 0, transno 4294970021
00000100:00100000:1.0:1789431564.349835:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3c157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894231552:0@lo:6:osp-syn-1-0.0
00000004:00080000:1.0:1789431564.349850:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2a7e8a80/2, rc 0, transno 4294969635
00000100:00100000:1.0:1789431564.349863:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894228352:0@lo:6:osp-syn-0-0.0
00010000:00010000:1.0:1789431564.349879:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431564.349942:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894234368:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.349979:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000004:00080000:1.0:1789431564.350043:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce36219c00/2, rc 0, transno 4294970020
00000100:00100000:1.0:1789431564.350077:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce36219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894230272:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.350109:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1789431564.350115:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894234496:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.350139:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431564.350166:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1789431564.350175:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894233856:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.350198:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431564.350225:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894234368
00000100:00100000:1.0:1789431564.350231:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894234368
00000100:00100000:1.0:1789431564.350261:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894234496
00000100:00100000:1.0:1789431564.350264:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894234496
00000100:00100000:1.0:1789431564.350273:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894233856
00000100:00100000:1.0:1789431564.350276:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894233856
00000100:00100000:1.0:1789431564.350291:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8319
00000100:00100000:1.0:1789431564.350298:0:14500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+28:3313:x1876351894234368:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431564.350321:0:14500:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1257 count 1
00010000:00010000:1.0:1789431564.350344:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb635269ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.350368:0:14500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005abd602c/0xd8e438fb63521496 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c76dc expref: 85 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.350378:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4e9:0x0].0x0 since=11s v=(0 0)
00010000:00010000:1.0:1789431564.350382:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.350387:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb635269ed lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.350411:0:14500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005abd602c/0xd8e438fb63521496 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c76dc expref: 85 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.350424:0:14500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005abd602c/0xd8e438fb63521496 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c76dc expref: 85 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.350436:0:14500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:14500:1876351894234624:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.350481:0:14500:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e600 going to sleep for 11 seconds
00000100:00100000:1.0:1789431564.350496:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8320
00000100:00100000:1.0:1789431564.350503:0:14501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+28:3313:x1876351894234496:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431564.350515:0:14501:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1262 count 1
00010000:00010000:1.0:1789431564.350528:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb635269f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.350540:0:14501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000edad4ed/0xd8e438fb63522043 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a94 expref: 85 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.350552:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4ee:0x0].0x0 since=9s v=(0 0)
00010000:00010000:1.0:1789431564.350555:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ee:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.350559:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb635269f4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.350575:0:14501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000edad4ed/0xd8e438fb63522043 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a94 expref: 85 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.350585:0:14501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000edad4ed/0xd8e438fb63522043 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a94 expref: 85 pid: 14499 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.350594:0:14501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14501:1876351894234752:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.350616:0:14501:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065ed80 going to sleep for 11 seconds
00000100:00100000:1.0:1789431564.353642:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8321
00000100:00100000:1.0:1789431564.353665:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3311:x1876351894233856:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:1.0:1789431564.353708:0:14471:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1279 count 1
00010000:00010000:1.0:1789431564.353894:0:14471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635269fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.353922:0:14471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000de606a35/0xd8e438fb635236d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8108 expref: 85 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.353933:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4ff:0x0].0x0 since=6s v=(0 0)
00010000:00010000:1.0:1789431564.353938:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ff:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.353945:0:14471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635269fb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.353988:0:14471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000de606a35/0xd8e438fb635236d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8108 expref: 85 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.354003:0:14471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000de606a35/0xd8e438fb635236d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8108 expref: 85 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.354020:0:14471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14471:1876351894234880:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.354185:0:14471:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e000 going to sleep for 11 seconds
00000100:00100000:1.0:1789431564.354265:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894235008:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431564.354325:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789431564.354366:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894235008
00000100:00100000:1.0:1789431564.354374:0:14490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894235008
00000100:00100000:1.0:1789431564.354411:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8322
00000100:00100000:1.0:1789431564.354418:0:14490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3311:x1876351894235008:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:1.0:1789431564.354436:0:14490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1206 count 1
00010000:00010000:1.0:1789431564.354455:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f84e050/0xd8e438fb63526a02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.354471:0:14490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec015882/0xd8e438fb63517bf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c460d expref: 82 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.354478:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4b6:0x0].0x0 since=37s v=(0 0)
00010000:00010000:1.0:1789431564.354481:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.354486:0:14490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f84e050/0xd8e438fb63526a02 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.354506:0:14490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec015882/0xd8e438fb63517bf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c460d expref: 82 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.354517:0:14490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec015882/0xd8e438fb63517bf4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c460d expref: 82 pid: 14505 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.354528:0:14490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:14490:1876351894235136:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.354561:0:14490:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e9c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431564.354951:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000004:00080000:3.0:1789431564.355577:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce36218e00/2, rc 0, transno 4294969636
00000100:00100000:3.0:1789431564.355598:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce36218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894230528:0@lo:6:osp-syn-0-0.0
00000004:00080000:3.0:1789431564.355614:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2a7e9c00/2, rc 0, transno 4294969634
00000100:00100000:3.0:1789431564.355618:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894228864:0@lo:6:osp-syn-0-0.0
00010000:00010000:0.0:1789431564.355699:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaea9290/0xd8e438fb6351e605 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c67f5 expref: 85 pid: 14469 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.355731:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3c157100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6699:1876351894231424:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431564.355756:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006ca7c869/0xd8e438fb635269a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.355769:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006ca7c869/0xd8e438fb635269a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.355776:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ca7c869/0xd8e438fb635269a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.355790:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ca7c869/0xd8e438fb635269a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.355799:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ca7c869/0xd8e438fb635269a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.355819:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431564.355833:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.355839:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ca7c869/0xd8e438fb635269a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.355849:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.355853:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ca7c869/0xd8e438fb635269a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.355863:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ca7c869/0xd8e438fb635269a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.355887:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ca7c869/0xd8e438fb635269a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.355894:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ca7c869/0xd8e438fb635269a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.355920:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.355922:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.355924:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431564.355938:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894235392:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431564.355988:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431564.356027:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894235264:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431564.356676:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3312:x1876351894231296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 38485us (38577us total) trans 4294970022 rc 0/0
00000100:00100000:0.0:1789431564.356690:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8308
00000100:00100000:1.0:1789431564.359505:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431564.361531:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894233728
00000100:00100000:0.0:1789431564.361558:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894233728
00000100:00100000:0.0:1789431564.361615:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894235392
00000100:00100000:0.0:1789431564.361620:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894235392
00000100:00100000:0.0:1789431564.361650:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8323
00000100:00100000:0.0:1789431564.361662:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3312:x1876351894233728:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431564.361914:0:6699:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1236 count 1
00010000:00010000:0.0:1789431564.361953:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fe21d5f/0xd8e438fb63526a09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.361984:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004a9edf9/0xd8e438fb6351ed8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6a80 expref: 82 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.361995:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4d4:0x0].0x0 since=17s v=(0 0)
00010000:00010000:0.0:1789431564.362002:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.362008:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fe21d5f/0xd8e438fb63526a09 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.362075:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004a9edf9/0xd8e438fb6351ed8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6a80 expref: 82 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.362091:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004a9edf9/0xd8e438fb6351ed8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6a80 expref: 82 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.362108:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3c157100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1876351894235520:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431564.362219:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf030e93c0 going to sleep for 11 seconds
00010000:00010000:0.0:1789431564.364383:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431564.364441:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8324
00000100:00100000:0.0:1789431564.364473:0:14499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+30:3313:x1876351894235392:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431564.364519:0:14499:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1207 count 1
00010000:00010000:0.0:1789431564.364553:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63526a10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.364580:0:14499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000002fd64d4/0xd8e438fb63518000 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c475d expref: 82 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.364591:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4b7:0x0].0x0 since=36s v=(0 0)
00010000:00010000:0.0:1789431564.364596:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.364602:0:14499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63526a10 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.364648:0:14499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000002fd64d4/0xd8e438fb63518000 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c475d expref: 82 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.364664:0:14499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000002fd64d4/0xd8e438fb63518000 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c475d expref: 82 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.364680:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3c155f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:14499:1876351894235648:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431564.364779:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf030e90c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431564.364811:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+84:2347:x1876351933511552:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 19414us (22024us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.364822:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16566
00010000:00010000:0.0:1789431564.364867:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431564.366109:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894235264
00000100:00100000:1.0:1789431564.366126:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894235264
00000100:00100000:1.0:1789431564.366178:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8325
00000100:00100000:1.0:1789431564.366189:0:14482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3312:x1876351894235264:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:1.0:1789431564.366226:0:14482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1238 count 1
00010000:00010000:1.0:1789431564.366256:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b552df83/0xd8e438fb63526a17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.366281:0:14482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000054a10ce/0xd8e438fb6351f103 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6b98 expref: 82 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.366292:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4d6:0x0].0x0 since=17s v=(0 0)
00010000:00010000:1.0:1789431564.366296:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.366301:0:14482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b552df83/0xd8e438fb63526a17 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.366337:0:14482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000054a10ce/0xd8e438fb6351f103 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6b98 expref: 82 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.366352:0:14482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000054a10ce/0xd8e438fb6351f103 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6b98 expref: 82 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.366369:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a045c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14482:1876351894235776:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.366445:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf22256a80 going to sleep for 11 seconds
00000100:00100000:1.0:1789431564.366492:0:14464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14464:1876351894232320:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.366516:0:14464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb635269b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.366544:0:14486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14486:1876351894234240:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.366557:0:14486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb635269e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.366578:0:8217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8217:1876351894233984:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.366589:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6bbf184/0xd8e438fb635269d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.366612:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14468:1876351894232704:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.366624:0:14468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb635269c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00080000:1.0:1789431564.366665:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3c157800/2, rc 0, transno 4294970022
00000100:00100000:1.0:1789431564.366677:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3c157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894231296:0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431564.366754:0:14469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3621b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14469:1876351894232448:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431564.366769:0:14469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb635269bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.366769:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894235904:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.366811:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431564.367095:0:14505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:14505:1876351894233472:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.367106:0:14500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:14500:1876351894234624:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431564.367113:0:14505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054447f51/0xd8e438fb635269ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.367121:0:14500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb635269ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.367136:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:14502:1876351894234112:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431564.367148:0:14502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000090fe46f0/0xd8e438fb635269df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.367209:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894235904
00000100:00100000:2.0:1789431564.367215:0:14491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894235904
00000100:00100000:2.0:1789431564.367359:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8326
00000100:00100000:2.0:1789431564.367374:0:14491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+29:3314:x1876351894235904:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:2.0:1789431564.367399:0:14491:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1201 count 1
00010000:00010000:2.0:1789431564.367421:0:14491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002916db0d/0xd8e438fb63526a1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.367437:0:14491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cfdd6f0b/0xd8e438fb635167bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3f4c expref: 83 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.367445:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4b1:0x0].0x0 since=40s v=(0 0)
00010000:00010000:2.0:1789431564.367449:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.367452:0:14491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002916db0d/0xd8e438fb63526a1e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.367464:0:14472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce0e615f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14472:1876351894233344:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431564.367475:0:14491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cfdd6f0b/0xd8e438fb635167bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3f4c expref: 83 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.367481:0:14472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000019b16bbd/0xd8e438fb635269d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.367486:0:14491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cfdd6f0b/0xd8e438fb635167bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3f4c expref: 83 pid: 14490 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.367498:0:14491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14491:1876351894236032:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.368015:0:14491:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3e6cb240 going to sleep for 11 seconds
00000100:00100000:3.0:1789431564.368314:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.368565:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.368609:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.369702:0:14501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14501:1876351894234752:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431564.369748:0:14501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb635269f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.370366:0:14490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:14490:1876351894235136:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431564.370384:0:14490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f84e050/0xd8e438fb63526a02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.370432:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933511936
00000100:00100000:1.0:1789431564.370443:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933511936
00000100:00100000:2.0:1789431564.370493:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933512064
00010000:00010000:1.0:1789431564.370494:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb6351f945 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6e2a expref: 83 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.370498:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933512064
00010000:00010000:2.0:1789431564.370521:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004976014e/0xd8e438fb6351f6e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6d5f expref: 84 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.370535:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933512192
00000100:00100000:1.0:1789431564.370537:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933512192
00010000:00010000:1.0:1789431564.370555:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb6351f8c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6df9 expref: 84 pid: 14471 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.370556:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16570
00000100:00100000:2.0:1789431564.370565:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e953850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+84:2348:x1876351933511936:12345-192.168.203.4@tcp:103:ldlm_bl.0
00000100:00100000:1.0:1789431564.370575:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16571
00000100:00100000:1.0:1789431564.370581:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e615f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+84:2347:x1876351933512064:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431564.370585:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.370586:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.370592:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004976014e/0xd8e438fb6351f6e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6d5f expref: 84 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.370592:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb6351f945 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6e2a expref: 84 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.370607:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004976014e/0xd8e438fb6351f6e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6d5f expref: 84 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.370607:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb6351f945 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6e2a expref: 84 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.370635:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004976014e/0xd8e438fb6351f6e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6d5f expref: 84 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.370635:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb6351f945 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6e2a expref: 84 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.370654:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.370654:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4db:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.370659:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.370659:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4db:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.370667:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb635269b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.370667:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb635269bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.370678:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb635269b5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.370678:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb635269bc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.370703:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431564.370703:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.370771:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e953850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+82:2348:x1876351933511936:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 206us (2459us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.370778:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16570
00000100:00100000:2.0:1789431564.370840:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16572
00000100:00100000:2.0:1789431564.370848:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+84:2348:x1876351933512192:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431564.370858:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431564.370863:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb6351f8c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6df9 expref: 84 pid: 14471 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.370873:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb6351f8c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6df9 expref: 84 pid: 14471 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.370890:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb6351f8c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6df9 expref: 84 pid: 14471 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.370901:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4da:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.370905:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4da:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.370909:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019b16bbd/0xd8e438fb635269d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.370918:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019b16bbd/0xd8e438fb635269d1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.370939:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.370958:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+83:2348:x1876351933512192:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 111us (2348us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.370965:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16572
00010000:00010000:2.0:1789431564.370992:0:14472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000019b16bbd/0xd8e438fb635269d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.371008:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019b16bbd/0xd8e438fb635269d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.371020:0:14472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019b16bbd/0xd8e438fb635269d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.371029:0:14472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019b16bbd/0xd8e438fb635269d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.371068:0:14472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:1.0:1789431564.371520:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e615f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+81:2347:x1876351933512064:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 936us (2953us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.371528:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16571
00010000:00010000:1.0:1789431564.371695:0:14464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb635269b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.371833:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb635269b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.371847:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb635269b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.371860:0:14472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3312:x1876351894233088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 27119us (27650us total) trans 4294970023 rc 0/0
00000100:00100000:2.0:1789431564.371870:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8315
00010000:00010000:2.0:1789431564.371904:0:14469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb635269bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.371915:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb635269bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.371924:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb635269bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.371932:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb635269bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.371966:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb635269b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.372006:0:14469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool
00000004:00080000:3.0:1789431564.372023:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce156b2300/2, rc 0, transno 4294970023
00000100:00100000:3.0:1789431564.372040:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894233088:0@lo:6:osp-syn-1-0.0
00000100:00100000:2.0:1789431564.372549:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3311:x1876351894232192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 34784us (35028us total) trans 4294969637 rc 0/0
00000100:00100000:2.0:1789431564.372558:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8312
00000004:00080000:3.0:1789431564.372903:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3c155c00/2, rc 0, transno 4294969637
00000100:00100000:3.0:1789431564.372920:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3c155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894232192:0@lo:6:osp-syn-0-0.0
00010000:00010000:0.0:1789431564.373221:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp.  (2 blwis in pool)
00010000:00010000:1.0:1789431564.373438:0:14464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:1.0:1789431564.375297:0:14464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3311:x1876351894232064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 37688us (37830us total) trans 4294969638 rc 0/0
00000100:00100000:1.0:1789431564.375310:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8311
00010000:00010000:1.0:1789431564.376095:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:0.0:1789431564.376100:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019b16bbd/0xd8e438fb635269d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.376108:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb635269bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.376153:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b275a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.376155:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e0000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431564.376169:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019b16bbd/0xd8e438fb635269d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.376169:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb635269bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.376227:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019b16bbd/0xd8e438fb635269d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.376228:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb635269bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.376278:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb635269bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.376283:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019b16bbd/0xd8e438fb635269d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.376308:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5bad049/0xd8e438fb635269bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.376354:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019b16bbd/0xd8e438fb635269d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.376380:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.376387:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb635269b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.376391:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431564.376396:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.376401:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce19859200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431564.376402:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.376410:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb635269b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.376427:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb635269b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.376439:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb635269b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.376446:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb635269b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.376468:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.376472:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.376476:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431564.376581:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894236160:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.376639:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000004:00080000:1.0:1789431564.376796:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3c155180/2, rc 0, transno 4294969638
00000100:00100000:1.0:1789431564.376805:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3c155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894232064:0@lo:6:osp-syn-0-0.0
00010000:00010000:2.0:1789431564.376903:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431564.376947:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.377163:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.377227:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.377262:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933512448
00000100:00100000:1.0:1789431564.377269:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933512448
00010000:00010000:1.0:1789431564.377308:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021b8b20c/0xd8e438fb635223df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b90 expref: 83 pid: 14468 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.377344:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933512704
00000100:00100000:1.0:1789431564.377349:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933512704
00000100:00100000:2.0:1789431564.377361:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933512960
00010000:00010000:1.0:1789431564.377370:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb63515f14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3c74 expref: 81 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.377371:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933512960
00000100:00100000:1.0:1789431564.377405:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16573
00010000:00010000:2.0:1789431564.377415:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e230ba3/0xd8e438fb63521b0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c78fe expref: 82 pid: 14469 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.377426:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+83:2348:x1876351933512448:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.377452:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.377461:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021b8b20c/0xd8e438fb635223df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b90 expref: 83 pid: 14468 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.377475:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16574
00010000:00010000:1.0:1789431564.377478:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021b8b20c/0xd8e438fb635223df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b90 expref: 83 pid: 14468 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.377492:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+82:2348:x1876351933512704:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.377513:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021b8b20c/0xd8e438fb635223df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7b90 expref: 83 pid: 14468 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.377513:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431564.377527:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb63515f14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3c74 expref: 82 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.377535:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ef:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.377542:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ef:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.377545:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb63515f14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3c74 expref: 82 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.377552:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090fe46f0/0xd8e438fb635269df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.377568:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090fe46f0/0xd8e438fb635269df lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.377580:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb63515f14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3c74 expref: 82 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.377602:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4af:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.377606:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4af:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.377608:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431564.377612:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb635269e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.377625:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb635269e6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.377661:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.377669:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+82:2348:x1876351933512448:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 250us (721us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.377683:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16573
00000100:00100000:2.0:1789431564.377714:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+81:2348:x1876351933512704:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 223us (547us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.377787:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16575
00000100:00100000:1.0:1789431564.377805:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+81:2348:x1876351933512960:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.377817:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.377824:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e230ba3/0xd8e438fb63521b0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c78fe expref: 81 pid: 14469 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.377835:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16574
00010000:00010000:1.0:1789431564.377849:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e230ba3/0xd8e438fb63521b0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c78fe expref: 81 pid: 14469 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.377879:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894236288:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431564.377936:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1789431564.377951:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e230ba3/0xd8e438fb63521b0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c78fe expref: 80 pid: 14469 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.378519:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894236160
00000100:00100000:0.0:1789431564.378530:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894236160
00000100:00100000:0.0:1789431564.378573:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894236288
00000100:00100000:0.0:1789431564.378576:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894236288
00000100:00100000:0.0:1789431564.378606:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8327
00000100:00100000:0.0:1789431564.378615:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3311:x1876351894236160:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431564.378647:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1248 count 1
00010000:00010000:0.0:1789431564.378678:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63526a25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.378698:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9c6cd14/0xd8e438fb6352039b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7179 expref: 81 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.378707:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4e0:0x0].0x0 since=13s v=(0 0)
00010000:00010000:0.0:1789431564.378711:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.378716:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63526a25 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.378757:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9c6cd14/0xd8e438fb6352039b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7179 expref: 81 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.378775:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9c6cd14/0xd8e438fb6352039b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7179 expref: 81 pid: 14469 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.378789:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3621aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1876351894236544:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431564.378858:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf030e9780 going to sleep for 11 seconds
00010000:00010000:1.0:1789431564.380235:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ec:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.380245:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ec:0x0].0x0 since=0s v=(1 0)
00000100:00100000:0.0:1789431564.380252:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00010000:00010000:1.0:1789431564.380256:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb635269c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.380273:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb635269c3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.380290:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894236416:0@lo:6:osp-syn-0-0.0
00010000:00010000:1.0:1789431564.380321:0:14502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000090fe46f0/0xd8e438fb635269df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.380332:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090fe46f0/0xd8e438fb635269df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.380344:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090fe46f0/0xd8e438fb635269df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.380352:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090fe46f0/0xd8e438fb635269df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.380380:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1789431564.380382:0:14502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431564.380495:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.380587:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.380636:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.380705:0:14502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+31:3313:x1876351894233216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 33818us (34097us total) trans 4294970024 rc 0/0
00000100:00100000:0.0:1789431564.380772:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.380830:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.380843:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.380854:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.380947:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3c157100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1876351894235520:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431564.380983:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000fe21d5f/0xd8e438fb63526a09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.381016:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3c155f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:14499:1876351894235648:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431564.381037:0:14499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63526a10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.381088:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933512320
00000100:00100000:0.0:1789431564.381096:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933512320
00010000:00010000:0.0:1789431564.381136:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dff3304a/0xd8e438fb63513a23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c30f8 expref: 82 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.381161:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933512576
00000100:00100000:0.0:1789431564.381164:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933512576
00010000:00010000:0.0:1789431564.381176:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c473188f/0xd8e438fb6351eb4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c69b5 expref: 83 pid: 14472 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.381187:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933512832
00000100:00100000:0.0:1789431564.381189:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933512832
00010000:00010000:0.0:1789431564.381200:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005abd602c/0xd8e438fb63521496 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c76dc expref: 84 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.381211:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933513088
00000100:00100000:0.0:1789431564.381213:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933513088
00010000:00010000:0.0:1789431564.381226:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000edad4ed/0xd8e438fb63522043 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a94 expref: 85 pid: 14499 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.381236:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933513216
00000100:00100000:0.0:1789431564.381238:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933513216
00010000:00010000:0.0:1789431564.381253:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec015882/0xd8e438fb63517bf4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c460d expref: 80 pid: 14505 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.381264:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933513472
00000100:00100000:0.0:1789431564.381267:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933513472
00010000:00010000:0.0:1789431564.381278:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004a9edf9/0xd8e438fb6351ed8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6a80 expref: 81 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.381288:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933513344
00000100:00100000:0.0:1789431564.381290:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933513344
00010000:00010000:0.0:1789431564.381300:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000de606a35/0xd8e438fb635236d9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8108 expref: 86 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.381316:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16576
00000100:00100000:0.0:1789431564.381324:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+86:2348:x1876351933512320:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431564.381342:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431564.381348:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dff3304a/0xd8e438fb63513a23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c30f8 expref: 86 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381362:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dff3304a/0xd8e438fb63513a23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c30f8 expref: 86 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381389:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dff3304a/0xd8e438fb63513a23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c30f8 expref: 86 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381407:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.381412:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.381419:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054447f51/0xd8e438fb635269ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381429:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054447f51/0xd8e438fb635269ca lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381455:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431564.381503:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+85:2348:x1876351933512320:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 179us (1011us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.381514:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16576
00000100:00100000:0.0:1789431564.381535:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16577
00000100:00100000:0.0:1789431564.381542:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e950050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+84:2348:x1876351933512576:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431564.381549:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431564.381554:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c473188f/0xd8e438fb6351eb4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c69b5 expref: 84 pid: 14472 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381565:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c473188f/0xd8e438fb6351eb4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c69b5 expref: 84 pid: 14472 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381578:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c473188f/0xd8e438fb6351eb4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c69b5 expref: 84 pid: 14472 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381591:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4d2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.381594:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4d2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.381598:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6bbf184/0xd8e438fb635269d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381606:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6bbf184/0xd8e438fb635269d8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381627:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431564.381646:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e950050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+83:2348:x1876351933512576:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 104us (1061us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.381652:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16577
00000100:00100000:0.0:1789431564.381666:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16578
00000100:00100000:0.0:1789431564.381673:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+82:2348:x1876351933512832:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431564.381680:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431564.381685:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005abd602c/0xd8e438fb63521496 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c76dc expref: 82 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381697:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005abd602c/0xd8e438fb63521496 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c76dc expref: 82 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381710:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005abd602c/0xd8e438fb63521496 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c76dc expref: 82 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381734:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.381738:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.381742:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb635269ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381750:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb635269ed lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381769:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431564.381788:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+81:2348:x1876351933512832:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 115us (1153us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.381795:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16578
00000100:00100000:0.0:1789431564.381811:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16579
00000100:00100000:0.0:1789431564.381823:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+80:2348:x1876351933513088:12345-192.168.203.4@tcp:103:ldlm_bl.0
00000100:00100000:1.0:1789431564.381827:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8316
00010000:00010000:0.0:1789431564.381836:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431564.381844:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000edad4ed/0xd8e438fb63522043 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a94 expref: 80 pid: 14499 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381857:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000edad4ed/0xd8e438fb63522043 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a94 expref: 80 pid: 14499 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381871:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000edad4ed/0xd8e438fb63522043 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7a94 expref: 80 pid: 14499 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.381877:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894236416
00010000:00010000:0.0:1789431564.381883:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ee:0x0].0x0 since=0s v=(1 0)
00000100:00100000:1.0:1789431564.381888:0:14502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894236416
00010000:00010000:0.0:1789431564.381889:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ee:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.381897:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb635269f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381905:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb635269f4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.381930:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.381932:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8328
00000100:00100000:1.0:1789431564.381946:0:14502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+33:3312:x1876351894236288:12345-0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431564.381958:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+79:2348:x1876351933513088:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 136us (1184us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.381967:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16579
00000100:00100000:0.0:1789431564.381988:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16580
00000100:00100000:0.0:1789431564.381997:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+81:2347:x1876351933513216:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431564.382006:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431564.382013:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec015882/0xd8e438fb63517bf4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c460d expref: 81 pid: 14505 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382023:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec015882/0xd8e438fb63517bf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c460d expref: 81 pid: 14505 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00080000:1.0:1789431564.382038:0:14502:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1237 count 1
00010000:00010000:0.0:1789431564.382040:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec015882/0xd8e438fb63517bf4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c460d expref: 81 pid: 14505 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382085:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.382087:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000babb468b/0xd8e438fb63526a2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382093:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.382104:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f84e050/0xd8e438fb63526a02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382122:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f84e050/0xd8e438fb63526a02 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.382131:0:14502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d27ff86/0xd8e438fb6351efac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6b28 expref: 80 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.382145:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4d5:0x0].0x0 since=17s v=(0 0)
00010000:00010000:0.0:1789431564.382148:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431564.382149:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.382157:0:14502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000babb468b/0xd8e438fb63526a2c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.382174:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+80:2347:x1876351933513216:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 175us (1340us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.382182:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16580
00000100:00100000:0.0:1789431564.382198:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16581
00000100:00100000:0.0:1789431564.382206:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+79:2348:x1876351933513472:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431564.382215:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431564.382220:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004a9edf9/0xd8e438fb6351ed8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6a80 expref: 79 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382238:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004a9edf9/0xd8e438fb6351ed8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6a80 expref: 79 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382252:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004a9edf9/0xd8e438fb6351ed8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6a80 expref: 79 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382263:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.382266:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.382271:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000fe21d5f/0xd8e438fb63526a09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382278:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fe21d5f/0xd8e438fb63526a09 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382296:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431564.382315:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+78:2348:x1876351933513472:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 110us (1470us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.382322:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16581
00000100:00100000:0.0:1789431564.382336:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16582
00000100:00100000:0.0:1789431564.382342:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+78:2347:x1876351933513344:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431564.382350:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431564.382355:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000de606a35/0xd8e438fb635236d9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8108 expref: 78 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382372:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000de606a35/0xd8e438fb635236d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8108 expref: 78 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382384:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ff:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.382388:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ff:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.382391:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635269fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382399:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635269fb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382410:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431564.382427:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+78:2347:x1876351933513344:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 85us (1571us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.382433:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16582
00010000:00010000:0.0:1789431564.382460:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000fe21d5f/0xd8e438fb63526a09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382471:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fe21d5f/0xd8e438fb63526a09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382482:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fe21d5f/0xd8e438fb63526a09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382492:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fe21d5f/0xd8e438fb63526a09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382511:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:0.0:1789431564.382831:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3312:x1876351894233728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21171us (27879us total) trans 4294969639 rc 0/0
00000100:00100000:0.0:1789431564.382840:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8323
00000100:00100000:0.0:1789431564.382860:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8329
00000100:00100000:0.0:1789431564.382868:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3314:x1876351894236416:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431564.382888:0:6699:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1247 count 1
00010000:00010000:0.0:1789431564.382910:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63526a33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382925:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac650f25/0xd8e438fb6352020c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c70ed expref: 77 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382934:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4df:0x0].0x0 since=13s v=(0 0)
00010000:00010000:0.0:1789431564.382938:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4df:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.382941:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63526a33 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382977:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac650f25/0xd8e438fb6352020c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c70ed expref: 77 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.382992:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac650f25/0xd8e438fb6352020c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c70ed expref: 77 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.383008:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3c155f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1876351894236672:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431564.383087:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf030e93c0 going to sleep for 11 seconds
00010000:00010000:0.0:1789431564.383109:0:14501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb635269f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.383120:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb635269f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.383130:0:14501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb635269f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.383138:0:14501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb635269f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.383159:0:14501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool
00000100:00100000:0.0:1789431564.383557:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+31:3313:x1876351894234496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 33053us (33415us total) trans 4294970025 rc 0/0
00000100:00100000:0.0:1789431564.383566:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8320
00010000:00010000:0.0:1789431564.383594:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp.  (2 blwis in pool)
00010000:00010000:0.0:1789431564.383602:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090fe46f0/0xd8e438fb635269df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.383612:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e75600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431564.383618:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090fe46f0/0xd8e438fb635269df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.383630:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090fe46f0/0xd8e438fb635269df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.383649:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090fe46f0/0xd8e438fb635269df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.383658:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090fe46f0/0xd8e438fb635269df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.383680:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:0.0:1789431564.383684:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fe21d5f/0xd8e438fb63526a09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.383690:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e1800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431564.383694:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fe21d5f/0xd8e438fb63526a09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.383701:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fe21d5f/0xd8e438fb63526a09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.383712:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fe21d5f/0xd8e438fb63526a09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.384744:0:14502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d27ff86/0xd8e438fb6351efac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6b28 expref: 77 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.384771:0:14502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d27ff86/0xd8e438fb6351efac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6b28 expref: 77 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.384789:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a045f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:14502:1876351894236800:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431564.384853:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065ed80 going to sleep for 11 seconds
00010000:00010000:1.0:1789431564.384887:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.384895:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb635269f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.384904:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.384909:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb635269f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.384920:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb635269f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.384942:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb635269f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.384949:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043e0f543/0xd8e438fb635269f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.384964:0:14505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054447f51/0xd8e438fb635269ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.384981:0:14505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054447f51/0xd8e438fb635269ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.384982:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.384986:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.384990:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431564.385003:0:14505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054447f51/0xd8e438fb635269ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.385014:0:14505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054447f51/0xd8e438fb635269ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.385025:0:14486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb635269e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.385038:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb635269e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.385071:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb635269e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.385077:0:14505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431564.385081:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb635269e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.385111:0:14486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:1.0:1789431564.385580:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+34:3313:x1876351894233600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 37365us (38827us total) trans 4294969640 rc 0/0
00000100:00100000:1.0:1789431564.385592:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8318
00010000:00010000:1.0:1789431564.385627:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1789431564.385632:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054447f51/0xd8e438fb635269ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.385640:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0f896600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.385645:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054447f51/0xd8e438fb635269ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.385654:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054447f51/0xd8e438fb635269ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.385668:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054447f51/0xd8e438fb635269ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.385676:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054447f51/0xd8e438fb635269ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.385699:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.385704:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb635269e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.385712:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01520200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.385716:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb635269e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.385734:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb635269e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.385749:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb635269e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.385757:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017a8e0de/0xd8e438fb635269e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.385781:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.385783:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.385785:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.385799:0:14500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb635269ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.385808:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb635269ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.385818:0:14500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb635269ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.385827:0:14500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb635269ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.385846:0:14500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000001:00080000:3.0:1789431564.386039:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970006 is committed
00000001:00080000:3.0:1789431564.386160:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970008 is committed
00000001:00080000:3.0:1789431564.386180:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970004 is committed
00000001:00080000:3.0:1789431564.386201:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970005 is committed
00000100:00100000:1.0:1789431564.386238:0:14500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+29:3313:x1876351894234368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 35937us (36256us total) trans 4294970027 rc 0/0
00000100:00100000:1.0:1789431564.386246:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8319
00010000:00010000:1.0:1789431564.386269:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.386273:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb635269ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.386279:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.386282:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb635269ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.386290:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb635269ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.386304:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb635269ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.386312:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb635269ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.386315:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.386336:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.386340:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.386342:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431564.386415:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+28:3312:x1876351894232960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 41720us (42536us total) trans 4294970026 rc 0/0
00000100:00100000:2.0:1789431564.386428:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8314
00010000:00010000:1.0:1789431564.386566:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6bbf184/0xd8e438fb635269d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.386579:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6bbf184/0xd8e438fb635269d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.386589:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6bbf184/0xd8e438fb635269d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.386598:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6bbf184/0xd8e438fb635269d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.386619:0:8217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000004:00080000:2.0:1789431564.386786:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce36219880/2, rc 0, transno 4294969639
00000100:00100000:2.0:1789431564.386814:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce36219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894233728:0@lo:6:osp-syn-0-0.0
00000004:00080000:2.0:1789431564.386833:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce156b2680/2, rc 0, transno 4294970026
00000100:00100000:2.0:1789431564.386848:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894232960:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.387330:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3313:x1876351894232832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 40433us (40627us total) trans 4294970028 rc 0/0
00000100:00100000:1.0:1789431564.387343:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8317
00000100:00100000:2.0:1789431564.387358:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0e617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894236928:0@lo:6:osp-syn-0-0.0
00010000:00010000:1.0:1789431564.387373:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.387382:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6bbf184/0xd8e438fb635269d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.387391:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce19858800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.387395:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6bbf184/0xd8e438fb635269d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.387404:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6bbf184/0xd8e438fb635269d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.387420:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6bbf184/0xd8e438fb635269d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.387435:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1789431564.387445:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6bbf184/0xd8e438fb635269d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.387469:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.387471:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.387474:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431564.387521:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894236928
00000100:00100000:1.0:1789431564.387528:0:14464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894236928
00000100:00100000:1.0:1789431564.387572:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8330
00000100:00100000:1.0:1789431564.387581:0:14464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3314:x1876351894236928:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:1.0:1789431564.387604:0:14464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1244 count 1
00010000:00010000:1.0:1789431564.387626:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000640d8a5c/0xd8e438fb63526a3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.387644:0:14464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb6351fbc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6ed9 expref: 77 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.387656:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fe21d5f/0xd8e438fb63526a09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.387657:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4dc:0x0].0x0 since=15s v=(0 0)
00010000:00010000:1.0:1789431564.387672:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4dc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.387692:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000640d8a5c/0xd8e438fb63526a3a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.387712:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431564.387717:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431564.387733:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.387736:0:14464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb6351fbc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6ed9 expref: 77 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.387753:0:14464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb6351fbc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6ed9 expref: 77 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.387769:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a047b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14464:1876351894237056:192.168.203.4@tcp:104:
00000004:00080000:0.0:1789431564.387774:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1ac75f80/2, rc 0, transno 4294970025
00000100:00100000:0.0:1789431564.387833:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894234496:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.387855:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e600 going to sleep for 11 seconds
00000100:00100000:0.0:1789431564.387857:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294970008 gen 2
00000004:00080000:0.0:1789431564.387865:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce156b0700, transno 4294970006
00000100:00100000:3.0:1789431564.388558:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.388583:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.388600:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.388618:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.388824:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933513600
00000100:00100000:1.0:1789431564.388831:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933513600
00010000:00010000:1.0:1789431564.388858:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000054a10ce/0xd8e438fb6351f103 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6b98 expref: 78 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.388944:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933513728
00000100:00100000:1.0:1789431564.388948:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933513728
00010000:00010000:1.0:1789431564.388962:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cfdd6f0b/0xd8e438fb635167bf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3f4c expref: 74 pid: 14490 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.388985:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933513856
00000100:00100000:1.0:1789431564.388988:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933513856
00010000:00010000:1.0:1789431564.388999:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000002fd64d4/0xd8e438fb63518000 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c475d expref: 79 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.389018:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16583
00000100:00100000:1.0:1789431564.389026:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+79:2347:x1876351933513600:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.389038:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.389043:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000054a10ce/0xd8e438fb6351f103 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6b98 expref: 79 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.389072:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000054a10ce/0xd8e438fb6351f103 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6b98 expref: 79 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.389091:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.389095:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.389100:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b552df83/0xd8e438fb63526a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.389110:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b552df83/0xd8e438fb63526a17 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.389127:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.389164:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+79:2347:x1876351933513600:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 138us (608us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.389173:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16583
00000100:00100000:1.0:1789431564.389189:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16584
00000100:00100000:1.0:1789431564.389196:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e950c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2347:x1876351933513728:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.389204:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.389209:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cfdd6f0b/0xd8e438fb635167bf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3f4c expref: 74 pid: 14490 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.389219:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cfdd6f0b/0xd8e438fb635167bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3f4c expref: 74 pid: 14490 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.389231:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.389235:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.389239:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002916db0d/0xd8e438fb63526a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.389246:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002916db0d/0xd8e438fb63526a1e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.389351:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16585
00000100:00100000:3.0:1789431564.389362:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e615c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+78:2348:x1876351933513856:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431564.389370:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431564.389375:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000002fd64d4/0xd8e438fb63518000 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c475d expref: 78 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.389385:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000002fd64d4/0xd8e438fb63518000 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c475d expref: 78 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.389399:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002fd64d4/0xd8e438fb63518000 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c475d expref: 78 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.389412:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431564.389415:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431564.389419:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63526a10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.389426:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63526a10 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.389444:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431564.389465:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e615c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+77:2348:x1876351933513856:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 106us (863us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431564.389471:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16585
00010000:00010000:1.0:1789431564.389926:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.389999:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e950c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2347:x1876351933513728:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 803us (1413us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.390008:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16584
00010000:00010000:1.0:1789431564.390139:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de606a35/0xd8e438fb635236d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8108 expref: 73 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.390178:0:14471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14471:1876351894234880:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.390203:0:14471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635269fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.390215:0:14471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635269fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.390222:0:14471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635269fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.390232:0:14471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635269fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.390242:0:14471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635269fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.390267:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933513984
00010000:00010000:1.0:1789431564.390271:0:14471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1789431564.390294:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933513984
00000100:00100000:2.0:1789431564.390366:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296071
00000100:00100000:2.0:1789431564.390378:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+194:14616:x1876351933513984:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431564.390402:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431564.390432:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74000/0xd8e438fb63526a41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8dd4 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.390517:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e75a00/0xd8e438fb63526a48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.390535:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e75a00/0xd8e438fb63526a48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.390549:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e75a00/0xd8e438fb63526a48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.390573:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63526a4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.390582:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63526a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.390596:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63526a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.390811:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3311:x1876351894233856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 37153us (40607us total) trans 4294970029 rc 0/0
00000100:00100000:1.0:1789431564.390820:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8321
00010000:00010000:2.0:1789431564.390849:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e75a00/0xd8e438fb63526a48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.390858:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431564.390859:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e75a00/0xd8e438fb63526a48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.390873:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e75a00/0xd8e438fb63526a48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.390877:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635269fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.390883:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e75a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431564.390890:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e75a00/0xd8e438fb63526a48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.390924:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e75a00/0xd8e438fb63526a48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.390926:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ace00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.390936:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635269fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.390948:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431564.390952:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635269fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.390955:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431564.390964:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e75a00/0xd8e438fb63526a48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.390973:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e75a00/0xd8e438fb63526a48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.390989:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63526a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.390994:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635269fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.390997:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63526a4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.391026:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63526a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.391031:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b43bd3ce/0xd8e438fb635269fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.391039:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e74a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431564.391092:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63526a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.391103:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431564.391103:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63526a4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.391108:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.391112:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431564.391121:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf13195b00)
00010000:00010000:1.0:1789431564.391124:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431564.391127:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431564.391133:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63526a4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.391140:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74a00/0xd8e438fb63526a4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.391185:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74000/0xd8e438fb63526a41 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dd4 expref: 195 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.391196:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431564.391198:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431564.391203:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37e74000/0xd8e438fb63526a41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dd4 expref: 195 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.391213:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37e74000, rc 0)
00000100:00100000:2.0:1789431564.391269:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+194:14616:x1876351933513984:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 894us (2649us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431564.391277:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296071
00010000:00010000:2.0:1789431564.391347:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfdd6f0b/0xd8e438fb635167bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3f4c expref: 72 pid: 14490 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.391361:0:14491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14491:1876351894236032:192.168.203.4@tcp:104:
00000004:00080000:0.0:1789431564.391592:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce156b1f80, transno 4294970007
00000004:00080000:0.0:1789431564.391599:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf37e3f800, transno 4294970008
00000100:00100000:0.0:1789431564.391609:0:3313:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search  req@ffff90ce156b0a80 x1876351894224896/t4294970009(4294970009) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789431580 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295
00000004:00080000:0.0:1789431564.391622:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1ac74e00/2, rc 0, transno 4294970027
00000100:00100000:0.0:1789431564.391629:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894234368:0@lo:6:osp-syn-1-0.0
00000004:00080000:0.0:1789431564.391655:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce156b0380/2, rc 0, transno 4294970028
00000100:00100000:0.0:1789431564.391659:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894232832:0@lo:6:osp-syn-1-0.0
00000004:00080000:0.0:1789431564.391674:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce36219500/2, rc 0, transno 4294969640
00000100:00100000:0.0:1789431564.391688:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce36219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894233600:0@lo:6:osp-syn-0-0.0
00000004:00080000:0.0:1789431564.391700:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce156b2d80/2, rc 0, transno 4294970024
00000100:00100000:0.0:1789431564.391703:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894233216:0@lo:6:osp-syn-1-0.0
00010000:00010000:0.0:1789431564.391744:0:14499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63526a10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.391756:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63526a10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.391767:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63526a10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.391782:0:14499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63526a10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.391803:0:14499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431564.391956:0:14491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002916db0d/0xd8e438fb63526a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.392209:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1789431564.392233:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0e616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894237184:0@lo:6:osp-syn-0-0.0
00010000:00010000:2.0:1789431564.392251:0:14491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002916db0d/0xd8e438fb63526a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.392264:0:14491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002916db0d/0xd8e438fb63526a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.392275:0:14491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002916db0d/0xd8e438fb63526a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.392294:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431564.392716:0:14499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+35:3313:x1876351894235392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28258us (36722us total) trans 4294969641 rc 0/0
00010000:00010000:2.0:1789431564.392870:0:14491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002916db0d/0xd8e438fb63526a1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.392893:0:14491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:2.0:1789431564.392910:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:2.0:1789431564.392918:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63526a10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.392933:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce156e1a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431564.392937:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63526a10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.392948:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63526a10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.392970:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63526a10 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.392979:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029307d8a/0xd8e438fb63526a10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.393004:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431564.393008:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002916db0d/0xd8e438fb63526a1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.393015:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37e74200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431564.393018:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002916db0d/0xd8e438fb63526a1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.393025:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002916db0d/0xd8e438fb63526a1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.393035:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002916db0d/0xd8e438fb63526a1e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.393043:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002916db0d/0xd8e438fb63526a1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.393092:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431564.393095:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431564.393097:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431564.393169:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8324
00000100:00100000:0.0:1789431564.393206:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894237184
00000100:00100000:0.0:1789431564.393216:0:14499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894237184
00000100:00100000:0.0:1789431564.393429:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8331
00000100:00100000:0.0:1789431564.393444:0:14499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+35:3312:x1876351894237184:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431564.393481:0:14499:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1245 count 1
00010000:00010000:0.0:1789431564.393509:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb63526a56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.393532:0:14499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058b06dbd/0xd8e438fb6351fdcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6f88 expref: 76 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.393543:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4dd:0x0].0x0 since=14s v=(0 0)
00010000:00010000:0.0:1789431564.393549:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4dd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431564.393555:0:14499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb63526a56 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.393598:0:14499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058b06dbd/0xd8e438fb6351fdcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6f88 expref: 76 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.393616:0:14491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+28:3314:x1876351894235904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26232us (26791us total) trans 4294970030 rc 0/0
00010000:00010000:0.0:1789431564.393654:0:14499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058b06dbd/0xd8e438fb6351fdcf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6f88 expref: 76 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.393659:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8326
00000100:00100000:0.0:1789431564.393685:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3c157100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:14499:1876351894237312:192.168.203.4@tcp:104:
00000004:00080000:3.0:1789431564.393813:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce3a046d80/2, rc 0, transno 4294970030
00000100:00100000:3.0:1789431564.393830:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894235904:0@lo:6:osp-syn-1-0.0
00010000:00010000:1.0:1789431564.398505:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:2.0:1789431564.398549:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1ac76680/2, rc 0, transno 4294970029
00010000:00010000:1.0:1789431564.398579:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000054a10ce/0xd8e438fb6351f103 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6b98 expref: 76 pid: 14464 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.398589:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894233856:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431564.398623:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a045c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14482:1876351894235776:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431564.398638:0:14490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f84e050/0xd8e438fb63526a02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.398653:0:14482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b552df83/0xd8e438fb63526a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.398655:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f84e050/0xd8e438fb63526a02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.398695:0:14490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f84e050/0xd8e438fb63526a02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.398717:0:14482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b552df83/0xd8e438fb63526a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.398730:0:14490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f84e050/0xd8e438fb63526a02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.398750:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b552df83/0xd8e438fb63526a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.398763:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b552df83/0xd8e438fb63526a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.398769:0:14490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431564.398771:0:14482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b552df83/0xd8e438fb63526a17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.398804:0:14482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:3.0:1789431564.399417:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3621aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1876351894236544:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.399446:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63526a25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.399684:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf030e90c0 going to sleep for 11 seconds
00000004:00080000:0.0:1789431564.399748:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1ac77480/2, rc 0, transno 4294969641
00000100:00100000:0.0:1789431564.399763:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894235392:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431564.399922:0:14482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3312:x1876351894235264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 33673us (40367us total) trans 4294969643 rc 0/0
00000100:00100000:1.0:1789431564.399935:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8325
00010000:00010000:1.0:1789431564.399969:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1789431564.399976:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f84e050/0xd8e438fb63526a02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.399986:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00031400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.399990:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f84e050/0xd8e438fb63526a02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.400000:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f84e050/0xd8e438fb63526a02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.400019:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f84e050/0xd8e438fb63526a02 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.400026:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f84e050/0xd8e438fb63526a02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.400069:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.400074:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b552df83/0xd8e438fb63526a17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.400081:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00030e00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.400084:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b552df83/0xd8e438fb63526a17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.400091:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b552df83/0xd8e438fb63526a17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.400101:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b552df83/0xd8e438fb63526a17 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.400109:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b552df83/0xd8e438fb63526a17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.400123:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.400124:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.400127:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.400133:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431564.400332:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.400485:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2350:x1876351933508864:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 108014us (109884us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.400494:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8292
00010000:00010000:1.0:1789431564.400625:0:14468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb635269c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.400635:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb635269c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.400646:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb635269c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.400654:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb635269c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.400681:0:14468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000004:00080000:3.0:1789431564.400709:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1ac75c00/2, rc 0, transno 4294969642
00000100:00100000:3.0:1789431564.400736:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894235008:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431564.400743:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1789431564.400761:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0e614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894237440:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431564.400886:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+75:2348:x1876351933512960:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 23083us (23657us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.400898:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16575
00000100:00100000:2.0:1789431564.401109:0:14490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3311:x1876351894235008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 46688us (46781us total) trans 4294969642 rc 0/0
00000100:00100000:2.0:1789431564.401121:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8322
00000100:00100000:0.0:1789431564.401411:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.401476:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933514112
00000100:00100000:2.0:1789431564.401485:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933514112
00010000:00010000:2.0:1789431564.401528:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c6cd14/0xd8e438fb6352039b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7179 expref: 71 pid: 14469 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.401571:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16586
00000100:00100000:1.0:1789431564.401579:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3313:x1876351894232576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 60164us (60283us total) trans 4294969644 rc 0/0
00000100:00100000:2.0:1789431564.401590:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2347:x1876351933514112:12345-192.168.203.4@tcp:103:ldlm_bl.0
00000100:00100000:1.0:1789431564.401597:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8313
00010000:00010000:2.0:1789431564.401612:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431564.401622:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9c6cd14/0xd8e438fb6352039b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7179 expref: 71 pid: 14469 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.401639:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9c6cd14/0xd8e438fb6352039b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7179 expref: 71 pid: 14469 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.401669:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9c6cd14/0xd8e438fb6352039b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c7179 expref: 71 pid: 14469 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.401691:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.401697:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.401704:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63526a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.401717:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63526a25 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.401757:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.401791:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2347:x1876351933514112:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 206us (383us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.401801:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16586
00010000:00010000:1.0:1789431564.401820:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.401830:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb635269c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.401840:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce19858a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.401843:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb635269c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.401854:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb635269c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.401940:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb635269c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.401951:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f97892ae/0xd8e438fb635269c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.402131:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.402157:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.402178:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.402206:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000004:00080000:0.0:1789431564.402259:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1ac74000/2, rc 0, transno 4294969643
00000100:00100000:0.0:1789431564.402268:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894235264:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431564.402421:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933514368
00000100:00100000:2.0:1789431564.402427:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933514368
00010000:00010000:2.0:1789431564.402451:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d27ff86/0xd8e438fb6351efac lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6b28 expref: 75 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.402482:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933514240
00000100:00100000:2.0:1789431564.402486:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933514240
00010000:00010000:2.0:1789431564.402499:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac650f25/0xd8e438fb6352020c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c70ed expref: 76 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.402518:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933514496
00000100:00100000:2.0:1789431564.402520:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933514496
00010000:00010000:2.0:1789431564.402533:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb6351fbc2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6ed9 expref: 77 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.402551:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16587
00000100:00100000:2.0:1789431564.402559:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+77:2348:x1876351933514368:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431564.402571:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431564.402576:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d27ff86/0xd8e438fb6351efac lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6b28 expref: 77 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.402588:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d27ff86/0xd8e438fb6351efac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6b28 expref: 77 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.402609:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.402613:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.402619:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000babb468b/0xd8e438fb63526a2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.402628:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000babb468b/0xd8e438fb63526a2c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.402644:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.402682:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+77:2348:x1876351933514368:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 123us (552us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.402690:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16587
00000100:00100000:2.0:1789431564.402705:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16588
00000100:00100000:2.0:1789431564.402712:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+76:2347:x1876351933514240:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.403166:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.403171:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.403173:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.403234:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d27ff86/0xd8e438fb6351efac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6b28 expref: 76 pid: 14501 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.403358:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a045f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:14502:1876351894236800:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.403383:0:14502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000babb468b/0xd8e438fb63526a2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.403394:0:14502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000babb468b/0xd8e438fb63526a2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.403402:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000babb468b/0xd8e438fb63526a2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.403417:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000babb468b/0xd8e438fb63526a2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.403425:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000babb468b/0xd8e438fb63526a2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.403451:0:14502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431564.404444:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431564.404465:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac650f25/0xd8e438fb6352020c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c70ed expref: 75 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.404488:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac650f25/0xd8e438fb6352020c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c70ed expref: 75 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.404519:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4df:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.404523:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4df:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.404531:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63526a33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.404543:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63526a33 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.404571:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.404634:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+75:2347:x1876351933514240:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1919us (2473us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.404645:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16588
00000100:00100000:1.0:1789431564.404688:0:14502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+36:3312:x1876351894236288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22742us (26747us total) trans 4294969645 rc 0/0
00000100:00100000:2.0:1789431564.404692:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16589
00000100:00100000:1.0:1789431564.404708:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8328
00000100:00100000:2.0:1789431564.404715:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2347:x1876351933514496:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431564.404745:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431564.404752:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb6351fbc2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6ed9 expref: 74 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.404767:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb6351fbc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6ed9 expref: 74 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.404771:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.404784:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000babb468b/0xd8e438fb63526a2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.404786:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4dc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.404799:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4dc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431564.404813:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000640d8a5c/0xd8e438fb63526a3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.404816:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.404827:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000babb468b/0xd8e438fb63526a2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.404833:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000640d8a5c/0xd8e438fb63526a3a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.404857:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000babb468b/0xd8e438fb63526a2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.404863:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431564.404887:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000babb468b/0xd8e438fb63526a2c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.404894:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2347:x1876351933514496:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 185us (2712us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.404914:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16589
00010000:00010000:1.0:1789431564.404915:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000babb468b/0xd8e438fb63526a2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.404942:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.404945:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.404953:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431564.405083:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac650f25/0xd8e438fb6352020c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c70ed expref: 73 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.405100:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3c155f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1876351894236672:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431564.405125:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63526a33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.405136:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63526a33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.405144:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63526a33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.405154:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63526a33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.405163:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63526a33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.406353:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431564.406425:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894237440
00000100:00100000:3.0:1789431564.406435:0:14505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894237440
00000100:00100000:3.0:1789431564.406488:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8332
00000100:00100000:3.0:1789431564.406498:0:14505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+36:3311:x1876351894237440:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:3.0:1789431564.406537:0:14505:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1283 count 1
00010000:00010000:3.0:1789431564.406570:0:14505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aa9bc70/0xd8e438fb63526a5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.406593:0:14505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000de873613/0xd8e438fb63523c04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c829e expref: 72 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.406601:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x503:0x0].0x0 since=6s v=(0 0)
00010000:00010000:3.0:1789431564.406606:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x503:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431564.406611:0:14505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aa9bc70/0xd8e438fb63526a5d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.406650:0:14505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000de873613/0xd8e438fb63523c04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c829e expref: 72 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.406663:0:14505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000de873613/0xd8e438fb63523c04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c829e expref: 72 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.406680:0:14505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0e614000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:14505:1876351894237568:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431564.406772:0:14505:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf066aacc0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431564.406959:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.406988:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.407014:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933515008
00000100:00100000:3.0:1789431564.407018:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933515008
00002000:00100000:3.0:1789431564.407082:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x515:0x0] (0->4095)  req@ffff90ce0e616300 x1876351933515008/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/0 e 0 to 0 dl 1789431575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431564.407092:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0e616300 with x1876351933515008 ext(0->4095)
00002000:00010000:3.0:1789431564.407099:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce0e616300
00000100:00100000:3.0:1789431564.407121:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1538
00000100:00100000:3.0:1789431564.407129:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2348:x1876351933515008:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:3.0:1789431564.407636:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2348:x1876351933515008:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 505us (674us total) trans 4294970031 rc 0/0
00000100:00100000:3.0:1789431564.407644:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1538
00002000:00100000:3.0:1789431564.407652:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x515:0x0] (0->4095)  req@ffff90ce0e616300 x1876351933515008/t4294970031(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/448 e 0 to 0 dl 1789431575 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431564.407662:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0e616300 with x1876351933515008 ext(0->4095)
00002000:00010000:3.0:1789431564.407666:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce0e616300
00000100:00100000:3.0:1789431564.407700:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933514880
00000100:00100000:3.0:1789431564.407704:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933514880
00010000:00010000:3.0:1789431564.407738:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058b06dbd/0xd8e438fb6351fdcf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6f88 expref: 73 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.408547:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1789431564.409229:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3314:x1876351894236416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26355us (28843us total) trans 4294969646 rc 0/0
00000100:00100000:2.0:1789431564.409240:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8329
00000004:00080000:0.0:1789431564.409565:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2a7ebb80/2, rc 0, transno 4294969644
00000100:00100000:0.0:1789431564.409582:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894232576:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431564.409612:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933514752
00000100:00100000:0.0:1789431564.409620:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933514752
00000100:00100000:0.0:1789431564.409672:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296072
00000100:00100000:0.0:1789431564.409682:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+194:14616:x1876351933514752:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431564.409709:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431564.409714:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431564.409763:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb6352660b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8cf4 expref: 194 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.409788:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431564.409795:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431564.409804:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb6351fbc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6ed9 expref: 73 pid: 6698 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.409814:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526a64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ddb expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.409858:0:14464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a047b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14464:1876351894237056:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.409889:0:14464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000640d8a5c/0xd8e438fb63526a3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.409901:0:14464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000640d8a5c/0xd8e438fb63526a3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.409909:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000640d8a5c/0xd8e438fb63526a3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.409920:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000640d8a5c/0xd8e438fb63526a3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.409928:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000640d8a5c/0xd8e438fb63526a3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.409958:0:14464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:1.0:1789431564.410082:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1789431564.410090:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63526a33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.410100:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7aa00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.410105:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63526a33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.410115:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63526a33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.410135:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63526a33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.410142:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63526a33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.410153:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526a6b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.410162:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.410168:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000640d8a5c/0xd8e438fb63526a3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.410172:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526a6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.410183:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.410190:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000640d8a5c/0xd8e438fb63526a3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.410195:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526a6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.410201:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000640d8a5c/0xd8e438fb63526a3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.410220:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000640d8a5c/0xd8e438fb63526a3a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.410223:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526a72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.410241:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000640d8a5c/0xd8e438fb63526a3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.410250:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.410263:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.410263:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.410268:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.410272:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.410283:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:0.0:1789431564.411171:0:12181:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x516:0x0], index 0: 0
00010000:00010000:0.0:1789431564.411480:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a800/0xd8e438fb63526a79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.411495:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a800/0xd8e438fb63526a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.411506:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a800/0xd8e438fb63526a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.411554:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526a6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.411563:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526a6b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.411571:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526a6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.411578:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431564.411582:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526a6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.411590:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526a6b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.411603:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431564.411606:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431564.411612:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526a6b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.411619:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526a6b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431564.411636:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f8c5dd42 reply state 000000006b403506 transno 4295121025 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.411647:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431564.411692:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526a64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ddb expref: 196 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.411710:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a800/0xd8e438fb63526a79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ddb expref: 195 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.412272:0:14464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3314:x1876351894236928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24684us (24840us total) trans 4294969647 rc 0/0
00000100:00100000:1.0:1789431564.412286:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8330
00000004:00080000:1.0:1789431564.412355:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2d50ad80/2, rc 0, transno 4294969645
00000100:00100000:1.0:1789431564.412362:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894236288:0@lo:6:osp-syn-0-0.0
00010000:00010000:0.0:1789431564.412822:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa8:0x0].0x0 (ffff90ce07190500)
00010000:00010000:0.0:1789431564.412830:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431564.412835:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a800, rc 0)
00000100:00100000:0.0:1789431564.413119:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933514752:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3432us (10905us total) trans 4295121025 rc 0/0
00000100:00100000:0.0:1789431564.413129:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296072
00000100:00100000:0.0:1789431564.413210:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3c157100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:14499:1876351894237312:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431564.413241:0:14499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb63526a56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.413879:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16590
00000100:00100000:3.0:1789431564.413899:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2348:x1876351933514880:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431564.413921:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431564.413931:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058b06dbd/0xd8e438fb6351fdcf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6f88 expref: 72 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.413948:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058b06dbd/0xd8e438fb6351fdcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6f88 expref: 72 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.413976:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058b06dbd/0xd8e438fb6351fdcf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6f88 expref: 72 pid: 14486 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.413998:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4dd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431564.414002:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4dd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431564.414010:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb63526a56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.414021:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb63526a56 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.414085:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431564.414145:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2348:x1876351933514880:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 254us (7154us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431564.414153:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16590
00000100:00100000:0.0:1789431564.414503:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.414814:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.414919:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933515136
00000100:00100000:1.0:1789431564.414930:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933515136
00010000:00010000:1.0:1789431564.414972:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000de873613/0xd8e438fb63523c04 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c829e expref: 71 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.415015:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16591
00000100:00100000:1.0:1789431564.415024:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e952050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2347:x1876351933515136:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.415037:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.415043:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000de873613/0xd8e438fb63523c04 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x503:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c829e expref: 71 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.415076:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000de873613/0xd8e438fb63523c04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x503:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c829e expref: 71 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.415103:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x503:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.415107:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x503:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431564.415119:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001aa9bc70/0xd8e438fb63526a5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x503:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.415128:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aa9bc70/0xd8e438fb63526a5d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x503:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.415149:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.415187:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e952050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2347:x1876351933515136:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 165us (686us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.415196:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16591
00000100:00100000:1.0:1789431564.415266:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933515264
00000100:00100000:1.0:1789431564.415270:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933515264
00000100:00100000:1.0:1789431564.415313:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8333
00000100:00100000:1.0:1789431564.415321:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2350:x1876351933515264:12345-192.168.203.4@tcp:16:dbench.0
00000004:00080000:3.0:1789431564.423487:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce0e617b80/2, rc 0, transno 4294969647
00000100:00100000:3.0:1789431564.423507:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce0e617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894236928:0@lo:6:osp-syn-0-0.0
00000004:00080000:3.0:1789431564.423523:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2d50b480/2, rc 0, transno 4294969646
00000100:00100000:3.0:1789431564.423526:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894236416:0@lo:6:osp-syn-0-0.0
00010000:00010000:3.0:1789431564.423569:0:14505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de873613/0xd8e438fb63523c04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x503:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c829e expref: 70 pid: 6700 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.423591:0:14505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce0e614000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:14505:1876351894237568:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431564.423618:0:14505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001aa9bc70/0xd8e438fb63526a5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.423631:0:14505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001aa9bc70/0xd8e438fb63526a5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.423639:0:14505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aa9bc70/0xd8e438fb63526a5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.423653:0:14505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aa9bc70/0xd8e438fb63526a5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.423668:0:14505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aa9bc70/0xd8e438fb63526a5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.423691:0:14505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431564.424033:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.424044:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526a72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.424070:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526a72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.424076:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431564.424081:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526a72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.424090:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526a72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.424112:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce07190600)
00010000:00010000:1.0:1789431564.424115:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431564.424121:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526a72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.424127:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526a72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.424242:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.427942:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+37:3311:x1876351894237440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21434us (21584us total) trans 4294969648 rc 0/0
00000100:00100000:3.0:1789431564.427958:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8332
00000100:00100000:3.0:1789431564.427993:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933515392
00000100:00100000:3.0:1789431564.428001:0:14505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933515392
00000100:00100000:3.0:1789431564.428042:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8334
00000100:00100000:3.0:1789431564.428063:0:14505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2348:x1876351933515392:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431564.428082:0:14505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431564.428106:0:14505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000005adae1/0xd8e438fb63526a87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8de2 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431564.428138:0:14505:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x516:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431564.428161:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x516:0x0].0x0 since=3022s v=(0 0)
00010000:00010000:3.0:1789431564.428166:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x516:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431564.428176:0:14505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000005adae1/0xd8e438fb63526a87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8de2 expref: 71 pid: 14505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.428196:0:14505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000005adae1/0xd8e438fb63526a87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8de2 expref: 71 pid: 14505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.428211:0:14505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b274c00, rc 0)
00000100:00100000:3.0:1789431564.428256:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2348:x1876351933515392:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 206us (4019us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431564.428262:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8334
00010000:00010000:3.0:1789431564.428283:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431564.428290:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aa9bc70/0xd8e438fb63526a5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.428299:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b275200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431564.428304:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aa9bc70/0xd8e438fb63526a5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.428317:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aa9bc70/0xd8e438fb63526a5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.428333:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aa9bc70/0xd8e438fb63526a5d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.428342:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aa9bc70/0xd8e438fb63526a5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.428361:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.428363:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431564.428365:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:3.0:1789431564.428423:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce0e614e00/2, rc 0, transno 4294969648
00000100:00100000:3.0:1789431564.428434:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce0e614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894237440:0@lo:6:osp-syn-0-0.0
00010000:00010000:3.0:1789431564.428585:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63526a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.428603:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63526a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.428614:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63526a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.428622:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63526a25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.428638:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431564.428674:0:14499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb63526a56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.428683:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb63526a56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.428691:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb63526a56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.428698:0:14499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb63526a56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.428708:0:14499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:3.0:1789431564.429285:0:14499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+37:3312:x1876351894237184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35841us (36986us total) trans 4294969649 rc 0/0
00000100:00100000:3.0:1789431564.429298:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8331
00010000:00010000:1.0:1789431564.429749:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1789431564.429759:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63526a25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.429772:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.429776:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63526a25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.429788:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63526a25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.429822:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63526a25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.429831:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052a7abc7/0xd8e438fb63526a25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.429866:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431564.429872:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb63526a56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.429878:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7bc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431564.429881:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb63526a56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.429889:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb63526a56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.429900:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb63526a56 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.429907:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb63526a56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.429921:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.429923:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.429925:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431564.429933:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:1.0:1789431564.429978:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce0e616d80/2, rc 0, transno 4294969649
00000100:00100000:1.0:1789431564.429995:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce0e616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894237184:0@lo:6:osp-syn-0-0.0
00000004:00080000:0.0:1789431564.434495:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce3a047100/2, rc 0, transno 4294970032
00000100:00100000:0.0:1789431564.434518:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894236160:0@lo:6:osp-syn-1-0.0
00000100:00100000:3.0:1789431564.434561:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3311:x1876351894236160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 55694us (57669us total) trans 4294970032 rc 0/0
00000100:00100000:3.0:1789431564.434573:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8327
00000100:00100000:0.0:1789431564.435671:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.435714:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933515648
00000100:00100000:0.0:1789431564.435734:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933515648
00000100:00100000:0.0:1789431564.435868:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12485
00000100:00100000:0.0:1789431564.435882:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14616:x1876351933515648:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431564.436839:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933515648:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 953us (1170us total) trans 4295121026 rc 0/0
00000100:00100000:0.0:1789431564.436851:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12485
00000100:00100000:3.0:1789431564.444816:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.444931:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933515904
00000100:00100000:0.0:1789431564.444945:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933515904
00000100:00100000:0.0:1789431564.445020:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296073
00000100:00100000:0.0:1789431564.445032:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933515904:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431564.445145:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431564.445181:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a800/0xd8e438fb63526a79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ddb expref: 196 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.445204:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa8:0x0].0x0 (ffff90ce07190500)
00010000:00010000:0.0:1789431564.445219:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431564.445249:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526a8e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.445266:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526a8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.445277:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526a8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.445307:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526a95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.445314:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526a95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.445325:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526a95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.445462:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526a9c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aa8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.445470:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526a9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.445478:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526a9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:0.0:1789431564.446579:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1246, 64 off87936
00010000:00010000:0.0:1789431564.446676:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526aa3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aa8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446692:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446703:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446714:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526aa3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446733:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526aa3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446740:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526aa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446764:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431564.446792:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526a9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446798:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526a9c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aa8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446804:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526a9c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446810:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431564.446814:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526a9c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446823:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526a9c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aa8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446835:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa8:0x0].0x0 (ffff90ce07190d00)
00010000:00010000:0.0:1789431564.446838:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431564.446843:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526a9c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aa8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446851:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526a9c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aa8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446874:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526a8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446881:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526a8e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446887:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526a8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446897:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431564.446900:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526a8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446906:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526a8e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446915:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431564.446918:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431564.446921:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526a8e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.446927:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526a8e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431564.446937:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b316e98c reply state 0000000097e23f6a transno 4295121027 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526a95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.446946:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431564.447099:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14616:x1876351933515904:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2064us (2293us total) trans 4295121027 rc 0/0
00000100:00100000:0.0:1789431564.447109:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296073
00010000:00010000:0.0:1789431564.447154:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431564.447160:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526aa3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.447168:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431564.447172:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526aa3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.447184:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526aa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.447193:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa8:0x0].0x0 (ffff90ce07190d00)
00010000:00010000:0.0:1789431564.447195:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431564.447198:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526aa3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10aa8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.447204:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526aa3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aa8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.447220:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431564.447222:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431564.447224:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431564.453370:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431564.453563:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526a95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.453583:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526a95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.453592:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526a95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.453599:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431564.453604:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526a95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.453613:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526a95 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.453638:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce07190800)
00010000:00010000:2.0:1789431564.453642:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431564.453648:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526a95 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.453655:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526a95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.453784:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933516032
00000100:00100000:3.0:1789431564.453797:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933516032
00000100:00100000:3.0:1789431564.453897:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296074
00000100:00100000:3.0:1789431564.453949:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933516032:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431564.453983:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431564.454005:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526aaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8de9 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454363:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ab1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454382:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ab1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454397:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ab1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454415:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526ab8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454422:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454429:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454498:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ab1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454506:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ab1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454512:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ab1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454518:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b275200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431564.454521:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ab1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454527:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ab1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454537:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431564.454541:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431564.454546:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ab1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454553:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ab1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454565:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454571:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526ab8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454577:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454583:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b275400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431564.454587:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454592:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454602:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf18b78d00)
00010000:00010000:3.0:1789431564.454605:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431564.454609:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526ab8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454615:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526ab8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454656:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526aaa lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8de9 expref: 197 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454669:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431564.454672:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431564.454676:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526aaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8de9 expref: 197 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.454688:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b275600, rc 0)
00000100:00100000:1.0:1789431564.458524:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933516032:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4592us (5144us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431564.458544:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296074
00000100:00100000:1.0:1789431564.463966:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.464077:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933516160
00000100:00100000:0.0:1789431564.464092:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933516160
00000100:00100000:0.0:1789431564.464156:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296075
00000100:00100000:0.0:1789431564.464167:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933516160:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431564.464195:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431564.464224:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526abf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8df0 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.464322:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.464339:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.464352:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431564.464400:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008d:0x0]: returning size 16384
00000004:00200000:0.0:1789431564.464404:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431564.464427:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.464456:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526abf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8df0 expref: 198 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.464478:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8df0 expref: 197 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.464487:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431564.464490:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431564.464494:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3c00, rc 0)
00000100:00100000:0.0:1789431564.464564:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14616:x1876351933516160:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 399us (613us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.464571:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296075
00000100:00100000:2.0:1789431564.470866:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.470953:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933516288
00000100:00100000:3.0:1789431564.470967:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933516288
00000100:00100000:3.0:1789431564.471034:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12486
00000100:00100000:3.0:1789431564.471075:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14616:x1876351933516288:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431564.478229:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14616:x1876351933516288:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 7167us (7361us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431564.478246:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12486
00000100:00100000:1.0:1789431564.483786:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.483949:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933516544
00000100:00100000:2.0:1789431564.483962:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933516544
00000100:00100000:2.0:1789431564.484034:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296076
00000100:00100000:2.0:1789431564.484080:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14616:x1876351933516544:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431564.484109:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431564.484137:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63526acd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8df7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484241:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526ad4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484261:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526ad4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484276:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526ad4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484291:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526adb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484299:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484307:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484379:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526ad4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484388:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526ad4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484395:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526ad4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484402:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431564.484406:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526ad4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484420:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526ad4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484434:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431564.484437:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431564.484444:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526ad4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484450:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526ad4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484467:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484473:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526adb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484479:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526adb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484484:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431564.484487:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526adb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484492:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526adb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484500:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf13195700)
00010000:00010000:2.0:1789431564.484502:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431564.484505:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526adb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484511:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526adb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484552:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63526acd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8df7 expref: 198 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484563:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431564.484565:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:2.0:1789431564.484568:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63526acd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8df7 expref: 198 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.484578:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce387a4a00, rc 0)
00000100:00100000:2.0:1789431564.484652:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14616:x1876351933516544:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 608us (882us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431564.484660:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296076
00000100:00100000:2.0:1789431564.486114:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2350:x1876351933515264:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 70781us (71287us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.486128:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8333
00000001:00080000:3.0:1789431564.486280:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970025 is committed
00000001:00080000:3.0:1789431564.486305:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970029 is committed
00000001:00080000:3.0:1789431564.486368:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970031 is committed
00000001:00080000:3.0:1789431564.486378:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970030 is committed
00000100:00100000:1.0:1789431564.491103:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.491292:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933516800
00000100:00100000:2.0:1789431564.491305:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933516800
00000100:00100000:2.0:1789431564.491384:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296077
00000100:00100000:2.0:1789431564.491397:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14616:x1876351933516800:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431564.491425:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431564.491429:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:2.0:1789431564.491467:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526ac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8df0 expref: 197 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.491496:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431564.491503:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431564.491521:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63526ae2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8dfe expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.491671:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526ae9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.491688:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.491711:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.491736:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526af0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.491744:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.491752:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:2.0:1789431564.492486:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x516:0x0], index 1: 0
00010000:00010000:2.0:1789431564.492689:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526af7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.492705:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.492729:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.492773:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.492780:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526ae9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.492787:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526ae9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.492793:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431564.492798:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526ae9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.492807:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526ae9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.492819:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431564.492822:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431564.492827:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526ae9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.492834:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526ae9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431564.492847:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000698c0efa reply state 0000000000a605f3 transno 4295121028 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.492858:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:2.0:1789431564.492895:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63526ae2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dfe expref: 199 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.492909:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526af7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dfe expref: 198 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.492922:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90cf13195b00)
00010000:00010000:2.0:1789431564.492925:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431564.492927:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce387a5e00, rc 0)
00000100:00100000:2.0:1789431564.493031:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14616:x1876351933516800:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1637us (1984us total) trans 4295121028 rc 0/0
00000100:00100000:2.0:1789431564.493040:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296077
00010000:00010000:2.0:1789431564.496742:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.496764:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526af0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.496773:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526af0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.496779:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431564.496785:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526af0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.496794:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526af0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.496815:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf13195700)
00010000:00010000:2.0:1789431564.496819:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431564.496825:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526af0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.496832:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5800/0xd8e438fb63526af0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.500704:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.507929:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933516928
00000100:00100000:3.0:1789431564.507950:0:14491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933516928
00000100:00100000:2.0:1789431564.508139:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8335
00000100:00100000:2.0:1789431564.508155:0:14491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2348:x1876351933516928:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431564.508180:0:14491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431564.508211:0:14491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bca4ae2/0xd8e438fb63526b05 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e05 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789431564.508250:0:14491:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x516:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:2.0:1789431564.508277:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x516:0x0].0x0 since=3022s v=(0 0)
00010000:00010000:2.0:1789431564.508282:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x516:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431564.508294:0:14491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bca4ae2/0xd8e438fb63526b05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e05 expref: 71 pid: 14491 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.508314:0:14491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009bca4ae2/0xd8e438fb63526b05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e05 expref: 71 pid: 14491 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.508330:0:14491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce387a4a00, rc 0)
00000100:00100000:2.0:1789431564.508422:0:14491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2348:x1876351933516928:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 271us (7733us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.508429:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8335
00000100:00100000:3.0:1789431564.508884:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.509200:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933517056
00000100:00100000:2.0:1789431564.509208:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933517056
00002000:00100000:2.0:1789431564.509266:0:14440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x515:0x0] (0->4095)  req@ffff90ce0e616a00 x1876351933517056/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/0 e 0 to 0 dl 1789431575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431564.509277:0:14440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0e616a00 with x1876351933517056 ext(0->4095)
00002000:00010000:2.0:1789431564.509295:0:14440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce0e616a00
00000100:00100000:2.0:1789431564.509322:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1539
00000100:00100000:2.0:1789431564.509333:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2348:x1876351933517056:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:2.0:1789431564.509873:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2348:x1876351933517056:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 540us (989us total) trans 4294970033 rc 0/0
00000100:00100000:2.0:1789431564.509882:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1539
00002000:00100000:2.0:1789431564.509891:0:14440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x515:0x0] (0->4095)  req@ffff90ce0e616a00 x1876351933517056/t4294970033(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/448 e 0 to 0 dl 1789431575 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431564.509900:0:14440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0e616a00 with x1876351933517056 ext(0->4095)
00002000:00010000:2.0:1789431564.509904:0:14440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce0e616a00
00000100:00100000:0.0:1789431564.514465:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.514521:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.514632:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933517184
00000100:00100000:2.0:1789431564.514645:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933517184
00000100:00100000:2.0:1789431564.514733:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933517312
00000100:00100000:2.0:1789431564.514736:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933517312
00000100:00100000:2.0:1789431564.514768:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8336
00000100:00100000:3.0:1789431564.514776:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8337
00000100:00100000:2.0:1789431564.514780:0:14482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:14616:x1876351933517184:12345-192.168.203.4@tcp:101:dbench.0
00000100:00100000:3.0:1789431564.514786:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2350:x1876351933517312:12345-192.168.203.4@tcp:16:dbench.0
00010000:00010000:2.0:1789431564.514814:0:14482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431564.514842:0:14482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a54d6ca/0xd8e438fb63526b0c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e0c expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.514881:0:14482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009bca4ae2/0xd8e438fb63526b05 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e05 expref: 75 pid: 14491 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.514899:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x516:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431564.514905:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x516:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431564.514911:0:14482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a54d6ca/0xd8e438fb63526b0c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x516:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e0c expref: 75 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.514961:0:14482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009bca4ae2/0xd8e438fb63526b05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e05 expref: 75 pid: 14491 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.514982:0:14482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009bca4ae2/0xd8e438fb63526b05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e05 expref: 75 pid: 14491 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.514999:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14482:1876351894237696:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.515152:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb383c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431564.523093:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.523216:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14482:1876351894237696:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431564.523273:0:14482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a54d6ca/0xd8e438fb63526b0c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x516:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e0c expref: 75 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.523310:0:14482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce387a5800, rc 0)
00000100:00100000:2.0:1789431564.523388:0:14482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+75:14616:x1876351933517184:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8610us (8939us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.523400:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8336
00000100:00100000:1.0:1789431564.524181:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933517440
00000100:00100000:1.0:1789431564.524192:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933517440
00010000:00010000:1.0:1789431564.524235:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009bca4ae2/0xd8e438fb63526b05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e05 expref: 75 pid: 14491 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.524339:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16592
00000100:00100000:1.0:1789431564.524351:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+75:2348:x1876351933517440:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431564.524370:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431564.524403:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009bca4ae2/0xd8e438fb63526b05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x516:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e05 expref: 75 pid: 14491 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.524419:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009bca4ae2/0xd8e438fb63526b05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x516:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e05 expref: 75 pid: 14491 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.524449:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bca4ae2/0xd8e438fb63526b05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x516:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e05 expref: 75 pid: 14491 timeout: 3122 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.524466:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x516:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.524471:0:14506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x516:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431564.524481:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a54d6ca/0xd8e438fb63526b0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e0c expref: 74 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.524495:0:14506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a54d6ca/0xd8e438fb63526b0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e0c expref: 74 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.524540:0:14506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000a54d6ca/0xd8e438fb63526b0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e0c expref: 74 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431564.524558:0:14506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3a044000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14506:1876351894237824:192.168.203.4@tcp:105:
00000100:00100000:1.0:1789431564.524656:0:14506:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf0620e180 going to sleep for 11 seconds
00000100:00100000:1.0:1789431564.535082:0:14506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3a044000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14506:1876351894237824:192.168.203.4@tcp:105:
00010000:00010000:1.0:1789431564.535119:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431564.535197:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2348:x1876351933517440:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 10847us (12117us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.535212:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16592
00000100:00100000:1.0:1789431564.552785:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.552830:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.552857:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.552886:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.552898:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933517696
00000100:00100000:1.0:1789431564.552913:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.552914:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933517696
00002000:00100000:3.0:1789431564.552983:0:14484:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x29:0x0] (0->4095)  req@ffff90ce3a044000 x1876351933517696/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/0 e 0 to 0 dl 1789431575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431564.552996:0:14484:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce3a044000 with x1876351933517696 ext(0->4095)
00002000:00010000:3.0:1789431564.553003:0:14484:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce3a044000
00000100:00100000:3.0:1789431564.553038:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933517568
00000100:00100000:3.0:1789431564.553042:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933517568
00000100:00100000:1.0:1789431564.553079:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933517952
00002000:00100000:3.0:1789431564.553084:0:14484:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x28:0x0] (0->4095)  req@ffff90ce3a046680 x1876351933517568/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/0 e 0 to 0 dl 1789431575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00000100:00100000:1.0:1789431564.553085:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933517952
00002000:00100000:3.0:1789431564.553097:0:14484:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce3a046680 with x1876351933517568 ext(0->4095)
00002000:00010000:3.0:1789431564.553102:0:14484:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce3a046680
00002000:00100000:1.0:1789431564.553114:0:14449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2b:0x0] (0->4095)  req@ffff90ce3a045880 x1876351933517952/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/0 e 0 to 0 dl 1789431575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00000100:00100000:3.0:1789431564.553119:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933517824
00000100:00100000:3.0:1789431564.553124:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933517824
00002000:00100000:1.0:1789431564.553128:0:14449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce3a045880 with x1876351933517952 ext(0->4095)
00002000:00010000:1.0:1789431564.553133:0:14449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce3a045880
00002000:00100000:3.0:1789431564.553145:0:14484:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x29:0x0] (0->4095)  req@ffff90ce3a047480 x1876351933517824/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/0 e 0 to 0 dl 1789431575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431564.553154:0:14484:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce3a047480 with x1876351933517824 ext(0->4095)
00002000:00010000:3.0:1789431564.553159:0:14484:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce3a047480
00000100:00100000:1.0:1789431564.553161:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1540
00000100:00100000:1.0:1789431564.553175:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2348:x1876351933517696:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:3.0:1789431564.553183:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1541
00000100:00100000:3.0:1789431564.553192:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+75:2347:x1876351933517568:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:1.0:1789431564.553791:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2348:x1876351933517696:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 615us (1015us total) trans 4294969650 rc 0/0
00000100:00100000:1.0:1789431564.553800:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1540
00002000:00100000:1.0:1789431564.553809:0:14449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x29:0x0] (0->4095)  req@ffff90ce3a044000 x1876351933517696/t4294969650(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/448 e 0 to 0 dl 1789431575 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431564.553819:0:14449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce3a044000 with x1876351933517696 ext(0->4095)
00002000:00010000:1.0:1789431564.553823:0:14449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce3a044000
00000100:00100000:1.0:1789431564.553846:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1542
00000100:00100000:1.0:1789431564.553853:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2348:x1876351933517952:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:3.0:1789431564.556005:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+77:2347:x1876351933517568:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 2793us (3126us total) trans 4294970034 rc 0/0
00000100:00100000:3.0:1789431564.556021:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1541
00002000:00100000:3.0:1789431564.556035:0:14484:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x28:0x0] (0->4095)  req@ffff90ce3a046680 x1876351933517568/t4294970034(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/448 e 0 to 0 dl 1789431575 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431564.556046:0:14484:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce3a046680 with x1876351933517568 ext(0->4095)
00002000:00010000:3.0:1789431564.556068:0:14484:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce3a046680
00000100:00100000:3.0:1789431564.556119:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1543
00000100:00100000:3.0:1789431564.556133:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+76:2347:x1876351933517824:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:3.0:1789431564.556592:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+78:2347:x1876351933517824:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 462us (3676us total) trans 4294970035 rc 0/0
00000100:00100000:1.0:1789431564.556601:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+75:2348:x1876351933517952:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 2745us (3713us total) trans 4294969651 rc 0/0
00000100:00100000:3.0:1789431564.556602:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1543
00002000:00100000:3.0:1789431564.556612:0:14484:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x29:0x0] (0->4095)  req@ffff90ce3a047480 x1876351933517824/t4294970035(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/448 e 0 to 0 dl 1789431575 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00000100:00100000:1.0:1789431564.556615:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1542
00002000:00100000:3.0:1789431564.556625:0:14484:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce3a047480 with x1876351933517824 ext(0->4095)
00002000:00100000:1.0:1789431564.556627:0:14449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2b:0x0] (0->4095)  req@ffff90ce3a045880 x1876351933517952/t4294969651(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/448 e 0 to 0 dl 1789431575 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00010000:3.0:1789431564.556631:0:14484:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce3a047480
00002000:00100000:1.0:1789431564.556641:0:14449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce3a045880 with x1876351933517952 ext(0->4095)
00002000:00010000:1.0:1789431564.556646:0:14449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce3a045880
00000100:00100000:3.0:1789431564.556677:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933518208
00000100:00100000:3.0:1789431564.556687:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933518208
00000100:00100000:3.0:1789431564.556773:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12487
00000100:00100000:3.0:1789431564.556781:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14616:x1876351933518208:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431564.561385:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14616:x1876351933518208:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 4586us (8535us total) trans 4295121029 rc 0/0
00000100:00100000:3.0:1789431564.561404:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12487
00000100:00100000:1.0:1789431564.568083:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.568365:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933518464
00000100:00100000:2.0:1789431564.568380:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933518464
00000100:00100000:2.0:1789431564.568457:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296078
00000100:00100000:2.0:1789431564.568470:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14616:x1876351933518464:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431564.568561:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431564.568591:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63526b13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e13 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.568759:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b1a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.568778:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526af7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dfe expref: 200 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.568789:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b1a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.568834:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526af7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dfe expref: 200 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.568851:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526af7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dfe expref: 200 pid: 5848 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.568867:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894237952:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.568983:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38cc0 going to sleep for 11 seconds
00000100:00100000:2.0:1789431564.571612:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894237952:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431564.571651:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b1a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.572227:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.572671:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933518592
00000100:00100000:2.0:1789431564.572683:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933518592
00010000:00010000:2.0:1789431564.572746:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526af7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dfe expref: 201 pid: 5848 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.572792:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16593
00000100:00100000:2.0:1789431564.572805:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:2347:x1876351933518592:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431564.572828:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431564.572838:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526af7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dfe expref: 201 pid: 5848 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.572854:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526af7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dfe expref: 201 pid: 5848 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.572885:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526af7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8dfe expref: 201 pid: 5848 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.572905:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90cf13195b00)
00010000:00010000:2.0:1789431564.572912:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b1a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.572925:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.572935:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b1a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.572982:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431564.573125:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:2347:x1876351933518592:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 322us (900us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.573134:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16593
00010000:00010000:3.0:1789431564.573473:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.573484:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431564.576706:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00010000:00010000:3.0:1789431564.576981:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63526b13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e13 expref: 201 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.577009:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e13 expref: 200 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.577019:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90cf13195b00)
00010000:00010000:3.0:1789431564.577022:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431564.577026:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce387a4e00, rc 0)
00000100:00100000:3.0:1789431564.577129:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14616:x1876351933518464:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8660us (9083us total) trans 4295121030 rc 0/0
00000100:00100000:3.0:1789431564.577138:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296078
00000100:00100000:2.0:1789431564.584030:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.584726:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933518720
00000100:00100000:0.0:1789431564.584741:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933518720
00000100:00100000:0.0:1789431564.584823:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296079
00000100:00100000:0.0:1789431564.584841:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14616:x1876351933518720:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431564.584875:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431564.584905:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63526b28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e1a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.585016:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63526b2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.585039:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b1a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e13 expref: 201 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.585071:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63526b2f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.585116:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e13 expref: 201 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.585132:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b1a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e13 expref: 201 pid: 6797 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.585147:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce17f3dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894238080:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431564.585252:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2d449000 going to sleep for 11 seconds
00000100:00100000:1.0:1789431564.588729:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894238080:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431564.588775:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63526b2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.593955:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431564.598824:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.599086:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933518848
00000100:00100000:3.0:1789431564.599100:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933518848
00010000:00010000:3.0:1789431564.599155:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b1a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e13 expref: 202 pid: 6797 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431564.599205:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16594
00000100:00100000:3.0:1789431564.599216:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:2347:x1876351933518848:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431564.599235:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431564.599243:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b1a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e13 expref: 202 pid: 6797 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.599269:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e13 expref: 202 pid: 6797 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.599297:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e13 expref: 202 pid: 6797 timeout: 3122 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.599318:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90cf13195b00)
00010000:00010000:3.0:1789431564.599323:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63526b2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.599334:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63526b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.599342:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63526b2f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.599381:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431564.599449:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:2347:x1876351933518848:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 234us (640us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431564.599457:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16594
00010000:00010000:0.0:1789431564.599691:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63526b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.599702:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63526b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431564.599774:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000004:00200000:0.0:1789431564.599783:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431564.599810:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63526b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.599857:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63526b28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e1a expref: 201 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.599875:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63526b2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e1a expref: 200 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.599883:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90cf13195b00)
00010000:00010000:0.0:1789431564.599886:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431564.599889:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3e00, rc 0)
00000100:00100000:0.0:1789431564.599924:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14616:x1876351933518720:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 15092us (15910us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.599932:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296079
00000100:00100000:3.0:1789431564.605773:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.605912:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933518976
00000100:00100000:2.0:1789431564.605926:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933518976
00002000:00100000:2.0:1789431564.605985:0:14440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x516:0x0] (0->85514)  req@ffff90ce0e615c00 x1876351933518976/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 488/0 e 0 to 0 dl 1789431575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431564.605998:0:14440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0e615c00 with x1876351933518976 ext(0->85514)
00002000:00010000:2.0:1789431564.606005:0:14440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce0e615c00
00000100:00100000:2.0:1789431564.606044:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1544
00000100:00100000:2.0:1789431564.606270:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+78:2347:x1876351933518976:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:2.0:1789431564.616370:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+80:2347:x1876351933518976:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 10087us (10593us total) trans 4294970036 rc 0/0
00000100:00100000:2.0:1789431564.616391:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1544
00002000:00100000:2.0:1789431564.616410:0:14440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x516:0x0] (0->85514)  req@ffff90ce0e615c00 x1876351933518976/t4294970036(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 488/448 e 0 to 0 dl 1789431575 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431564.616434:0:14440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0e615c00 with x1876351933518976 ext(0->85514)
00002000:00010000:2.0:1789431564.616444:0:14440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce0e615c00
00000100:00100000:3.0:1789431564.621011:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+79:2350:x1876351933517312:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 106208us (106469us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431564.621028:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8337
00000001:00080000:1.0:1789431564.622125:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970033 is committed
00000001:00080000:1.0:1789431564.622155:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970032 is committed
00000100:00100000:2.0:1789431564.640776:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.640973:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933519104
00000100:00100000:3.0:1789431564.640988:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933519104
00002000:00100000:3.0:1789431564.641253:0:14484:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x515:0x0] (0->4095)  req@ffff90ce2d50aa00 x1876351933519104/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/0 e 0 to 0 dl 1789431575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431564.641268:0:14484:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce2d50aa00 with x1876351933519104 ext(0->4095)
00002000:00010000:3.0:1789431564.641277:0:14484:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce2d50aa00
00000100:00100000:3.0:1789431564.641317:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1545
00000100:00100000:3.0:1789431564.641328:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+77:2348:x1876351933519104:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:3.0:1789431564.642453:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+79:2348:x1876351933519104:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 1114us (1679us total) trans 4294970037 rc 0/0
00000100:00100000:3.0:1789431564.642468:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1545
00002000:00100000:3.0:1789431564.642483:0:14484:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x515:0x0] (0->4095)  req@ffff90ce2d50aa00 x1876351933519104/t4294970037(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/448 e 0 to 0 dl 1789431575 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431564.642667:0:14484:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce2d50aa00 with x1876351933519104 ext(0->4095)
00002000:00010000:3.0:1789431564.642677:0:14484:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce2d50aa00
00000100:00100000:0.0:1789431564.644766:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.644941:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933519232
00000100:00100000:2.0:1789431564.644955:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933519232
00000100:00100000:2.0:1789431564.645136:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296080
00000100:00100000:2.0:1789431564.645149:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14616:x1876351933519232:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:2.0:1789431564.650040:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.650170:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933519360
00000100:00100000:2.0:1789431564.650184:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933519360
00000100:00100000:2.0:1789431564.650258:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8338
00000100:00100000:2.0:1789431564.652727:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+79:2350:x1876351933519360:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:2.0:1789431564.724256:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+79:2350:x1876351933519360:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 71554us (74232us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.724268:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8338
00000001:00080000:0.0:1789431564.726109:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970036 is committed
00000001:00080000:0.0:1789431564.726127:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970037 is committed
00000001:00080000:1.0:1789431564.735759:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121027 is committed
00000001:00080000:1.0:1789431564.735788:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121028 is committed
00000001:00080000:1.0:1789431564.735803:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121030 is committed
00000100:00100000:2.0:1789431564.736152:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+190:14616:x1876351933519232:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 91001us (91394us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.736163:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296080
00000100:00100000:2.0:1789431564.739892:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.740045:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933519488
00000100:00100000:3.0:1789431564.740128:0:14532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933519488
00002000:00100000:3.0:1789431564.740182:0:14532:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x515:0x0] (0->4095)  req@ffff90ce2d508380 x1876351933519488/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/0 e 0 to 0 dl 1789431575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431564.740194:0:14532:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce2d508380 with x1876351933519488 ext(0->4095)
00002000:00010000:3.0:1789431564.740200:0:14532:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce2d508380
00000100:00100000:3.0:1789431564.740266:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1546
00000100:00100000:3.0:1789431564.740276:0:14532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2350:x1876351933519488:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:3.0:1789431564.740709:0:14532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2350:x1876351933519488:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 433us (825us total) trans 4294970038 rc 0/0
00000100:00100000:3.0:1789431564.740730:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1546
00002000:00100000:3.0:1789431564.740748:0:14532:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x515:0x0] (0->4095)  req@ffff90ce2d508380 x1876351933519488/t4294970038(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/448 e 0 to 0 dl 1789431575 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431564.740755:0:14532:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce2d508380 with x1876351933519488 ext(0->4095)
00002000:00010000:3.0:1789431564.740759:0:14532:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce2d508380
00000100:00100000:0.0:1789431564.742321:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.742409:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933519616
00000100:00100000:1.0:1789431564.742418:0:14502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933519616
00000100:00100000:1.0:1789431564.742500:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8339
00000100:00100000:1.0:1789431564.742512:0:14502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2347:x1876351933519616:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:1.0:1789431564.742655:0:14502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2347:x1876351933519616:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 145us (341us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.742662:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8339
00000100:00100000:1.0:1789431564.746019:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.746197:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933519744
00000100:00100000:2.0:1789431564.746208:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933519744
00000100:00100000:2.0:1789431564.746269:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8340
00000100:00100000:2.0:1789431564.746280:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2349:x1876351933519744:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:2.0:1789431564.762422:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.762676:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933519872
00000100:00100000:3.0:1789431564.762686:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933519872
00002000:00100000:3.0:1789431564.762748:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x516:0x0] (0->4095)  req@ffff90ce2d508a80 x1876351933519872/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/0 e 0 to 0 dl 1789431575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431564.762759:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce2d508a80 with x1876351933519872 ext(0->4095)
00002000:00010000:3.0:1789431564.762765:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce2d508a80
00000100:00100000:3.0:1789431564.762796:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1547
00000100:00100000:3.0:1789431564.762805:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2348:x1876351933519872:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:3.0:1789431564.763236:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+76:2348:x1876351933519872:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 431us (823us total) trans 4294970039 rc 0/0
00000100:00100000:3.0:1789431564.763244:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1547
00002000:00100000:3.0:1789431564.763251:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x516:0x0] (0->4095)  req@ffff90ce2d508a80 x1876351933519872/t4294970039(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/448 e 0 to 0 dl 1789431575 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431564.763279:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce2d508a80 with x1876351933519872 ext(0->4095)
00002000:00010000:3.0:1789431564.763283:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce2d508a80
00000100:00100000:1.0:1789431564.771417:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.771508:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933520000
00000100:00100000:3.0:1789431564.771518:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933520000
00000100:00100000:3.0:1789431564.771577:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8341
00000100:00100000:3.0:1789431564.771587:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+76:2348:x1876351933520000:12345-192.168.203.4@tcp:16:dbench.0
00000004:00080000:3.0:1789431564.789208:0:6794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3022820157095ns, next at 3023820154495ns, rc = 0
00000100:00100000:1.0:1789431564.789279:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0e614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894238208:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1789431564.789343:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431564.789551:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894238208
00000100:00100000:3.0:1789431564.789559:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894238208
00000100:00100000:3.0:1789431564.789644:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134
00000100:00100000:3.0:1789431564.789654:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3313:x1876351894238208:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1789431564.789676:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 20447232 granted 408616960 pending 3407872 free 3835691008 avail 3833593856
00000100:00100000:3.0:1789431564.789745:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3313:x1876351894238208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (401us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431564.789752:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134
00000100:00100000:1.0:1789431564.789823:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce0e614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894238208:0@lo:13:osp-pre-0-0.0
00000001:00080000:3.0:1789431564.797905:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970038 is committed
00000100:00100000:0.0:1789431564.798477:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2349:x1876351933519744:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 52192us (52461us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.798489:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8340
00000100:00100000:2.0:1789431564.813324:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.813400:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933520128
00000100:00100000:1.0:1789431564.813410:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933520128
00000100:00100000:1.0:1789431564.813464:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296081
00000100:00100000:1.0:1789431564.813475:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+190:14617:x1876351933520128:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431564.813495:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431564.813514:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63526b36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e21 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.813575:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526b3d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.813592:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526b3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.813604:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526b3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.813618:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526b44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.813625:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.813631:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.813944:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63526b4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.813954:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63526b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.813962:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63526b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431564.813994:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000004:00200000:1.0:1789431564.813998:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431564.814015:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63526b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.814025:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63526b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.814037:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526b3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.814043:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526b3d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.814072:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526b3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.814078:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431564.814083:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526b3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.814090:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526b3d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.814101:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431564.814104:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431564.814109:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526b3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.814115:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526b3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.814128:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.814134:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526b44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.814140:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.814144:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431564.814147:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.814152:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526b44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.814158:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce03149800)
00010000:00010000:1.0:1789431564.814160:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431564.814163:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526b44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.814167:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526b44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.814197:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63526b36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e21 expref: 192 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.814212:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63526b4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e21 expref: 191 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431564.814219:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90ce07190000)
00010000:00010000:1.0:1789431564.814221:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431564.814224:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309e00, rc 0)
00000100:00100000:1.0:1789431564.814387:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+191:14617:x1876351933520128:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 913us (1071us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.814394:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296081
00000100:00100000:0.0:1789431564.823728:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.823771:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933520384
00000100:00100000:0.0:1789431564.823780:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933520384
00000100:00100000:0.0:1789431564.823827:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296082
00000100:00100000:0.0:1789431564.823835:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+191:14617:x1876351933520384:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431564.823882:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:0.0:1789431564.823908:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63526b4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e21 expref: 191 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.823929:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3b62ce00/0xd8e438fb63526811 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d9c expref: 190 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.823939:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90ce07190000)
00010000:00010000:0.0:1789431564.823950:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431564.823991:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526b52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.824003:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526b52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.824012:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526b52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431564.824206:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f1326579 reply state 000000005d2d165c transno 4295121031 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526b52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.824216:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431564.824311:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+191:14617:x1876351933520384:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 475us (602us total) trans 4295121031 rc 0/0
00000100:00100000:0.0:1789431564.824318:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296082
00010000:00010000:2.0:1789431564.826846:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526b52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.826863:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526b52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.826871:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526b52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.826877:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431564.826882:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526b52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.826895:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526b52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.826911:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90ce07190500)
00010000:00010000:2.0:1789431564.826914:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431564.826918:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526b52 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.826924:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526b52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.828602:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.828889:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933520512
00000100:00100000:2.0:1789431564.828898:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933520512
00000100:00100000:2.0:1789431564.828955:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296083
00000100:00100000:2.0:1789431564.828965:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+190:14617:x1876351933520512:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431564.828986:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431564.829008:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63526b59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e28 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.829088:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63526b59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e28 expref: 191 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.829102:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63526b59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e28 expref: 191 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.829121:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431564.829124:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00010000:2.0:1789431564.829127:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce387a5200, rc 0)
00000100:00100000:2.0:1789431564.829176:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+191:14617:x1876351933520512:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 213us (583us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.829182:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296083
00000001:00080000:3.0:1789431564.835685:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970039 is committed
00000100:00100000:1.0:1789431564.835915:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2348:x1876351933520000:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 64324us (64502us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431564.835927:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8341
00000100:00100000:0.0:1789431564.844801:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.845696:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933520640
00000100:00100000:3.0:1789431564.845707:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933520640
00002000:00100000:2.0:1789431564.845933:0:14461:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x516:0x0] (0->4095)  req@ffff90ce17f3f100 x1876351933520640/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/0 e 0 to 0 dl 1789431575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431564.845944:0:14461:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce17f3f100 with x1876351933520640 ext(0->4095)
00002000:00010000:2.0:1789431564.845950:0:14461:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce17f3f100
00000100:00100000:2.0:1789431564.845985:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1548
00000100:00100000:2.0:1789431564.845994:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2350:x1876351933520640:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:2.0:1789431564.846619:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2350:x1876351933520640:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 622us (1824us total) trans 4294970040 rc 0/0
00000100:00100000:2.0:1789431564.846627:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1548
00002000:00100000:2.0:1789431564.846634:0:14461:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x516:0x0] (0->4095)  req@ffff90ce17f3f100 x1876351933520640/t4294970040(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/448 e 0 to 0 dl 1789431575 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431564.846643:0:14461:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce17f3f100 with x1876351933520640 ext(0->4095)
00002000:00010000:2.0:1789431564.846647:0:14461:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce17f3f100
00000100:00100000:0.0:1789431564.846829:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.847407:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933520768
00000100:00100000:2.0:1789431564.847415:0:14501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933520768
00000100:00100000:2.0:1789431564.847465:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8342
00000100:00100000:2.0:1789431564.847474:0:14501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2349:x1876351933520768:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:2.0:1789431564.847618:0:14501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x515:0x0] updating lvb size from disk: 0 -> 85515
00002000:00010000:2.0:1789431564.847621:0:14501:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x515:0x0] updating lvb mtime from disk: 0 -> 1789431552
00002000:00010000:2.0:1789431564.847623:0:14501:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x515:0x0] updating lvb atime from disk: 0 -> 1789431553
00002000:00010000:2.0:1789431564.847625:0:14501:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x515:0x0] updating lvb ctime from disk: 0 -> 1789431564
00002000:00010000:2.0:1789431564.847628:0:14501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x515:0x0] updating lvb blocks from disk: 1 -> 259
00000100:00100000:2.0:1789431564.847666:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2349:x1876351933520768:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 187us (831us total) trans 4294970041 rc 0/0
00000100:00100000:2.0:1789431564.847673:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8342
00000100:00100000:0.0:1789431564.851875:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.854431:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.854620:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933520896
00000100:00100000:1.0:1789431564.854630:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933520896
00000100:00100000:1.0:1789431564.854685:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8343
00000100:00100000:1.0:1789431564.854696:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2349:x1876351933520896:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:2.0:1789431564.855009:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933521152
00000100:00100000:2.0:1789431564.855078:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933521152
00000100:00100000:2.0:1789431564.855121:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296084
00000100:00100000:2.0:1789431564.855129:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+191:14617:x1876351933521152:12345-192.168.203.4@tcp:55:dbench.0
00010000:00010000:2.0:1789431564.855627:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.855645:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.855657:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.855683:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.855690:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.855697:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.855703:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431564.855707:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.855726:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.855738:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431564.855741:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:2.0:1789431564.855745:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b60 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.855752:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.855826:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+191:14617:x1876351933521152:12345-192.168.203.4@tcp:55:dbench.0 Request processed in 697us (1404us total) trans 0 rc -22/-22
00000100:00100000:2.0:1789431564.855833:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296084
00000100:00100000:0.0:1789431564.866866:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.866905:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933521280
00000100:00100000:0.0:1789431564.866915:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933521280
00002000:00100000:0.0:1789431564.866961:0:14439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x515:0x0] (0->4095)  req@ffff90ce17f3c700 x1876351933521280/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/0 e 0 to 0 dl 1789431575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431564.866972:0:14439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce17f3c700 with x1876351933521280 ext(0->4095)
00002000:00010000:0.0:1789431564.866978:0:14439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce17f3c700
00000100:00100000:0.0:1789431564.867004:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1549
00000100:00100000:0.0:1789431564.867014:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+75:2348:x1876351933521280:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:0.0:1789431564.868500:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+77:2348:x1876351933521280:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 1479us (1635us total) trans 4294970042 rc 0/0
00000100:00100000:0.0:1789431564.868511:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1549
00002000:00100000:0.0:1789431564.868522:0:14439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x515:0x0] (0->4095)  req@ffff90ce17f3c700 x1876351933521280/t4294970042(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/448 e 0 to 0 dl 1789431575 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431564.868532:0:14439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce17f3c700 with x1876351933521280 ext(0->4095)
00002000:00010000:0.0:1789431564.868537:0:14439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce17f3c700
00000100:00100000:0.0:1789431564.877219:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.877489:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933521408
00000100:00100000:0.0:1789431564.877499:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933521408
00000100:00100000:0.0:1789431564.877562:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296085
00000100:00100000:0.0:1789431564.877572:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+191:14617:x1876351933521408:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:0.0:1789431564.877878:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+191:14617:x1876351933521408:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 306us (668us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.877887:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296085
00000100:00100000:0.0:1789431564.883659:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.883844:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933521536
00000100:00100000:1.0:1789431564.883855:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933521536
00000100:00100000:2.0:1789431564.883943:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8344
00000100:00100000:2.0:1789431564.883956:0:14500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+77:2347:x1876351933521536:12345-192.168.203.4@tcp:16:dbench.0
00000001:00080000:2.0:1789431564.888732:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970041 is committed
00000100:00100000:0.0:1789431564.890991:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2349:x1876351933520896:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 36286us (39113us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.891004:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8343
00000100:00100000:3.0:1789431564.900421:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431564.900898:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933521664
00000100:00100000:1.0:1789431564.900909:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933521664
00002000:00100000:1.0:1789431564.900956:0:14449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x516:0x0] (0->4095)  req@ffff90ce0e614a80 x1876351933521664/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/0 e 0 to 0 dl 1789431575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431564.900967:0:14449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0e614a80 with x1876351933521664 ext(0->4095)
00002000:00010000:1.0:1789431564.900973:0:14449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce0e614a80
00000100:00100000:1.0:1789431564.901007:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1550
00000100:00100000:1.0:1789431564.901017:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2349:x1876351933521664:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:1.0:1789431564.901497:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+76:2349:x1876351933521664:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 479us (1084us total) trans 4294970043 rc 0/0
00000100:00100000:1.0:1789431564.901505:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1550
00002000:00100000:1.0:1789431564.901513:0:14449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x516:0x0] (0->4095)  req@ffff90ce0e614a80 x1876351933521664/t4294970043(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:35/0 lens 4584/448 e 0 to 0 dl 1789431575 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431564.901521:0:14449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0e614a80 with x1876351933521664 ext(0->4095)
00002000:00010000:1.0:1789431564.901524:0:14449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce0e614a80
00000100:00100000:1.0:1789431564.905730:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.906401:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933521792
00000100:00100000:3.0:1789431564.906413:0:14491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933521792
00000100:00100000:3.0:1789431564.906561:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8345
00000100:00100000:3.0:1789431564.906572:0:14491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+76:2350:x1876351933521792:12345-192.168.203.4@tcp:16:dbench.0
00000001:00080000:2.0:1789431564.949875:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970042 is committed
00000100:00100000:2.0:1789431564.950007:0:14500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2347:x1876351933521536:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 66049us (66352us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431564.950018:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8344
00000100:00100000:1.0:1789431564.956730:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.957009:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933522048
00000100:00100000:3.0:1789431564.957020:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933522048
00000100:00100000:3.0:1789431564.957088:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12488
00000100:00100000:3.0:1789431564.957098:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+191:14617:x1876351933522048:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431564.957408:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+192:14617:x1876351933522048:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 311us (697us total) trans 4295121032 rc 0/0
00000100:00100000:3.0:1789431564.957416:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12488
00000100:00100000:1.0:1789431564.965519:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431564.967373:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933522176
00000100:00100000:3.0:1789431564.967389:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933522176
00000100:00100000:3.0:1789431564.967449:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296086
00000100:00100000:3.0:1789431564.967459:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+192:14617:x1876351933522176:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431564.967481:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431564.967502:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526b67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e2f expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.967568:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526b6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.967645:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526b6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.967659:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526b6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.967677:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526b75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.967685:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.967693:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.967926:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526b7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.967935:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526b7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.967942:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526b7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431564.968117:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000004:00200000:3.0:1789431564.968122:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431564.968147:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526b7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.968159:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526b7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.968168:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526b6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.968174:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526b6e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.968180:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526b6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.968186:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b275600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431564.968190:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526b6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.968198:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526b6e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.968210:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431564.968213:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431564.968218:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526b6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.968224:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526b6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.968236:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.968244:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526b75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.968249:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526b75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.968255:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b275200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431564.968259:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526b75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.968265:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526b75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.968273:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90cf18b78d00)
00010000:00010000:3.0:1789431564.968275:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431564.968278:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526b75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.968284:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526b75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.968320:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526b67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e2f expref: 194 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.968333:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526b7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e2f expref: 193 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431564.968340:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:3.0:1789431564.968342:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431564.968344:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b275a00, rc 0)
00000100:00100000:3.0:1789431564.968413:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933522176:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 955us (2904us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431564.968420:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296086
00000100:00100000:1.0:1789431564.983537:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.983685:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933522432
00000100:00100000:2.0:1789431564.983697:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933522432
00000100:00100000:2.0:1789431564.984093:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296087
00000100:00100000:2.0:1789431564.984105:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933522432:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431564.984125:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431564.984146:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63526b83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e36 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.984252:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b8a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.984267:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526b7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e2f expref: 194 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.984276:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b8a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.984308:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526b7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e2f expref: 194 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.984322:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526b7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e2f expref: 194 pid: 12775 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.984335:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d509f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894238336:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.984421:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38f00 going to sleep for 11 seconds
00000001:00080000:2.0:1789431564.989498:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970043 is committed
00000100:00100000:3.0:1789431564.989658:0:14491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2350:x1876351933521792:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 83082us (83944us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431564.989671:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8345
00000100:00100000:1.0:1789431564.992806:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431564.992910:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933522560
00000100:00100000:0.0:1789431564.992919:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933522560
00010000:00010000:0.0:1789431564.992959:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526b7c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e2f expref: 195 pid: 12775 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431564.992999:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16595
00000100:00100000:0.0:1789431564.993008:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c154a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:2347:x1876351933522560:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431564.993022:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431564.993029:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526b7c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e2f expref: 195 pid: 12775 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.993042:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526b7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e2f expref: 195 pid: 12775 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.993099:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:0.0:1789431564.993105:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b8a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.993116:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b8a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.993123:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b8a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431564.993143:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431564.993198:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c154a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:2347:x1876351933522560:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 182us (392us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431564.993206:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16595
00010000:00010000:2.0:1789431564.993777:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526b7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e2f expref: 194 pid: 12775 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.993796:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d509f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894238336:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431564.993816:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b8a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.993825:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b8a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.993832:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b8a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431564.993850:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00010000:00010000:2.0:1789431564.994023:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63526b83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e36 expref: 195 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.994038:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b8a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e36 expref: 194 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.994045:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431564.994156:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431564.994160:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce387a5400, rc 0)
00000100:00100000:2.0:1789431564.994206:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+194:14617:x1876351933522432:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10105us (10680us total) trans 4295121033 rc 0/0
00000100:00100000:2.0:1789431564.994214:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296087
00000100:00100000:3.0:1789431564.998536:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431564.998611:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933522688
00000100:00100000:2.0:1789431564.998621:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933522688
00000100:00100000:2.0:1789431564.998785:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296088
00000100:00100000:2.0:1789431564.998795:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+194:14617:x1876351933522688:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431564.998819:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431564.998839:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526b98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e3d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.998942:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.998961:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b8a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e36 expref: 195 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.998969:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b9f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.998999:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b8a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e36 expref: 195 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431564.999011:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b8a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e36 expref: 195 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431564.999024:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d509f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894238464:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431564.999122:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38f00 going to sleep for 11 seconds
00000100:00100000:2.0:1789431565.002854:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d509f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894238464:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431565.002888:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.003215:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.003308:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933522816
00000100:00100000:1.0:1789431565.003316:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933522816
00010000:00010000:1.0:1789431565.003357:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b8a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e36 expref: 196 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.003397:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16596
00000100:00100000:1.0:1789431565.003406:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:2348:x1876351933522816:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.003421:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.003427:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b8a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e36 expref: 196 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.003439:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b8a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e36 expref: 196 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.003459:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526b8a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e36 expref: 196 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.003476:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:1.0:1789431565.003481:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.003490:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.003499:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b9f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.003537:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431565.003592:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:2348:x1876351933522816:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 186us (385us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.003602:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16596
00010000:00010000:0.0:1789431565.003789:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.003798:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431565.003844:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000004:00200000:0.0:1789431565.003848:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431565.003867:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.003898:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526b98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e3d expref: 195 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.003926:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e3d expref: 194 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.003933:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:0.0:1789431565.003937:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431565.003939:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce387a4e00, rc 0)
00000100:00100000:0.0:1789431565.004019:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+194:14617:x1876351933522688:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 5225us (5492us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.004027:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296088
00000100:00100000:3.0:1789431565.007353:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.007425:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933522944
00000100:00100000:0.0:1789431565.007439:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933522944
00002000:00100000:0.0:1789431565.007489:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x516:0x0] (0->4095)  req@ffff90ce0e614380 x1876351933522944/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:36/0 lens 4584/0 e 0 to 0 dl 1789431576 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431565.007501:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0e614380 with x1876351933522944 ext(0->4095)
00002000:00010000:0.0:1789431565.007507:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce0e614380
00000100:00100000:0.0:1789431565.007544:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1551
00000100:00100000:0.0:1789431565.007554:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2348:x1876351933522944:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:0.0:1789431565.008000:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2348:x1876351933522944:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 445us (658us total) trans 4294970044 rc 0/0
00000100:00100000:0.0:1789431565.008008:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1551
00002000:00100000:0.0:1789431565.008015:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x516:0x0] (0->4095)  req@ffff90ce0e614380 x1876351933522944/t4294970044(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:36/0 lens 4584/448 e 0 to 0 dl 1789431576 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431565.008023:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0e614380 with x1876351933522944 ext(0->4095)
00002000:00010000:0.0:1789431565.008027:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce0e614380
00000100:00100000:1.0:1789431565.017254:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.017323:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.017431:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933523072
00000100:00100000:2.0:1789431565.017441:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933523072
00000100:00100000:2.0:1789431565.017509:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296089
00000100:00100000:2.0:1789431565.017519:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+194:14617:x1876351933523072:12345-192.168.203.4@tcp:41:dbench.0
00000004:00000024:2.0:1789431565.017573:0:5848:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7643070464 avail 7560232960
00000100:00100000:2.0:1789431565.017641:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+194:14617:x1876351933523072:12345-192.168.203.4@tcp:41:dbench.0 Request processed in 122us (395us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.017649:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296089
00000100:00100000:3.0:1789431565.017756:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933523200
00000100:00100000:3.0:1789431565.017762:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933523200
00000100:00100000:3.0:1789431565.017799:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8346
00000100:00100000:3.0:1789431565.017807:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2348:x1876351933523200:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:1.0:1789431565.031669:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.031729:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933523328
00000100:00100000:1.0:1789431565.031739:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933523328
00000100:00100000:1.0:1789431565.031790:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296090
00000100:00100000:1.0:1789431565.031801:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+194:14617:x1876351933523328:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431565.031821:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431565.031841:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526ba6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e44 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.031918:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526bad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.031932:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526bad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.031944:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526bad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.031958:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526bb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe5dc7a0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.031965:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.031971:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032177:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526bbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032186:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032193:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431565.032226:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10090:0x0]: returning size 260096
00000004:00200000:1.0:1789431565.032231:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431565.032254:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032265:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032273:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526bad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032279:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526bad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032285:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526bad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032291:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.032295:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526bad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032303:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526bad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032314:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431565.032317:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.032321:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526bad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032327:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526bad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032339:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032345:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526bb4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032350:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032354:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.032357:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032362:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526bb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032368:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe5dc7a0b (ffff90ce03149800)
00010000:00010000:1.0:1789431565.032371:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.032373:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526bb4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032378:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526bb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032406:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526ba6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e44 expref: 196 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032419:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e44 expref: 195 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.032426:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10090:0x0].0x0 (ffff90ce0bc57800)
00010000:00010000:1.0:1789431565.032428:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431565.032430:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:1.0:1789431565.032490:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14617:x1876351933523328:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 690us (828us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.032496:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296090
00000100:00100000:1.0:1789431565.042179:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.043044:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933523584
00000100:00100000:2.0:1789431565.043074:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933523584
00000100:00100000:2.0:1789431565.043126:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296091
00000100:00100000:2.0:1789431565.043135:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14617:x1876351933523584:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431565.043155:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431565.043176:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63526bc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e4b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.043286:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526bc9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10090:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.043302:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5a00/0xd8e438fb6351107e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2480 expref: 196 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.043314:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526bbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e44 expref: 196 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.043323:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526bc9 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x10090:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.043355:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e44 expref: 196 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.043368:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526bbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e44 expref: 196 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.043380:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d509f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894238592:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431565.043461:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5a00/0xd8e438fb6351107e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2480 expref: 196 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.043470:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5a00/0xd8e438fb6351107e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2480 expref: 196 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.043478:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894238720:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431565.043496:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb389c0 going to sleep for 11 seconds
00000100:00100000:1.0:1789431565.046778:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.046812:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933523712
00000100:00100000:1.0:1789431565.046821:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933523712
00010000:00010000:1.0:1789431565.046858:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526bbb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e44 expref: 197 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.046903:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16597
00000100:00100000:1.0:1789431565.046914:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:2347:x1876351933523712:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.046928:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.046935:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526bbb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e44 expref: 197 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.046947:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526bbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e44 expref: 197 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.046969:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10090:0x0].0x0 (ffff90ce0bc57800)
00010000:00010000:1.0:1789431565.046974:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526bc9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10090:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.046982:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526bc9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10090:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.046989:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431565.047033:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:2347:x1876351933523712:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 122us (265us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.047039:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16597
00000100:00100000:0.0:1789431565.061560:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.061598:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933523840
00000100:00100000:0.0:1789431565.061607:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933523840
00010000:00010000:0.0:1789431565.061648:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5a00/0xd8e438fb6351107e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2480 expref: 197 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.061681:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16598
00000100:00100000:0.0:1789431565.061691:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e953450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:2347:x1876351933523840:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431565.061705:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431565.061713:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5a00/0xd8e438fb6351107e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2480 expref: 197 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.061737:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5a00/0xd8e438fb6351107e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2480 expref: 197 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.061759:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10090:0x0].0x0 (ffff90ce0bc57800)
00010000:00010000:0.0:1789431565.061765:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526bc9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10090:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.061775:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526bc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10090:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.061782:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526bc9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10090:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.061969:0:5847:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@000000004274a1c8 x1876351894238592) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526bbb lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e44 expref: 197 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.061989:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526bbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e44 expref: 197 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.062005:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d509f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894238592:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431565.062022:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd5a00/0xd8e438fb6351107e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2480 expref: 196 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.062034:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894238720:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431565.062099:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10090:0x0].0x0 (ffff90ce0bc57800)
00010000:00010000:3.0:1789431565.062108:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526bc9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10090:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.062441:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431565.062491:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e953450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:2347:x1876351933523840:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 800us (940us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.062500:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16598
00010000:00010000:2.0:1789431565.062866:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526bc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10090:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.062877:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526bc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10090:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431565.062897:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10090:0x0]: returning size 260096
00010000:00010000:2.0:1789431565.063042:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb63526bc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e4b expref: 196 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.063084:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526bc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10090:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e4b expref: 195 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.063094:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10090:0x0].0x0 (ffff90ce0bc57800)
00010000:00010000:2.0:1789431565.063098:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431565.063101:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce387a5e00, rc 0)
00000100:00100000:2.0:1789431565.063130:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14617:x1876351933523584:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 19995us (20959us total) trans 4295121034 rc 0/0
00000100:00100000:2.0:1789431565.063139:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296091
00000100:00100000:1.0:1789431565.070109:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.070303:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933523968
00000100:00100000:2.0:1789431565.070312:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933523968
00000001:00080000:1.0:1789431565.070929:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970044 is committed
00000100:00100000:2.0:1789431565.070992:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296092
00000100:00100000:2.0:1789431565.071003:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14617:x1876351933523968:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431565.071025:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431565.071045:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526bd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10090:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e52 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.071152:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a800/0xd8e438fb63526bde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.071167:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526bc9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10090:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e4b expref: 196 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.071176:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a800/0xd8e438fb63526bde lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.071206:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526bc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10090:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e4b expref: 196 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.071225:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526bc9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10090:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e4b expref: 196 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.071238:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894238848:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431565.071312:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38e40 going to sleep for 11 seconds
00000100:00100000:3.0:1789431565.072150:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2348:x1876351933523200:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 54329us (54812us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.072160:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8346
00000100:00100000:2.0:1789431565.074303:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894238848:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431565.074333:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a800/0xd8e438fb63526bde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.081181:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.081223:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.081470:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933524096
00000100:00100000:3.0:1789431565.081480:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933524096
00010000:00010000:3.0:1789431565.081519:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526bc9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10090:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e4b expref: 197 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.081562:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16599
00000100:00100000:3.0:1789431565.081572:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:2348:x1876351933524096:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431565.081586:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431565.081594:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526bc9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10090:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e4b expref: 197 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.081608:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526bc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10090:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e4b expref: 197 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.081630:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63526bc9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10090:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e4b expref: 197 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.081647:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10090:0x0].0x0 (ffff90ce0bc57800)
00010000:00010000:3.0:1789431565.081920:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a800/0xd8e438fb63526bde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.081931:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a800/0xd8e438fb63526bde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.081939:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a800/0xd8e438fb63526bde lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.082078:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933524224
00000100:00100000:2.0:1789431565.082084:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933524224
00000100:00100000:2.0:1789431565.082118:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296093
00000100:00100000:2.0:1789431565.082126:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14616:x1876351933524224:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431565.082142:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431565.082157:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526be5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e59 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082213:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526bec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082225:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526bec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082233:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526bec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082258:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526bf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082266:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082273:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082500:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526bfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082508:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082515:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431565.082545:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000004:00200000:2.0:1789431565.082549:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431565.082565:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082574:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082581:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526bec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082586:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526bec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082592:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526bec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082598:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.082601:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526bec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082608:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526bec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082616:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431565.082618:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.082622:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526bec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082628:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526bec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082641:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082646:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526bf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082658:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082663:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.082666:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082671:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526bf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082678:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf13195300)
00010000:00010000:2.0:1789431565.082680:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.082683:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526bf3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082688:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526bf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082732:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526be5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e59 expref: 199 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082746:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526bfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e59 expref: 198 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.082758:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90cf13195b00)
00010000:00010000:2.0:1789431565.082761:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431565.082763:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b800, rc 0)
00000100:00100000:2.0:1789431565.082822:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14616:x1876351933524224:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 697us (1598us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.082829:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296093
00010000:00010000:3.0:1789431565.083202:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431565.083229:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:2348:x1876351933524096:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1658us (2058us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.083238:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16599
00010000:00010000:0.0:1789431565.083517:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a800/0xd8e438fb63526bde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.083525:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a800/0xd8e438fb63526bde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431565.083555:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10090:0x0]: returning size 260096
00000004:00200000:0.0:1789431565.083558:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431565.083571:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a800/0xd8e438fb63526bde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.083598:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63526bd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10090:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e52 expref: 197 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.083612:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a800/0xd8e438fb63526bde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10090:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e52 expref: 196 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.083618:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10090:0x0].0x0 (ffff90ce0bc57800)
00010000:00010000:0.0:1789431565.083621:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431565.083624:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a800, rc 0)
00000100:00100000:0.0:1789431565.083651:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14617:x1876351933523968:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12650us (13606us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.083657:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296092
00000100:00100000:1.0:1789431565.092506:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.092589:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933524608
00000100:00100000:0.0:1789431565.092599:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933524608
00000100:00100000:0.0:1789431565.092661:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296094
00000100:00100000:0.0:1789431565.092672:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933524608:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431565.092738:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431565.092763:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63526b2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e1a expref: 196 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.092782:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90cf13195b00)
00010000:00010000:0.0:1789431565.092787:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431565.092838:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526c01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.092852:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526bfa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e59 expref: 195 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.092860:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526c01 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.092894:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526bfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e59 expref: 195 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.092907:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526bfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e59 expref: 195 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.092925:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce17f3ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894238976:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431565.093219:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e000 going to sleep for 11 seconds
00000100:00100000:1.0:1789431565.103147:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.103287:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.103471:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933524864
00000100:00100000:3.0:1789431565.103481:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933524864
00000100:00100000:3.0:1789431565.103539:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12489
00000100:00100000:3.0:1789431565.103550:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14617:x1876351933524864:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431565.103771:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14617:x1876351933524864:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 222us (632us total) trans 4295121035 rc 0/0
00000100:00100000:3.0:1789431565.103779:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12489
00000100:00100000:2.0:1789431565.105029:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933524352
00000100:00100000:2.0:1789431565.105039:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933524352
00010000:00010000:2.0:1789431565.105095:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526bfa lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e59 expref: 197 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.105136:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16600
00000100:00100000:2.0:1789431565.105146:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:2348:x1876351933524352:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431565.105158:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431565.105166:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526bfa lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e59 expref: 197 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.105180:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526bfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e59 expref: 197 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.105201:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90cf13195b00)
00010000:00010000:2.0:1789431565.105208:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526c01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.105217:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.105231:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526c01 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.105252:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431565.105300:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:2348:x1876351933524352:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 155us (2012us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.105308:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16600
00010000:00010000:0.0:1789431565.106598:0:5849:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@0000000048f62ce0 x1876351894238976) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526bfa lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e59 expref: 196 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.106617:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526bfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e59 expref: 196 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.106634:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894238976:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431565.106656:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90cf13195b00)
00010000:00010000:0.0:1789431565.106663:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.106672:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.106677:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431565.106863:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003383a53e reply state 00000000bc209734 transno 4295121036 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.106872:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431565.106963:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14616:x1876351933524608:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 14293us (14466us total) trans 4295121036 rc 0/0
00000100:00100000:0.0:1789431565.106971:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296094
00010000:00010000:2.0:1789431565.111610:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.111627:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526c01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.111636:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526c01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.111643:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.111647:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526c01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.111655:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526c01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.111671:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90cf13195b00)
00010000:00010000:2.0:1789431565.111674:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.111679:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526c01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.111685:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526c01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.113496:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.113626:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.114564:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933524992
00000100:00100000:0.0:1789431565.114578:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933524992
00000100:00100000:0.0:1789431565.114686:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933525120
00000100:00100000:0.0:1789431565.114689:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933525120
00000100:00100000:1.0:1789431565.114788:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296095
00000100:00100000:1.0:1789431565.114802:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14616:x1876351933524992:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431565.114836:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431565.114866:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526c08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e60 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.114946:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526c08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e60 expref: 198 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.114964:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526c08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e60 expref: 198 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.114986:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:1.0:1789431565.114989:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00010000:1.0:1789431565.114993:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309000, rc 0)
00000100:00100000:0.0:1789431565.115199:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296096
00000100:00100000:0.0:1789431565.115209:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933525120:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.115218:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431565.115230:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63526c0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e67 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.115480:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14616:x1876351933524992:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 680us (1995us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.115488:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296095
00010000:00010000:0.0:1789431565.115565:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526c16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.115578:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526c16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.115590:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526c16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.115604:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526c1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.115612:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.115619:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.115949:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63526c24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.115959:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63526c24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.115967:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63526c24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431565.116004:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000004:00200000:0.0:1789431565.116009:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431565.116031:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63526c24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.116044:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63526c24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.116079:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526c16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.116087:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526c16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.116094:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526c16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.116101:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431565.116106:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526c16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.116114:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526c16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.116125:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431565.116128:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431565.116134:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526c16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.116146:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526c16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.116160:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.116166:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526c1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.116173:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526c1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.116177:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431565.116179:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526c1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.116184:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526c1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.116190:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce07190d00)
00010000:00010000:0.0:1789431565.116192:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431565.116195:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526c1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.116201:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526c1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.116236:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63526c0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e67 expref: 199 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.116271:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63526c24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e67 expref: 198 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.116279:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:0.0:1789431565.116282:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431565.116284:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3600, rc 0)
00000100:00100000:0.0:1789431565.116331:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933525120:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1124us (2705us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.116337:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296096
00000100:00100000:0.0:1789431565.125816:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.125864:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.125900:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.126017:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933525632
00000100:00100000:1.0:1789431565.126030:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933525632
00000100:00100000:1.0:1789431565.126132:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14358
00000100:00100000:1.0:1789431565.126144:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c154a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:2350:x1876351933525632:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.126163:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.126193:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63526c24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e67 expref: 198 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.126216:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:1.0:1789431565.126221:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431565.126299:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c154a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:2350:x1876351933525632:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 157us (398us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.126310:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14358
00000100:00100000:2.0:1789431565.126431:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933525376
00000100:00100000:2.0:1789431565.126448:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933525376
00000100:00100000:2.0:1789431565.126513:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296097
00000100:00100000:2.0:1789431565.126524:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14617:x1876351933525376:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431565.126546:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431565.126569:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526c2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e6e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.126632:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933525504
00000100:00100000:3.0:1789431565.126641:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933525504
00010000:00010000:2.0:1789431565.126699:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526c32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.126932:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e3d expref: 198 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.126944:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8347
00010000:00010000:2.0:1789431565.126946:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526c32 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.126958:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2347:x1876351933525504:12345-192.168.203.4@tcp:2:dbench.0
00010000:00010000:2.0:1789431565.126990:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e3d expref: 198 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.127008:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e3d expref: 198 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.127023:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894239104:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431565.127152:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38e40 going to sleep for 11 seconds
00002000:00010000:3.0:1789431565.127507:0:14497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x516:0x0] updating lvb size from disk: 0 -> 85515
00002000:00010000:3.0:1789431565.127513:0:14497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x516:0x0] updating lvb mtime from disk: 0 -> 1789431552
00002000:00010000:3.0:1789431565.127515:0:14497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x516:0x0] updating lvb atime from disk: 0 -> 1789431554
00002000:00010000:3.0:1789431565.127518:0:14497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x516:0x0] updating lvb ctime from disk: 0 -> 1789431564
00002000:00010000:3.0:1789431565.127520:0:14497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x516:0x0] updating lvb blocks from disk: 1 -> 259
00000100:00100000:3.0:1789431565.127572:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2347:x1876351933525504:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 616us (1704us total) trans 4294970045 rc 0/0
00000100:00100000:3.0:1789431565.127580:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8347
00000100:00100000:1.0:1789431565.134563:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.134641:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.134771:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894239104:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431565.134810:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526c32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.134963:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933526016
00000100:00100000:3.0:1789431565.134973:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933526016
00000100:00100000:3.0:1789431565.135042:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296098
00000100:00100000:3.0:1789431565.135075:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14616:x1876351933526016:12345-192.168.203.4@tcp:55:dbench.0
00010000:00010000:3.0:1789431565.135163:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526c39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.135182:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526c39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.135194:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526c39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.135227:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526c39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.135235:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526c39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.135514:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526c39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.135524:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b275400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431565.135530:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526c39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.135539:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526c39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.135554:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:3.0:1789431565.135557:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:3.0:1789431565.135564:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526c39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.135571:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526c39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.135737:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14616:x1876351933526016:12345-192.168.203.4@tcp:55:dbench.0 Request processed in 658us (1086us total) trans 0 rc -22/-22
00000100:00100000:2.0:1789431565.135747:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296098
00000100:00100000:0.0:1789431565.137244:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933525760
00000100:00100000:0.0:1789431565.137263:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933525760
00010000:00010000:2.0:1789431565.138640:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e3d expref: 199 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.138726:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16601
00000100:00100000:2.0:1789431565.138747:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:2348:x1876351933525760:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431565.138769:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431565.138777:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e3d expref: 199 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.138793:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e3d expref: 199 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.139458:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63526b9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e3d expref: 199 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.139489:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431565.139497:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526c32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.139508:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526c32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.139527:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526c32 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.139608:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431565.139710:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:2348:x1876351933525760:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 964us (5159us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.139728:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16601
00010000:00010000:3.0:1789431565.140119:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526c32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.140362:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431565.140960:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526c32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431565.140989:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000100:00100000:0.0:1789431565.141143:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933526144
00000100:00100000:0.0:1789431565.141154:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933526144
00002000:00100000:0.0:1789431565.141210:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x516:0x0] (0->4095)  req@ffff90ce2d50a300 x1876351933526144/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:36/0 lens 4584/0 e 0 to 0 dl 1789431576 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431565.141221:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce2d50a300 with x1876351933526144 ext(0->4095)
00002000:00010000:0.0:1789431565.141226:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce2d50a300
00000100:00100000:0.0:1789431565.141256:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1552
00000100:00100000:0.0:1789431565.141267:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2347:x1876351933526144:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:0.0:1789431565.141941:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2347:x1876351933526144:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 669us (1574us total) trans 4294970046 rc 0/0
00000100:00100000:0.0:1789431565.141951:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1552
00002000:00100000:0.0:1789431565.141961:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x516:0x0] (0->4095)  req@ffff90ce2d50a300 x1876351933526144/t4294970046(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:36/0 lens 4584/448 e 0 to 0 dl 1789431576 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431565.141970:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce2d50a300 with x1876351933526144 ext(0->4095)
00002000:00010000:0.0:1789431565.141974:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce2d50a300
00010000:00010000:1.0:1789431565.142193:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526c2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e6e expref: 199 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.142221:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526c32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e6e expref: 198 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.142231:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:1.0:1789431565.142234:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431565.142238:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7bc00, rc 0)
00000100:00100000:1.0:1789431565.142658:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933525376:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 16133us (16854us total) trans 4295121037 rc 0/0
00000100:00100000:1.0:1789431565.142667:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296097
00000100:00100000:1.0:1789431565.145033:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.145287:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933526272
00000100:00100000:2.0:1789431565.145299:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933526272
00000100:00100000:2.0:1789431565.145364:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296099
00000100:00100000:2.0:1789431565.145376:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14616:x1876351933526272:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:2.0:1789431565.145793:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14616:x1876351933526272:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 418us (782us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.145801:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296099
00000100:00100000:0.0:1789431565.146598:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.146689:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933526400
00000100:00100000:2.0:1789431565.146696:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933526400
00000100:00100000:2.0:1789431565.146788:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296100
00000100:00100000:2.0:1789431565.146799:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933526400:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431565.146818:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431565.146846:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526c47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.146950:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526c4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.146968:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526c32 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e6e expref: 199 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.146978:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526c4e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.147035:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526c32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e6e expref: 199 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.147226:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526c32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e6e expref: 199 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.147245:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d508700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894239232:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431565.147370:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38e40 going to sleep for 11 seconds
00000100:00100000:0.0:1789431565.150336:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d508700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894239232:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431565.150377:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526c4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.151834:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.151942:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933526528
00000100:00100000:1.0:1789431565.151955:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933526528
00010000:00010000:1.0:1789431565.152018:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526c32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e6e expref: 200 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.152116:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16602
00000100:00100000:1.0:1789431565.152128:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:2348:x1876351933526528:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.152149:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.152157:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526c32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e6e expref: 200 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.152179:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526c32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e6e expref: 200 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.152208:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526c32 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e6e expref: 200 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.152227:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:1.0:1789431565.152234:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526c4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.152245:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.152254:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526c4e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.152462:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431565.152579:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:2348:x1876351933526528:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 452us (755us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.152588:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16602
00010000:00010000:3.0:1789431565.153216:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.153230:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431565.153312:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000004:00200000:3.0:1789431565.153318:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431565.153346:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.153393:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526c47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e75 expref: 199 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.153414:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526c4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e75 expref: 198 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.153424:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:3.0:1789431565.153427:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431565.153430:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7ba00, rc 0)
00000100:00100000:3.0:1789431565.153478:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933526400:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6681us (6883us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.153487:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296100
00000100:00100000:1.0:1789431565.156380:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.156731:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933526656
00000100:00100000:2.0:1789431565.156744:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933526656
00000100:00100000:2.0:1789431565.156819:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8348
00000100:00100000:2.0:1789431565.156831:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2349:x1876351933526656:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:2.0:1789431565.158423:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.158586:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933526912
00000100:00100000:1.0:1789431565.158597:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933526912
00000100:00100000:1.0:1789431565.158667:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12490
00000100:00100000:1.0:1789431565.158682:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933526912:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431565.159000:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933526912:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 322us (588us total) trans 4295121038 rc 0/0
00000100:00100000:1.0:1789431565.159014:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12490
00000100:00100000:1.0:1789431565.165163:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.166132:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933527040
00000100:00100000:0.0:1789431565.166151:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933527040
00000100:00100000:0.0:1789431565.166884:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296101
00000100:00100000:0.0:1789431565.166900:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933527040:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.166933:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431565.166960:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526c55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e7c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167082:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526c5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167100:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526c5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167114:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526c5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167131:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167139:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167146:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167457:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526c6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167467:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167476:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431565.167519:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000004:00200000:0.0:1789431565.167525:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431565.167565:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167580:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167589:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526c5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167597:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526c5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167605:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526c5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167618:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431565.167626:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526c5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167636:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526c5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167651:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431565.167654:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431565.167661:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526c5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167668:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526c5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167683:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167690:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167696:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167701:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431565.167704:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167710:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167732:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce07190d00)
00010000:00010000:0.0:1789431565.167734:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431565.167738:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167745:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167780:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526c55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e7c expref: 201 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167794:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526c6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e7c expref: 200 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.167802:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:0.0:1789431565.167805:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431565.167808:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2000, rc 0)
00000100:00100000:0.0:1789431565.167893:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14617:x1876351933527040:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 997us (2751us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.167901:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296101
00000100:00100000:0.0:1789431565.178991:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.179171:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.179206:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933527424
00000100:00100000:0.0:1789431565.179216:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933527424
00000100:00100000:0.0:1789431565.179278:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296102
00000100:00100000:0.0:1789431565.179290:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14617:x1876351933527424:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.179311:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431565.179332:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526c71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e83 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.179430:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.179446:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526c4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e75 expref: 201 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.179455:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526c6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e7c expref: 201 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.179464:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.179496:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526c6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e7c expref: 201 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.179510:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526c6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e7c expref: 201 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.179522:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894239360:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431565.179605:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526c4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e75 expref: 201 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.179614:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526c4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e75 expref: 201 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.179624:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e829880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894239488:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431565.179651:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e480 going to sleep for 11 seconds
00000100:00100000:3.0:1789431565.187575:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933527168
00000100:00100000:3.0:1789431565.187590:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933527168
00010000:00010000:3.0:1789431565.187736:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526c6a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e7c expref: 202 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.187773:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16603
00000100:00100000:3.0:1789431565.187784:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:2347:x1876351933527168:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431565.187797:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431565.187804:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526c6a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e7c expref: 202 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.187819:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526c6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e7c expref: 202 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.187841:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:3.0:1789431565.187847:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.187856:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.187862:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431565.187931:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:2347:x1876351933527168:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 148us (9052us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.187938:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16603
00000100:00100000:2.0:1789431565.189573:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431565.189829:0:12775:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@000000005367df1c x1876351894239360) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526c6a lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e7c expref: 201 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.189859:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526c6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e7c expref: 201 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.189876:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894239360:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431565.189898:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e829880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894239488:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431565.189918:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:3.0:1789431565.189923:0:12775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.189936:0:12775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.189945:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.193414:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933527552
00000100:00100000:1.0:1789431565.193427:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933527552
00010000:00010000:1.0:1789431565.193468:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526c4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e75 expref: 201 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.193507:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16604
00000100:00100000:1.0:1789431565.193517:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e951450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:2348:x1876351933527552:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.193531:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.193539:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526c4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e75 expref: 201 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.193551:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526c4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e75 expref: 201 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.193572:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526c4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e75 expref: 201 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.193585:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:1.0:1789431565.193590:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.193600:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.193607:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.193633:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431565.193687:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e951450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:2348:x1876351933527552:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 172us (4121us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.193694:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16604
00010000:00010000:2.0:1789431565.193805:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.193814:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431565.193833:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00010000:00010000:2.0:1789431565.193988:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526c71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e83 expref: 201 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.194009:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e83 expref: 200 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.194017:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431565.194019:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431565.194022:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2e00, rc 0)
00000100:00100000:2.0:1789431565.194045:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14617:x1876351933527424:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 14759us (14875us total) trans 4295121039 rc 0/0
00000100:00100000:2.0:1789431565.194079:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296102
00000100:00100000:1.0:1789431565.204591:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.205078:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933527680
00000100:00100000:0.0:1789431565.205088:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933527680
00000100:00100000:0.0:1789431565.205134:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296103
00000100:00100000:0.0:1789431565.205153:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14617:x1876351933527680:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.205176:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431565.205195:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526c86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e8a expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.205276:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.205290:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e83 expref: 201 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.205299:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c8d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.205331:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e83 expref: 201 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.205342:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e83 expref: 201 pid: 12775 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.205356:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e828700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894239616:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431565.205419:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b6a26c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431565.208629:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e828700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894239616:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431565.208657:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.214264:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.214741:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2349:x1876351933526656:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 57911us (58373us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.214752:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8348
00000100:00100000:0.0:1789431565.215100:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933527808
00000100:00100000:0.0:1789431565.215109:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933527808
00010000:00010000:0.0:1789431565.215157:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e83 expref: 202 pid: 12775 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.215187:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16605
00000100:00100000:0.0:1789431565.215198:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:2349:x1876351933527808:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431565.215213:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431565.215220:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e83 expref: 202 pid: 12775 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.215233:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e83 expref: 202 pid: 12775 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.215255:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526c78 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e83 expref: 202 pid: 12775 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.215273:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:0.0:1789431565.215278:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.215287:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.215295:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c8d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.215325:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431565.215355:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:2349:x1876351933527808:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 160us (1100us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.215362:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16605
00010000:00010000:3.0:1789431565.215416:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.215431:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431565.215491:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000004:00200000:3.0:1789431565.215497:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431565.215525:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789431565.215544:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970046 is committed
00010000:00010000:3.0:1789431565.215576:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526c86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e8a expref: 201 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.215600:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e8a expref: 200 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.215609:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:3.0:1789431565.215612:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431565.215616:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2800, rc 0)
00000100:00100000:3.0:1789431565.215672:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14617:x1876351933527680:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10528us (11087us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.215681:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296103
00000100:00100000:1.0:1789431565.218290:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.219015:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933528064
00000100:00100000:3.0:1789431565.219032:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933528064
00000100:00100000:3.0:1789431565.219141:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12491
00000100:00100000:3.0:1789431565.219154:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14616:x1876351933528064:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431565.219627:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:14616:x1876351933528064:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 475us (1344us total) trans 4295121040 rc 0/0
00000100:00100000:3.0:1789431565.219635:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12491
00000100:00100000:1.0:1789431565.225082:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.225473:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933528320
00000100:00100000:3.0:1789431565.225489:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933528320
00000100:00100000:3.0:1789431565.225627:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12492
00000100:00100000:3.0:1789431565.225639:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:14617:x1876351933528320:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431565.225941:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:14617:x1876351933528320:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 304us (898us total) trans 4295121041 rc 0/0
00000100:00100000:3.0:1789431565.225950:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12492
00000100:00100000:1.0:1789431565.230413:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.231095:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933528448
00000100:00100000:2.0:1789431565.231108:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933528448
00000100:00100000:2.0:1789431565.231950:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296104
00000100:00100000:2.0:1789431565.231965:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:14616:x1876351933528448:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431565.231985:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431565.232006:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526c94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e91 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.232116:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526c9b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.232131:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526c9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.232147:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526c9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.232163:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526ca2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.232169:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.232175:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.232639:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526ca9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.232649:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.232657:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431565.232690:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000004:00200000:2.0:1789431565.232694:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431565.232711:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.232938:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.232948:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526c9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.232958:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526c9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.232966:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526c9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.232972:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.232976:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526c9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.232984:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526c9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.232997:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431565.233000:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.233005:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526c9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.233011:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526c9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.233023:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.233029:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526ca2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.233036:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.233041:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.233044:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.233089:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526ca2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.233096:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf13195b00)
00010000:00010000:2.0:1789431565.233099:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.233102:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526ca2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.233107:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526ca2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.233141:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526c94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e91 expref: 204 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.233155:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e91 expref: 203 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.233163:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:2.0:1789431565.233165:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431565.233168:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b000, rc 0)
00000100:00100000:2.0:1789431565.233325:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14616:x1876351933528448:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1364us (2920us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.233333:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296104
00000100:00100000:1.0:1789431565.234971:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.235045:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933528576
00000100:00100000:0.0:1789431565.235078:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933528576
00000100:00100000:0.0:1789431565.235125:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296105
00000100:00100000:0.0:1789431565.235133:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14617:x1876351933528576:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.235156:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431565.235173:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526cb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e98 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235234:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526cb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235247:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526cb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235256:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526cb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235269:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526cbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235276:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235282:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235587:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526cc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235598:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235612:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431565.235643:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000004:00200000:0.0:1789431565.235647:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431565.235663:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235674:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235682:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526cb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235688:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526cb7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235694:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526cb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235699:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431565.235702:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526cb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235708:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526cb7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235728:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431565.235732:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431565.235736:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526cb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235742:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526cb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235753:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235759:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526cbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235764:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526cbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235768:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431565.235771:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526cbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235777:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526cbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235784:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce07190d00)
00010000:00010000:0.0:1789431565.235787:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431565.235789:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526cbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235796:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526cbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235826:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526cb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e98 expref: 205 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235842:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e98 expref: 204 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.235849:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:0.0:1789431565.235851:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431565.235854:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3c00, rc 0)
00000100:00100000:0.0:1789431565.235966:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:14617:x1876351933528576:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 833us (1002us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.235973:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296105
00000100:00100000:1.0:1789431565.241868:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.242375:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933528832
00000100:00100000:3.0:1789431565.242394:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933528832
00000100:00100000:3.0:1789431565.242474:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296106
00000100:00100000:3.0:1789431565.242487:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:14617:x1876351933528832:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431565.242517:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431565.242547:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526ccc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8e9f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.242684:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.242702:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e8a expref: 205 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.242724:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526cc5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e98 expref: 205 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.242742:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.242787:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e98 expref: 205 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.242803:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526cc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e98 expref: 205 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.242819:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0e614700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894239744:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431565.242939:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e8a expref: 205 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.242949:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e8a expref: 205 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.242959:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0e617800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894239872:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431565.242981:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead840 going to sleep for 11 seconds
00000100:00100000:1.0:1789431565.245446:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.245495:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.245534:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933529088
00000100:00100000:0.0:1789431565.245550:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933529088
00000100:00100000:0.0:1789431565.245626:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296107
00000100:00100000:0.0:1789431565.245636:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14616:x1876351933529088:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.245658:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431565.245677:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526cda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ea6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.245793:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526ce1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.245808:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526ca9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e91 expref: 207 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.245817:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526ce1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.245858:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e91 expref: 207 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.245871:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526ca9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e91 expref: 207 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.245884:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e828700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894240000:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431565.245978:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b6a26c0 going to sleep for 11 seconds
00000100:00100000:2.0:1789431565.249676:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933529216
00000100:00100000:2.0:1789431565.249698:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933529216
00010000:00010000:2.0:1789431565.249777:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526cc5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e98 expref: 208 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.249832:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16606
00000100:00100000:2.0:1789431565.249844:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:2348:x1876351933529216:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431565.249863:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431565.249871:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526cc5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e98 expref: 208 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.249886:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526cc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e98 expref: 208 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.249916:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431565.249923:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.249934:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.249941:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431565.250202:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:2348:x1876351933529216:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 358us (4705us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.250212:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16606
00010000:00010000:3.0:1789431565.254380:0:5849:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@000000008e85ba98 x1876351894239744) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526cc5 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e98 expref: 207 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.254411:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526cc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e98 expref: 207 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.254433:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce0e614700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894239744:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431565.257977:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.258184:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce0e617800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894239872:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431565.258221:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00000100:00100000:2.0:1789431565.258233:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e828700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894240000:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431565.258235:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.258274:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526ce1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.258313:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.258323:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.258825:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933529344
00000100:00100000:1.0:1789431565.258834:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933529344
00010000:00010000:1.0:1789431565.258939:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e8a expref: 207 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.258978:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16607
00000100:00100000:1.0:1789431565.258988:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e829c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:2348:x1876351933529344:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.259003:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.259011:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e8a expref: 207 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.259023:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e8a expref: 207 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.259190:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63526c8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e8a expref: 207 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.259208:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:1.0:1789431565.259212:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.259221:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.259230:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.260359:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.260560:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933529472
00000100:00100000:0.0:1789431565.260581:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933529472
00010000:00010000:0.0:1789431565.260630:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526ca9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e91 expref: 207 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.260679:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16608
00000100:00100000:0.0:1789431565.260691:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:2348:x1876351933529472:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431565.260708:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431565.260723:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526ca9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e91 expref: 207 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.260746:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e91 expref: 207 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.260772:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526ca9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e91 expref: 207 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.260793:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:0.0:1789431565.260800:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526ce1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.260815:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526ce1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.260824:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526ce1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.260857:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431565.260933:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2348:x1876351933529472:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 241us (583us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.260942:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16608
00010000:00010000:2.0:1789431565.261123:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526ce1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.261139:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526ce1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431565.261164:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00010000:00010000:2.0:1789431565.261403:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526cda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ea6 expref: 207 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.261422:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526ce1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ea6 expref: 206 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.261431:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:2.0:1789431565.261434:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431565.261437:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2600, rc 0)
00000100:00100000:2.0:1789431565.261470:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14616:x1876351933529088:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 15836us (16041us total) trans 4295121042 rc 0/0
00000100:00100000:2.0:1789431565.261478:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296107
00010000:00010000:1.0:1789431565.262839:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431565.262893:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.262909:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431565.262935:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000100:00100000:1.0:1789431565.263037:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e829c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2348:x1876351933529344:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 4042us (5062us total) trans 0 rc 0/0
00010000:00010000:0.0:1789431565.263135:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526ccc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e9f expref: 207 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.263162:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e9f expref: 206 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.263172:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:0.0:1789431565.263175:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431565.263179:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b275200, rc 0)
00000100:00100000:1.0:1789431565.263220:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16607
00000100:00100000:0.0:1789431565.263228:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14617:x1876351933528832:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 20741us (21375us total) trans 4295121043 rc 0/0
00000100:00100000:0.0:1789431565.263239:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296106
00000100:00100000:3.0:1789431565.268201:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.268376:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933529600
00000100:00100000:2.0:1789431565.268394:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933529600
00000100:00100000:2.0:1789431565.268475:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296108
00000100:00100000:2.0:1789431565.268486:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14616:x1876351933529600:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431565.268514:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431565.268541:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526cf6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ead expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.268665:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526cfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.268687:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526ce1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ea6 expref: 206 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.268697:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526cfd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.268759:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526ce1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ea6 expref: 206 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.268776:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526ce1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ea6 expref: 206 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.268792:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894240128:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431565.268904:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38a80 going to sleep for 11 seconds
00000100:00100000:2.0:1789431565.274396:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.274475:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933529728
00000100:00100000:0.0:1789431565.274492:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933529728
00000100:00100000:0.0:1789431565.274586:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296109
00000100:00100000:0.0:1789431565.274598:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14617:x1876351933529728:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.274633:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431565.274660:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526d04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8eb4 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.274789:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63526d0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.274806:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e9f expref: 208 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.274816:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63526d0b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.274865:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e9f expref: 208 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.274881:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e9f expref: 208 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.274889:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894240128:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431565.274904:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894240256:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431565.274924:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526cfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.275021:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b6a2600 going to sleep for 11 seconds
00000100:00100000:3.0:1789431565.278781:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894240256:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431565.278825:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63526d0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.279912:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.280104:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933529856
00000100:00100000:1.0:1789431565.280121:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933529856
00010000:00010000:1.0:1789431565.280185:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526ce1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ea6 expref: 209 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.280236:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16609
00000100:00100000:1.0:1789431565.280249:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:2347:x1876351933529856:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.280268:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.280276:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526ce1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ea6 expref: 209 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.280296:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526ce1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ea6 expref: 209 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.280324:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63526ce1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ea6 expref: 209 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.280346:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:1.0:1789431565.280353:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526cfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.280363:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.280373:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526cfd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.280410:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431565.280477:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.280485:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:2347:x1876351933529856:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 237us (579us total) trans 0 rc 0/0
00010000:00010000:2.0:1789431565.280500:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.280507:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16609
00000004:00200000:2.0:1789431565.280677:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000004:00200000:2.0:1789431565.280682:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431565.280706:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.280824:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526cf6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ead expref: 208 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.280910:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526cfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ead expref: 207 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.280922:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:2.0:1789431565.280925:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431565.280929:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7aa00, rc 0)
00000100:00100000:2.0:1789431565.280985:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14616:x1876351933529600:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12500us (12794us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.280993:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296108
00000100:00100000:2.0:1789431565.284534:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.284977:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933529984
00000100:00100000:3.0:1789431565.284991:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933529984
00010000:00010000:3.0:1789431565.287517:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e9f expref: 207 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.287640:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16610
00000100:00100000:3.0:1789431565.287667:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:2347:x1876351933529984:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431565.287694:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431565.287706:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e9f expref: 207 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.287956:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e9f expref: 207 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.287994:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526cd3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e9f expref: 207 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.288017:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:3.0:1789431565.288024:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63526d0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.288036:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63526d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.288076:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63526d0b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.288115:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431565.288183:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63526d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.288196:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63526d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.288196:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2347:x1876351933529984:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 545us (3675us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.288212:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16610
00000004:00200000:2.0:1789431565.288276:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000004:00200000:2.0:1789431565.288283:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431565.288310:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63526d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.288348:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526d04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8eb4 expref: 206 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.288366:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63526d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8eb4 expref: 205 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.288380:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431565.288383:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431565.288386:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3a00, rc 0)
00000100:00100000:2.0:1789431565.288418:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14617:x1876351933529728:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 13823us (14032us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.288426:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296109
00000100:00100000:0.0:1789431565.294547:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.296969:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933530112
00000100:00100000:2.0:1789431565.296990:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933530112
00000100:00100000:2.0:1789431565.297102:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296110
00000100:00100000:2.0:1789431565.297115:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14617:x1876351933530112:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431565.297143:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431565.297175:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526d12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ebb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.297276:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d19 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.297295:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.297311:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.297330:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526d20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.297338:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.297346:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.297789:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526d27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.297801:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.297810:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431565.297857:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000004:00200000:2.0:1789431565.297863:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431565.297888:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.297900:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.297909:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.297916:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d19 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.297924:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.297930:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.297935:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.297943:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d19 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.300270:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431565.300285:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.300296:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.300308:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.300333:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.300341:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526d20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.300349:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526d20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.300356:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.300360:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526d20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.300368:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526d20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.300377:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90cf13195b00)
00010000:00010000:2.0:1789431565.300380:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.300383:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526d20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.300389:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526d20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.300455:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526d12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ebb expref: 207 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.300471:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526d27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ebb expref: 206 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.300478:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431565.300481:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431565.300483:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b000, rc 0)
00000100:00100000:2.0:1789431565.300580:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14617:x1876351933530112:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3466us (6046us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.300590:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296110
00000100:00100000:0.0:1789431565.302374:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.302462:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933530240
00000100:00100000:3.0:1789431565.302476:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933530240
00000100:00100000:3.0:1789431565.302549:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296111
00000100:00100000:3.0:1789431565.302561:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14616:x1876351933530240:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431565.302598:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431565.302626:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526d2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ec2 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.302720:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526d35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.302754:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526d35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.302769:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526d35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.302786:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526d3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe5dc7a0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.302794:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.302801:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303166:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526d43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303177:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526d43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303185:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526d43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431565.303227:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10091:0x0]: returning size 260096
00000004:00200000:3.0:1789431565.303232:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431565.303256:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526d43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303274:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526d43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303287:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526d35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303294:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526d35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303301:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526d35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303307:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b275400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431565.303312:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526d35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303321:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526d35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303335:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431565.303339:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431565.303346:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526d35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303353:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526d35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303367:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303372:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526d3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303378:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303384:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b275a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431565.303387:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303393:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526d3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303399:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe5dc7a0b (ffff90cf18b78300)
00010000:00010000:3.0:1789431565.303402:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431565.303404:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526d3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303410:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526d3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303445:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526d2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ec2 expref: 208 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303459:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526d43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ec2 expref: 207 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.303467:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10091:0x0].0x0 (ffff90ce15f16d00)
00010000:00010000:3.0:1789431565.303469:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431565.303472:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ac600, rc 0)
00000100:00100000:3.0:1789431565.303552:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14616:x1876351933530240:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 994us (1194us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.303560:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296111
00000100:00100000:2.0:1789431565.307481:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.307614:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933530496
00000100:00100000:3.0:1789431565.307631:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933530496
00000100:00100000:3.0:1789431565.307707:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296112
00000100:00100000:3.0:1789431565.307738:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14617:x1876351933530496:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431565.307812:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:3.0:1789431565.307849:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526d27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ebb expref: 207 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.307874:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63526d0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8eb4 expref: 206 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.307886:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:3.0:1789431565.307893:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431565.307948:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526d4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.307966:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526d4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.307978:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526d4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431565.308649:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000871ee858 reply state 000000003724f67a transno 4295121044 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526d4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.308663:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431565.315356:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.315420:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.316762:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933530624
00000100:00100000:1.0:1789431565.316779:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933530624
00000100:00100000:1.0:1789431565.316877:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14359
00000100:00100000:1.0:1789431565.316889:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e950850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:2347:x1876351933530624:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.316910:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.316945:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526d43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ec2 expref: 207 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.316975:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10091:0x0].0x0 (ffff90ce15f16d00)
00010000:00010000:1.0:1789431565.316981:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431565.317089:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e950850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2347:x1876351933530624:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 202us (1748us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.317098:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14359
00000100:00100000:3.0:1789431565.317515:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933530880
00000100:00100000:3.0:1789431565.317522:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933530880
00000100:00100000:3.0:1789431565.317574:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296113
00000100:00100000:3.0:1789431565.317584:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14616:x1876351933530880:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431565.317610:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431565.317631:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526d51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ec9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.317768:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526d58 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10091:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.317786:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612e00/0xd8e438fb63511643 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c260f expref: 207 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.317794:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526d58 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10091:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.317836:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612e00/0xd8e438fb63511643 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c260f expref: 207 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.317850:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612e00/0xd8e438fb63511643 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c260f expref: 207 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.317866:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0e617800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894240384:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431565.317941:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead3c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431565.319091:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14617:x1876351933530496:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 11352us (11614us total) trans 4295121044 rc 0/0
00000100:00100000:0.0:1789431565.319104:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296112
00010000:00010000:1.0:1789431565.323877:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526d4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.323900:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526d4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.323908:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526d4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.323915:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ace00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.323920:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526d4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.323928:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526d4a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.323950:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:1.0:1789431565.323954:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.323961:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526d4a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.323967:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526d4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.324921:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce0e617800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894240384:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431565.324958:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526d58 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10091:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.327559:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.327693:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.327830:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933531136
00000100:00100000:3.0:1789431565.327846:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933531136
00010000:00010000:3.0:1789431565.327903:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612e00/0xd8e438fb63511643 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c260f expref: 207 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.327957:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16611
00000100:00100000:3.0:1789431565.327969:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:2347:x1876351933531136:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431565.327988:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431565.327997:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612e00/0xd8e438fb63511643 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c260f expref: 207 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.328011:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612e00/0xd8e438fb63511643 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c260f expref: 207 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.328039:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e612e00/0xd8e438fb63511643 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c260f expref: 207 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.328097:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10091:0x0].0x0 (ffff90ce15f16d00)
00010000:00010000:3.0:1789431565.328105:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526d58 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10091:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.328115:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526d58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10091:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.328124:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526d58 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10091:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.328155:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431565.328219:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2347:x1876351933531136:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 252us (525us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.328228:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16611
00010000:00010000:0.0:1789431565.328230:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526d58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10091:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.328239:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526d58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10091:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431565.328263:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10091:0x0]: returning size 260096
00010000:00010000:0.0:1789431565.328467:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526d51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ec9 expref: 207 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.328486:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526d58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10091:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ec9 expref: 206 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.328493:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10091:0x0].0x0 (ffff90ce15f16d00)
00010000:00010000:0.0:1789431565.328497:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431565.328499:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7acc00, rc 0)
00000100:00100000:0.0:1789431565.328526:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14616:x1876351933530880:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10945us (13106us total) trans 4295121045 rc 0/0
00000100:00100000:0.0:1789431565.328534:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296113
00000100:00100000:2.0:1789431565.328644:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933531008
00000100:00100000:2.0:1789431565.328651:0:14502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933531008
00000100:00100000:2.0:1789431565.328695:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8349
00000100:00100000:2.0:1789431565.328706:0:14502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2350:x1876351933531008:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:2.0:1789431565.328967:0:14502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x515:0x0] updating lvb size from disk: 85515 -> 85515
00002000:00010000:2.0:1789431565.328971:0:14502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x515:0x0] updating lvb mtime from disk: 1789431552 -> 1789431552
00002000:00010000:2.0:1789431565.328974:0:14502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x515:0x0] updating lvb atime from disk: 1789431553 -> 1789431554
00002000:00010000:2.0:1789431565.328976:0:14502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x515:0x0] updating lvb ctime from disk: 1789431564 -> 1789431564
00002000:00010000:2.0:1789431565.328979:0:14502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x515:0x0] updating lvb blocks from disk: 259 -> 259
00000100:00100000:2.0:1789431565.329006:0:14502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2350:x1876351933531008:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 304us (1463us total) trans 4294970047 rc 0/0
00000100:00100000:2.0:1789431565.329015:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8349
00000100:00100000:2.0:1789431565.336124:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.336201:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933531264
00000100:00100000:3.0:1789431565.336226:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933531264
00000100:00100000:3.0:1789431565.336318:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296114
00000100:00100000:3.0:1789431565.336331:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14617:x1876351933531264:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431565.336364:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431565.336392:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526d66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ed0 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.336454:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431565.336480:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526d6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.336500:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526d6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.336515:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526d6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.336531:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526d74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.336539:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.336547:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.336653:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933531392
00000100:00100000:2.0:1789431565.336659:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933531392
00000100:00100000:2.0:1789431565.336703:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296115
00000100:00100000:2.0:1789431565.336720:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14616:x1876351933531392:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431565.336729:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431565.336837:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526d6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.336848:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526d6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.336855:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526d7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10091:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ed7 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.336865:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526d6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.336874:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431565.336879:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526d6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.336888:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526d6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.336902:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431565.336906:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431565.336914:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526d6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.336920:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526d6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.336927:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.336936:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.336943:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526d58 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10091:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ec9 expref: 209 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.336946:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526d74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.336961:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d82 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.336962:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526d74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.336979:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431565.336982:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526d74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.336993:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526d74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.337001:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x7f7efb67 (ffff90cf18b78300)
00010000:00010000:3.0:1789431565.337003:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431565.337006:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526d74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.337012:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526d74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.337014:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526d58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10091:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ec9 expref: 209 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.337042:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526d58 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10091:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ec9 expref: 209 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.337089:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526d66 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ed0 expref: 209 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.337098:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431565.337101:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431565.337105:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526d66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ed0 expref: 209 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.337116:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad000, rc 0)
00000100:00100000:2.0:1789431565.337163:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894240512:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431565.337199:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14617:x1876351933531264:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 870us (1089us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431565.337208:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296114
00000100:00100000:2.0:1789431565.337565:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb389c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431565.344420:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.344542:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933531520
00000100:00100000:2.0:1789431565.344555:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933531520
00000100:00100000:2.0:1789431565.344635:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296116
00000100:00100000:2.0:1789431565.344647:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14617:x1876351933531520:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431565.344675:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431565.344703:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526d89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ede expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.344807:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526d90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.344826:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.344841:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431565.344886:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008c:0x0]: returning size 16384
00000004:00200000:2.0:1789431565.344890:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431565.344913:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.344943:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526d89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ede expref: 210 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.344963:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526d90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ede expref: 209 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.344972:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431565.344975:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:2.0:1789431565.344979:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b600, rc 0)
00000100:00100000:2.0:1789431565.345108:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:14617:x1876351933531520:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 463us (705us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.345116:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296116
00000100:00100000:1.0:1789431565.346086:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894240512:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431565.346122:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.347564:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.347786:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933531648
00000100:00100000:3.0:1789431565.347799:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933531648
00010000:00010000:3.0:1789431565.347853:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526d58 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10091:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ec9 expref: 209 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.347907:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16612
00000100:00100000:3.0:1789431565.347919:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:2347:x1876351933531648:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431565.347943:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431565.347951:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526d58 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10091:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ec9 expref: 209 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.347965:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526d58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10091:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ec9 expref: 209 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.347992:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526d58 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10091:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ec9 expref: 209 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.348014:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10091:0x0].0x0 (ffff90ce15f16d00)
00010000:00010000:3.0:1789431565.348019:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.348030:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.348039:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d82 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.348107:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431565.348177:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:2347:x1876351933531648:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 259us (626us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.348185:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16612
00010000:00010000:1.0:1789431565.348594:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.348605:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431565.348677:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10091:0x0]: returning size 260096
00000004:00200000:1.0:1789431565.348683:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431565.348722:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.348765:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526d7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10091:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ed7 expref: 208 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.348784:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b800/0xd8e438fb63526d82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10091:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ed7 expref: 207 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.348792:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10091:0x0].0x0 (ffff90ce15f16d00)
00010000:00010000:1.0:1789431565.348795:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431565.348798:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b800, rc 0)
00000100:00100000:1.0:1789431565.348838:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14616:x1876351933531392:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12127us (12384us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.348849:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296115
00000100:00100000:2.0:1789431565.351951:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.352027:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933531776
00000100:00100000:1.0:1789431565.352041:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933531776
00000100:00100000:1.0:1789431565.352139:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12493
00000100:00100000:1.0:1789431565.352154:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14617:x1876351933531776:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431565.361010:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.361183:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933532032
00000100:00100000:2.0:1789431565.361197:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933532032
00000100:00100000:2.0:1789431565.361282:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12494
00000100:00100000:2.0:1789431565.361294:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:14616:x1876351933532032:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431565.362227:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:14616:x1876351933532032:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 927us (1229us total) trans 4295121046 rc 0/0
00000100:00100000:2.0:1789431565.362239:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12494
00000100:00100000:1.0:1789431565.366994:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14617:x1876351933531776:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 14828us (15041us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.367011:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12493
00000100:00100000:3.0:1789431565.368422:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.370038:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933532160
00000100:00100000:1.0:1789431565.370103:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933532160
00000100:00100000:1.0:1789431565.370185:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296117
00000100:00100000:1.0:1789431565.370199:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14616:x1876351933532160:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431565.370238:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431565.370275:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526d97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ee5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370363:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526d9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370380:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526d9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370394:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526d9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370413:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526da5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370424:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370432:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370786:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526dac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370797:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370804:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431565.370853:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000004:00200000:1.0:1789431565.370859:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431565.370883:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370897:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370907:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526d9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370913:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526d9e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370921:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526d9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370931:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.370936:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526d9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370944:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526d9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370959:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431565.370962:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.370968:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526d9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370975:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526d9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370989:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.370995:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526da5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.371001:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526da5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.371006:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.371008:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526da5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.371014:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526da5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.371024:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce03149400)
00010000:00010000:1.0:1789431565.371027:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.371030:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526da5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.371036:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526da5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.371393:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526d97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ee5 expref: 210 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.371413:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526dac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ee5 expref: 209 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.371421:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:1.0:1789431565.371423:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431565.371426:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308c00, rc 0)
00000100:00100000:1.0:1789431565.371514:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:14616:x1876351933532160:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1317us (3098us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.371523:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296117
00000100:00100000:1.0:1789431565.373145:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.373361:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933532416
00000100:00100000:3.0:1789431565.373373:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933532416
00000100:00100000:3.0:1789431565.373443:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296118
00000100:00100000:3.0:1789431565.373455:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:14617:x1876351933532416:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431565.373486:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431565.373490:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431565.373524:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526d90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ede expref: 209 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.373547:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431565.373553:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431565.373569:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526db3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8eec expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.373921:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526dba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.373937:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.373949:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.373967:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526dc1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.373974:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.373986:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:3.0:1789431565.375467:0:12775:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x517:0x0], index 0: 0
00010000:00010000:3.0:1789431565.376020:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526dc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aaa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.376040:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aaa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.376082:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aaa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.376133:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.376141:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526dba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.376150:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526dba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.376157:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431565.376162:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526dba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.376171:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526dba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.376185:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431565.376188:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431565.376195:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526dba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.376202:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526dba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431565.376218:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005a41f793 reply state 000000007cd2b217 transno 4295121047 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.376228:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431565.376426:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526db3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8eec expref: 211 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.376445:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aaa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8eec expref: 210 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.376452:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aaa:0x0].0x0 (ffff90cf18b78d00)
00010000:00010000:3.0:1789431565.376454:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431565.376457:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad400, rc 0)
00000100:00100000:3.0:1789431565.376566:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:14617:x1876351933532416:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3113us (3433us total) trans 4295121047 rc 0/0
00000100:00100000:3.0:1789431565.376577:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296118
00000100:00100000:2.0:1789431565.387355:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431565.387795:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.387814:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526dc1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.387823:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526dc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.387832:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.387838:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526dc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.387846:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526dc1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.387869:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x7f7efb67 (ffff90cf18b78300)
00010000:00010000:1.0:1789431565.387872:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.387879:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526dc1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.387886:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526dc1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.388511:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933532544
00000100:00100000:0.0:1789431565.388526:0:14505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933532544
00000100:00100000:0.0:1789431565.388620:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8350
00000100:00100000:0.0:1789431565.388644:0:14505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+75:2349:x1876351933532544:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.388670:0:14505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431565.388695:0:14505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d27ff86/0xd8e438fb63526dd6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ef3 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789431565.388749:0:14505:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x517:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431565.388777:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x517:0x0].0x0 since=3023s v=(0 0)
00010000:00010000:0.0:1789431565.388783:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x517:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431565.388794:0:14505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d27ff86/0xd8e438fb63526dd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ef3 expref: 76 pid: 14505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.388817:0:14505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001d27ff86/0xd8e438fb63526dd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ef3 expref: 76 pid: 14505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.388831:0:14505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2600, rc 0)
00000100:00100000:0.0:1789431565.388920:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+76:2349:x1876351933532544:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 289us (1580us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.388928:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8350
00000100:00080000:1.0:1789431565.389204:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1789431565.394316:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.394355:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.394484:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933532800
00000100:00100000:0.0:1789431565.394499:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933532800
00000100:00100000:0.0:1789431565.394573:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296119
00000100:00100000:0.0:1789431565.394586:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:14616:x1876351933532800:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.394617:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431565.394656:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63526ddd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8efa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.394868:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.394887:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526cfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ead expref: 211 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.394896:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526dac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ee5 expref: 211 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.394905:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.394947:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526dac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ee5 expref: 211 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.394963:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526dac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ee5 expref: 211 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.394986:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894240640:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431565.395171:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526cfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ead expref: 211 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.395181:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526cfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ead expref: 211 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.395190:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e829c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894240768:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431565.395218:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b6a2900 going to sleep for 11 seconds
00000100:00100000:3.0:1789431565.395495:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933532928
00000100:00100000:3.0:1789431565.395503:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933532928
00010000:00010000:3.0:1789431565.395538:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526dac lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ee5 expref: 212 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.396141:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16613
00000100:00100000:3.0:1789431565.396155:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:2350:x1876351933532928:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431565.396176:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431565.396184:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526dac lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ee5 expref: 212 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.396199:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526dac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ee5 expref: 212 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.396223:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:3.0:1789431565.396229:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.396238:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.396298:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431565.396346:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:2350:x1876351933532928:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 196us (1989us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.396355:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16613
00000100:00100000:2.0:1789431565.396994:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.398158:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933533184
00000100:00100000:0.0:1789431565.398175:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933533184
00000100:00100000:0.0:1789431565.398281:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12495
00000100:00100000:0.0:1789431565.398294:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14617:x1876351933533184:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431565.398782:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14617:x1876351933533184:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 490us (1791us total) trans 4295121048 rc 0/0
00000100:00100000:0.0:1789431565.398792:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12495
00010000:00010000:0.0:1789431565.412807:0:5849:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@0000000005281523 x1876351894240640) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526dac lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ee5 expref: 212 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.412841:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526dac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ee5 expref: 212 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.412866:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894240640:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431565.413335:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.413425:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e829c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894240768:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431565.413456:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:0.0:1789431565.413465:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.413477:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.413479:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933533312
00010000:00010000:0.0:1789431565.413489:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.413492:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933533312
00010000:00010000:1.0:1789431565.413543:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526cfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ead expref: 212 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.413586:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16614
00000100:00100000:1.0:1789431565.413597:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:2347:x1876351933533312:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.413626:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.413634:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526cfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ead expref: 212 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.413646:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526cfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ead expref: 212 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.413672:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526cfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ead expref: 212 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.413685:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:1.0:1789431565.413690:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.413699:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.413707:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.413748:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431565.413821:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:2347:x1876351933533312:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 224us (488us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.413828:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16614
00010000:00010000:0.0:1789431565.413889:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.413897:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431565.413924:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000100:00100000:2.0:1789431565.414032:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431565.414198:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63526ddd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8efa expref: 212 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.414217:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8efa expref: 211 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.414224:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:0.0:1789431565.414227:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431565.414229:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2400, rc 0)
00000100:00100000:0.0:1789431565.414275:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:14616:x1876351933532800:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 19692us (19974us total) trans 4295121049 rc 0/0
00000100:00100000:0.0:1789431565.414286:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296119
00000100:00100000:1.0:1789431565.414680:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933533568
00000100:00100000:1.0:1789431565.414689:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933533568
00000100:00100000:1.0:1789431565.414751:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12496
00000100:00100000:1.0:1789431565.414761:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:14617:x1876351933533568:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431565.415271:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14617:x1876351933533568:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 509us (1236us total) trans 4295121050 rc 0/0
00000100:00100000:1.0:1789431565.415281:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12496
00000100:00100000:3.0:1789431565.420778:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.420874:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933533696
00000100:00100000:1.0:1789431565.420889:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933533696
00000100:00100000:1.0:1789431565.420971:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296120
00000100:00100000:1.0:1789431565.420985:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14616:x1876351933533696:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431565.421017:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431565.421046:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526df2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f01 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.421210:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526df9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.421229:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8efa expref: 213 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.421239:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526df9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.421281:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8efa expref: 213 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.421298:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8efa expref: 213 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.421314:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894240896:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431565.421425:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1e8c9cc0 going to sleep for 11 seconds
00000100:00100000:1.0:1789431565.427813:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894240896:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431565.427866:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526df9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.429496:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.429837:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933534080
00000100:00100000:1.0:1789431565.429850:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933534080
00010000:00010000:1.0:1789431565.429906:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8efa expref: 214 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.429951:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16615
00000100:00100000:1.0:1789431565.429963:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:2348:x1876351933534080:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.429982:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.429989:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8efa expref: 214 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.430003:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8efa expref: 214 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.430031:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526de4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8efa expref: 214 pid: 5849 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.430145:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:1.0:1789431565.430152:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526df9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.430165:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.430175:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526df9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.430206:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431565.430254:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.430266:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431565.430333:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000004:00200000:2.0:1789431565.430339:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431565.430367:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.430413:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526df2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f01 expref: 214 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.430433:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f01 expref: 213 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.430441:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:2.0:1789431565.430444:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431565.430446:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309200, rc 0)
00000100:00100000:1.0:1789431565.434438:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:2348:x1876351933534080:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 4457us (4935us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.434441:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14616:x1876351933533696:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 13455us (13672us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.434463:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296120
00000100:00100000:1.0:1789431565.434464:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16615
00000100:00100000:3.0:1789431565.435568:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.436167:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933533952
00000100:00100000:0.0:1789431565.436181:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933533952
00000100:00100000:0.0:1789431565.436349:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12497
00000100:00100000:0.0:1789431565.436363:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14617:x1876351933533952:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431565.437396:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14617:x1876351933533952:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 1027us (1828us total) trans 4295121051 rc 0/0
00000100:00100000:3.0:1789431565.439636:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.439752:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933534336
00000100:00100000:1.0:1789431565.439772:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933534336
00000100:00100000:0.0:1789431565.441398:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12497
00000100:00100000:1.0:1789431565.441520:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12498
00000100:00100000:1.0:1789431565.441543:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14616:x1876351933534336:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431565.442183:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:14616:x1876351933534336:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 649us (2558us total) trans 4295121052 rc 0/0
00000100:00100000:1.0:1789431565.442193:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12498
00000100:00100000:3.0:1789431565.449186:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.449315:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.450485:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933534720
00000100:00100000:1.0:1789431565.450503:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933534720
00000100:00100000:1.0:1789431565.450582:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12499
00000100:00100000:1.0:1789431565.450595:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:14617:x1876351933534720:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431565.450951:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14617:x1876351933534720:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 357us (1634us total) trans 4295121053 rc 0/0
00000100:00100000:1.0:1789431565.450960:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12499
00000100:00100000:2.0:1789431565.452435:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933534464
00000100:00100000:2.0:1789431565.452453:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933534464
00000100:00100000:3.0:1789431565.452797:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296121
00000100:00100000:3.0:1789431565.452813:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14616:x1876351933534464:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431565.452851:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431565.452882:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526e00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f08 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.452981:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453001:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453016:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453039:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453127:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453136:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453556:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526e15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453568:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453577:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431565.453722:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000004:00200000:3.0:1789431565.453794:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431565.453826:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453842:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453852:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453859:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453866:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453872:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431565.453878:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453886:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453899:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431565.453903:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431565.453910:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453917:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453931:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453937:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453944:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453949:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431565.453952:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453958:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453966:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf18b78400)
00010000:00010000:3.0:1789431565.453968:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431565.453970:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.453976:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.454323:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526e00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f08 expref: 217 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.454341:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526e15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f08 expref: 216 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.454350:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:3.0:1789431565.454353:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431565.454356:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad800, rc 0)
00000100:00100000:3.0:1789431565.454456:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14616:x1876351933534464:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1647us (5283us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.454468:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296121
00000100:00100000:3.0:1789431565.457033:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.457139:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933534976
00000100:00100000:1.0:1789431565.457153:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933534976
00000100:00100000:1.0:1789431565.457231:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296122
00000100:00100000:1.0:1789431565.457253:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14617:x1876351933534976:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431565.457329:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.457365:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526dc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aaa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8eec expref: 216 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.457387:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aaa:0x0].0x0 (ffff90cf18b78d00)
00010000:00010000:1.0:1789431565.457400:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431565.457429:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526e1c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.457450:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526e1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.457463:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526e1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.457483:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.457490:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.457496:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.457651:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526e2a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aaa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.457661:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526e2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.457668:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526e2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431565.458452:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1247, 64 off88000
00010000:00010000:1.0:1789431565.458540:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526e31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aaa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458553:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aaa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458563:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aaa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458572:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526e31 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aaa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458578:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526e31 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aaa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458584:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526e31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aaa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458616:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431565.458641:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526e2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458649:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526e2a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458656:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526e2a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458663:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.458670:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526e2a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458678:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526e2a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.458685:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431565.458690:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aaa:0x0].0x0 (ffff90ce03149200)
00010000:00010000:2.0:1789431565.458695:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526e31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aaa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458696:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431565.458702:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526e2a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aaa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458725:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526e2a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aaa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458746:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526e1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458753:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526e1c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458760:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526e1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458765:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.458768:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526e1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458775:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526e1c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458785:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431565.458785:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308c00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431565.458792:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.458793:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526e31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aaa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458796:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526e1c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.458810:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526e31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aaa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.458812:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63526e1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431565.458836:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ab57565b reply state 000000001d75e427 transno 4295121054 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.458838:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aaa:0x0].0x0 (ffff90ce03149200)
00010000:00010000:2.0:1789431565.458844:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431565.458848:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526e31 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10aaa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.458851:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:2.0:1789431565.458859:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63526e31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aaa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.458877:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431565.458880:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431565.458882:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431565.458969:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14617:x1876351933534976:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1725us (1948us total) trans 4295121054 rc 0/0
00000100:00100000:1.0:1789431565.458978:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296122
00000100:00100000:3.0:1789431565.460909:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.461021:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933535232
00000100:00100000:0.0:1789431565.461033:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933535232
00000100:00100000:0.0:1789431565.461136:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296123
00000100:00100000:0.0:1789431565.461148:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14616:x1876351933535232:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.461182:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431565.461207:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526e38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f0f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.461364:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526e3f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.461387:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526df9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f01 expref: 218 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.461397:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526e15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f08 expref: 218 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.461407:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526e3f lrc: 5/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.461454:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526e15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f08 expref: 218 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.461470:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526e15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f08 expref: 218 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.461486:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e829c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894241024:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431565.461601:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f01 expref: 218 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.462306:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526df9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f01 expref: 218 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.462321:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894241152:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431565.462377:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b6a2900 going to sleep for 11 seconds
00010000:00010000:1.0:1789431565.462617:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.462629:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.462636:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.462641:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.462646:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.462655:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.462674:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x7f7efb67 (ffff90ce03149400)
00010000:00010000:1.0:1789431565.462677:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.462683:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.462690:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.470954:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.471001:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.471102:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.471240:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933535360
00000100:00100000:1.0:1789431565.471255:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933535360
00010000:00010000:1.0:1789431565.471310:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526e15 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f08 expref: 218 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.471350:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933535616
00000100:00100000:1.0:1789431565.471354:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933535616
00010000:00010000:1.0:1789431565.471367:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526df9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f01 expref: 219 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.471392:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16616
00000100:00100000:1.0:1789431565.471404:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:2348:x1876351933535360:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.471421:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.471430:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526e15 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f08 expref: 219 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.471446:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526e15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f08 expref: 219 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.471458:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16617
00000100:00100000:0.0:1789431565.471473:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb06c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:2348:x1876351933535616:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.471476:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:0.0:1789431565.471483:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.471485:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526e3f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.471493:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526df9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f01 expref: 219 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.471500:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526e3f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.471511:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431565.471628:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933535488
00000100:00100000:3.0:1789431565.471634:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933535488
00000100:00100000:3.0:1789431565.471720:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296124
00000100:00100000:3.0:1789431565.471736:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14617:x1876351933535488:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431565.471761:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431565.471790:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526e46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f16 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.471851:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:2348:x1876351933535360:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 447us (847us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.471862:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16616
00010000:00010000:3.0:1789431565.471865:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.471881:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.471894:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.471910:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.471918:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.471927:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.471929:0:5848:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@00000000a6aba7a9 x1876351894241024) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526e15 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f08 expref: 220 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472103:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526e5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472113:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472120:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431565.472163:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000004:00200000:3.0:1789431565.472168:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431565.472193:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472206:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472215:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472222:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472229:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472236:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431565.472241:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472261:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472272:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431565.472275:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431565.472279:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472286:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472299:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472305:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472310:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472315:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431565.472318:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472324:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472331:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90cf18b78400)
00010000:00010000:3.0:1789431565.472334:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431565.472337:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472344:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472379:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526e46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f16 expref: 221 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472394:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526e5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f16 expref: 220 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.472402:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:3.0:1789431565.472405:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431565.472408:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ace00, rc 0)
00000100:00100000:3.0:1789431565.472444:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14617:x1876351933535488:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 717us (1505us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.472452:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296124
00010000:00010000:0.0:1789431565.472705:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526df9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f01 expref: 219 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.472733:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:0.0:1789431565.472738:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526e3f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.472748:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526e3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.472755:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526e3f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.472790:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431565.472814:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb06c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:2348:x1876351933535616:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1346us (1712us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.472822:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16617
00010000:00010000:1.0:1789431565.473256:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526e15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f08 expref: 218 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.473277:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e829c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894241024:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431565.473306:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526df9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f01 expref: 217 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.473317:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894241152:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431565.473341:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:1.0:1789431565.473347:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526e3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.473357:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526e3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.473364:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526e3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431565.473384:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00010000:00010000:1.0:1789431565.473558:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526e38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f0f expref: 218 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.473571:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526e3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f0f expref: 217 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.473584:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:1.0:1789431565.473586:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431565.473589:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2e00, rc 0)
00000100:00100000:1.0:1789431565.473964:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14616:x1876351933535232:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12816us (13067us total) trans 4295121055 rc 0/0
00000100:00100000:1.0:1789431565.473971:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296123
00000100:00100000:2.0:1789431565.481394:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.482939:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933535744
00000100:00100000:1.0:1789431565.482958:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933535744
00000100:00100000:1.0:1789431565.483038:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296125
00000100:00100000:1.0:1789431565.483089:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14616:x1876351933535744:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431565.483124:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431565.483152:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526e69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f1d expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.483280:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.483299:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526e3f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f0f expref: 218 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.483310:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e70 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.483355:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526e3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f0f expref: 218 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.483371:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526e3f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f0f expref: 218 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.483389:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894241280:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431565.483497:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1e8c93c0 going to sleep for 11 seconds
00000100:00100000:2.0:1789431565.489123:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894241280:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431565.489166:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.489392:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.489512:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.492074:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933536128
00000100:00100000:0.0:1789431565.492080:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933535872
00000100:00100000:0.0:1789431565.492104:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933535872
00000100:00100000:2.0:1789431565.492104:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933536128
00010000:00010000:0.0:1789431565.492188:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526e3f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f0f expref: 220 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.492243:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16618
00000100:00100000:0.0:1789431565.492257:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:2348:x1876351933535872:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431565.492281:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:2.0:1789431565.492287:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296126
00010000:00010000:0.0:1789431565.492290:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526e3f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f0f expref: 220 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.492296:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14617:x1876351933536128:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.492311:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526e3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f0f expref: 220 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.492322:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431565.492348:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526e77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f24 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.492470:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63526e3f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f0f expref: 221 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.492485:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526e7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.492497:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:2.0:1789431565.492501:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526e5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f16 expref: 220 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.492503:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.492511:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526e7e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.492513:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.492521:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e70 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.492551:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431565.492576:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526e5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f16 expref: 220 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.492590:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526e5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f16 expref: 220 pid: 12775 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.492605:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894241408:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431565.492641:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:2348:x1876351933535872:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 387us (3251us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.492648:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16618
00000100:00100000:2.0:1789431565.492680:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38f00 going to sleep for 11 seconds
00010000:00010000:2.0:1789431565.492703:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.492722:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431565.492767:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000004:00200000:2.0:1789431565.492772:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431565.492795:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.492829:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63526e69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f1d expref: 220 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.492849:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f1d expref: 219 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.492857:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:2.0:1789431565.492860:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431565.492863:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:2.0:1789431565.492896:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14616:x1876351933535744:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9848us (11518us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.492903:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296125
00000100:00100000:1.0:1789431565.499838:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894241408:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431565.499881:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526e7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.501155:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.501202:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.501308:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933536256
00000100:00100000:2.0:1789431565.501320:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933536256
00010000:00010000:2.0:1789431565.501461:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526e5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f16 expref: 219 pid: 12775 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.501521:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933536512
00000100:00100000:3.0:1789431565.501536:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933536512
00000100:00100000:2.0:1789431565.501552:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16619
00000100:00100000:2.0:1789431565.501566:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:2349:x1876351933536256:12345-192.168.203.4@tcp:103:ldlm_bl.0
00000100:00100000:3.0:1789431565.501582:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12500
00010000:00010000:2.0:1789431565.501586:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:3.0:1789431565.501595:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14616:x1876351933536512:12345-192.168.203.4@tcp:35:dbench.0
00010000:00010000:2.0:1789431565.501598:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526e5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f16 expref: 220 pid: 12775 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.501625:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526e5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f16 expref: 220 pid: 12775 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.501654:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63526e5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f16 expref: 220 pid: 12775 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.501680:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431565.501686:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526e7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.501697:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526e7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.501706:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526e7e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.501744:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431565.501809:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:2349:x1876351933536256:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 247us (663us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.501818:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16619
00000100:00100000:3.0:1789431565.502089:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14616:x1876351933536512:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 498us (885us total) trans 4295121056 rc 0/0
00000100:00100000:3.0:1789431565.502097:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12500
00010000:00010000:1.0:1789431565.502204:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526e7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.502214:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526e7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431565.502235:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00010000:00010000:1.0:1789431565.502333:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526e77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f24 expref: 220 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.502351:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526e7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f24 expref: 219 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.502358:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:1.0:1789431565.502361:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431565.502364:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b600, rc 0)
00000100:00100000:1.0:1789431565.502386:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14617:x1876351933536128:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10093us (12874us total) trans 4295121057 rc 0/0
00000100:00100000:1.0:1789431565.502394:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296126
00000100:00100000:2.0:1789431565.506478:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.506695:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933536640
00000100:00100000:3.0:1789431565.506708:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933536640
00000100:00100000:3.0:1789431565.506828:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296127
00000100:00100000:3.0:1789431565.506841:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14616:x1876351933536640:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431565.506875:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431565.506903:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526e8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f2b expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.506994:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e93 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507015:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507030:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507091:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507101:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507109:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507457:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526ea1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507468:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507477:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431565.507524:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000004:00200000:3.0:1789431565.507540:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431565.507566:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507586:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507595:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507602:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e93 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507618:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507625:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431565.507630:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507638:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507652:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431565.507655:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431565.507662:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507669:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63526e93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507683:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507689:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507696:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507702:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431565.507705:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507912:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507924:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf18b78400)
00010000:00010000:3.0:1789431565.507927:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431565.507930:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507936:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63526e9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507982:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63526e8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f2b expref: 221 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.507999:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f2b expref: 220 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.508007:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:3.0:1789431565.508010:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431565.508012:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad800, rc 0)
00000100:00100000:3.0:1789431565.508131:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14616:x1876351933536640:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1291us (1667us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.508140:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296127
00000100:00100000:2.0:1789431565.515878:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.515938:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.516029:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933536896
00000100:00100000:1.0:1789431565.516043:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933536896
00000100:00100000:1.0:1789431565.516160:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14360
00000100:00100000:1.0:1789431565.516172:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:2350:x1876351933536896:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.516192:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.516238:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63526ea1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f2b expref: 220 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.516262:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:1.0:1789431565.516268:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431565.516336:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:2350:x1876351933536896:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 167us (474us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.516344:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14360
00000100:00100000:2.0:1789431565.517025:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.517969:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933536768
00000100:00100000:3.0:1789431565.517981:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933536768
00000100:00100000:3.0:1789431565.518132:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933537152
00000100:00100000:3.0:1789431565.518138:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933537152
00000100:00100000:3.0:1789431565.518172:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296128
00000100:00100000:3.0:1789431565.518183:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14617:x1876351933536768:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431565.518221:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431565.518257:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526ea8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f32 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.518371:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526eaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.518389:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526e7e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f24 expref: 221 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.518399:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526eaf lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.518441:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526e7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f24 expref: 221 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.518458:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526e7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f24 expref: 221 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.518474:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf04829500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894241536:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431565.518645:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296129
00000100:00100000:1.0:1789431565.518658:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14616:x1876351933537152:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431565.518667:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431565.518680:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526eb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f39 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.518777:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526ebd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.518789:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f1d expref: 222 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.518807:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526ebd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.518831:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f1d expref: 222 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.518840:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f1d expref: 222 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.518849:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894241664:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431565.519131:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead900 going to sleep for 11 seconds
00000100:00100000:1.0:1789431565.519525:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1e8c9cc0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431565.524866:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf04829500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894241536:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431565.524911:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526eaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.525006:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894241664:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431565.525024:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526ebd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.525953:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.526018:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.526229:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933537280
00000100:00100000:0.0:1789431565.526241:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933537280
00010000:00010000:0.0:1789431565.526296:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526e7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f24 expref: 223 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.526343:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933537408
00000100:00100000:0.0:1789431565.526347:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933537408
00010000:00010000:0.0:1789431565.526362:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f1d expref: 224 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.526398:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16620
00000100:00100000:0.0:1789431565.526411:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:2347:x1876351933537280:12345-192.168.203.4@tcp:103:ldlm_bl.0
00000100:00100000:3.0:1789431565.526414:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16621
00000100:00100000:3.0:1789431565.526429:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:2347:x1876351933537408:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431565.526436:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431565.526441:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431565.526449:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526e7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f24 expref: 224 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.526450:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f1d expref: 224 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.526479:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526e7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f24 expref: 224 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.526481:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f1d expref: 224 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.526518:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63526e70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f1d expref: 224 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.526519:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526e7e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f24 expref: 224 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.526555:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:0.0:1789431565.526556:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:3.0:1789431565.526564:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526ebd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.526566:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526eaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.526588:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.526588:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526ebd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.526608:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526ebd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.526617:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526eaf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.526639:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431565.526646:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431565.526702:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526ebd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.526726:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526ebd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431565.526761:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000100:00100000:0.0:1789431565.526790:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:2347:x1876351933537280:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 380us (842us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.526799:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16620
00010000:00010000:0.0:1789431565.526829:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.526837:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431565.526876:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000004:00200000:0.0:1789431565.526882:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431565.526909:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.526959:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63526eb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f39 expref: 224 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.526960:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63526ea8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f32 expref: 224 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.526990:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526ebd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f39 expref: 222 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.526992:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526eaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f32 expref: 222 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.527009:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:0.0:1789431565.527013:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431565.527014:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431565.527018:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431565.527020:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309a00, rc 0)
00010000:00010000:0.0:1789431565.527024:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b275600, rc 0)
00000100:00100000:3.0:1789431565.529289:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:2347:x1876351933537408:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 2848us (3254us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.529307:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16621
00000100:00100000:2.0:1789431565.529442:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14616:x1876351933537152:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10784us (12417us total) trans 4295121058 rc 0/0
00000100:00100000:2.0:1789431565.529453:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296129
00000100:00100000:0.0:1789431565.530499:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14617:x1876351933536768:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12308us (14550us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.530510:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296128
00000100:00100000:2.0:1789431565.537157:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.537265:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933537536
00000100:00100000:1.0:1789431565.537279:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933537536
00000100:00100000:1.0:1789431565.537351:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296130
00000100:00100000:1.0:1789431565.537367:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14616:x1876351933537536:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431565.537396:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431565.537424:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526ecb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f40 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.537540:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526ed2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.537557:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526ebd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f39 expref: 221 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.537567:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526ed2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.537610:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526ebd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f39 expref: 221 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.537625:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526ebd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f39 expref: 221 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.537642:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894241792:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431565.537762:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1e8c9cc0 going to sleep for 11 seconds
00000100:00100000:1.0:1789431565.539466:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.539636:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933537792
00000100:00100000:2.0:1789431565.539649:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933537792
00000100:00100000:2.0:1789431565.539725:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12501
00000100:00100000:2.0:1789431565.539736:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14617:x1876351933537792:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431565.541415:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14617:x1876351933537792:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 1660us (1939us total) trans 4295121059 rc 0/0
00000100:00100000:2.0:1789431565.541432:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12501
00000100:00100000:3.0:1789431565.543973:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.545504:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933537920
00000100:00100000:2.0:1789431565.545525:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933537920
00010000:00010000:2.0:1789431565.545597:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526ebd lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f39 expref: 223 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.545682:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16622
00000100:00100000:2.0:1789431565.545694:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:2348:x1876351933537920:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431565.545722:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431565.545739:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526ebd lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f39 expref: 223 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.545756:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526ebd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f39 expref: 223 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.545784:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:2.0:1789431565.545791:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526ed2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.545803:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.545812:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526ed2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.545838:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431565.545930:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:2348:x1876351933537920:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 237us (1967us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.545938:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16622
00010000:00010000:1.0:1789431565.545991:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526ebd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f39 expref: 222 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.546014:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894241792:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431565.546041:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.546274:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.546283:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431565.546344:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000004:00200000:1.0:1789431565.546350:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431565.546376:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.546417:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526ecb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f40 expref: 222 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.546435:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f40 expref: 221 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.546443:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:1.0:1789431565.546446:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431565.546449:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:1.0:1789431565.546483:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14616:x1876351933537536:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9123us (9342us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.546491:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296130
00000100:00100000:3.0:1789431565.547143:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.547449:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933538048
00000100:00100000:0.0:1789431565.547460:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933538048
00000100:00100000:0.0:1789431565.547525:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296131
00000100:00100000:0.0:1789431565.547536:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14617:x1876351933538048:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.547561:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431565.547586:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526ed9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f47 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.547747:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526ee0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.547765:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526ee0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.547783:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526ee0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.547802:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526ee7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.547810:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.547818:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.547960:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526eee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.547971:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526eee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.547979:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526eee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431565.548017:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000004:00200000:0.0:1789431565.548022:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431565.548044:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526eee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.548096:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526eee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.548106:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526ee0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.548116:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526ee0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.548123:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526ee0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.548130:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431565.548134:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526ee0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.548142:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526ee0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.548159:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431565.548163:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431565.548169:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526ee0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.548175:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526ee0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.548190:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.548271:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526ee7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.548280:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.548286:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431565.548290:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.548296:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526ee7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.548304:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce07190700)
00010000:00010000:0.0:1789431565.548307:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431565.548310:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526ee7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.548315:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526ee7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.548353:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526ed9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f47 expref: 223 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.548369:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526eee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f47 expref: 222 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.548378:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:0.0:1789431565.548380:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431565.548383:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2400, rc 0)
00000100:00100000:0.0:1789431565.549411:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14617:x1876351933538048:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1864us (2259us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.549423:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296131
00000100:00100000:0.0:1789431565.553861:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.554169:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933538176
00000100:00100000:2.0:1789431565.554184:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933538176
00000100:00100000:2.0:1789431565.554268:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296132
00000100:00100000:2.0:1789431565.554281:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14616:x1876351933538176:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431565.554316:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431565.554346:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526ef5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f4e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.554434:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526efc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.554451:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526efc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.554466:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526efc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.554483:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.554491:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.554498:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555557:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526f0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555576:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526f0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555586:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526f0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431565.555637:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000004:00200000:2.0:1789431565.555645:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431565.555671:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526f0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555684:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526f0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555693:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526efc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555701:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526efc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555708:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526efc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555726:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.555738:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526efc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555748:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526efc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555763:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431565.555766:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.555772:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526efc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555779:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526efc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555795:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555808:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555815:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555820:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.555824:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555830:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555838:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf13195b00)
00010000:00010000:2.0:1789431565.555840:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.555843:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555848:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555892:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526ef5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f4e expref: 224 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555910:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526f0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f4e expref: 223 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.555917:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:2.0:1789431565.555919:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431565.555921:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b400, rc 0)
00000100:00100000:2.0:1789431565.556024:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14616:x1876351933538176:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1745us (2178us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.556033:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296132
00000100:00100000:1.0:1789431565.560911:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.560961:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.561032:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933538432
00000100:00100000:0.0:1789431565.561046:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933538432
00000100:00100000:0.0:1789431565.561162:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14361
00000100:00100000:0.0:1789431565.561178:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb05050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:2350:x1876351933538432:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431565.561213:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431565.561252:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526eee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f47 expref: 223 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.561275:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:0.0:1789431565.561281:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431565.561359:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb05050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:2350:x1876351933538432:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 186us (397us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.561368:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14361
00000100:00100000:3.0:1789431565.561549:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933538304
00000100:00100000:3.0:1789431565.561556:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933538304
00000100:00100000:3.0:1789431565.561636:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296133
00000100:00100000:3.0:1789431565.561646:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14617:x1876351933538304:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431565.561669:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431565.561690:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526f11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f55 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.561783:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526f18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.561800:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526f18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.561813:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526f18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.561830:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526f1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.561838:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.561845:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.561927:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526f18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.561936:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526f18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.561943:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526f18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.561951:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b275400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431565.561956:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526f18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.561965:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526f18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.561975:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431565.561978:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431565.561985:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526f18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.561990:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526f18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.562002:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.562009:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526f1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.562014:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.562019:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b275200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431565.562023:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.562029:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526f1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.562037:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x7f7efb67 (ffff90cf18b78400)
00010000:00010000:3.0:1789431565.562039:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431565.562043:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526f1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.562078:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526f1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.562115:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526f11 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f55 expref: 223 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.562126:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431565.562128:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431565.562131:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526f11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f55 expref: 223 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.562140:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b275a00, rc 0)
00000100:00100000:2.0:1789431565.562607:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14617:x1876351933538304:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 959us (1707us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431565.562617:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296133
00000100:00100000:1.0:1789431565.563831:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.563916:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933538688
00000100:00100000:2.0:1789431565.563927:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933538688
00000100:00100000:2.0:1789431565.564276:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296134
00000100:00100000:2.0:1789431565.564301:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14616:x1876351933538688:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431565.564373:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431565.564410:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526f0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f4e expref: 222 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.564436:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526ed2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f40 expref: 221 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.564447:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:2.0:1789431565.564452:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431565.564527:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f26 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.564545:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.564557:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431565.564827:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004868a45b reply state 00000000aa4b2078 transno 4295121060 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.564839:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431565.564962:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14616:x1876351933538688:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 664us (1140us total) trans 4295121060 rc 0/0
00000100:00100000:2.0:1789431565.564970:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296134
00000100:00100000:3.0:1789431565.569980:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.570074:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.570234:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933538944
00000100:00100000:0.0:1789431565.570248:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933538944
00000100:00100000:0.0:1789431565.570337:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296135
00000100:00100000:0.0:1789431565.570351:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14617:x1876351933538944:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.570383:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431565.570411:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526f2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f5c expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.570457:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933538816
00000100:00100000:2.0:1789431565.570463:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933538816
00000100:00100000:2.0:1789431565.570501:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8351
00010000:00010000:0.0:1789431565.570508:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526f34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.570508:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2348:x1876351933538816:12345-192.168.203.4@tcp:2:dbench.0
00010000:00010000:0.0:1789431565.570526:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.570540:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789431565.570777:0:14469:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x516:0x0] updating lvb size from disk: 85515 -> 85515
00002000:00010000:2.0:1789431565.570781:0:14469:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x516:0x0] updating lvb mtime from disk: 1789431552 -> 1789431552
00002000:00010000:2.0:1789431565.570784:0:14469:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x516:0x0] updating lvb atime from disk: 1789431554 -> 1789431555
00002000:00010000:2.0:1789431565.570787:0:14469:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x516:0x0] updating lvb ctime from disk: 1789431564 -> 1789431565
00002000:00010000:2.0:1789431565.570789:0:14469:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x516:0x0] updating lvb blocks from disk: 259 -> 259
00000100:00100000:2.0:1789431565.570866:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2348:x1876351933538816:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 356us (902us total) trans 4294970048 rc 0/0
00000100:00100000:2.0:1789431565.570874:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8351
00010000:00010000:1.0:1789431565.571150:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.571161:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f26 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.571168:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.571174:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.571178:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.571187:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f26 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.571207:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:1.0:1789431565.571210:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.571216:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f26 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.571222:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f26 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431565.571394:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008c:0x0]: returning size 16384
00000004:00200000:0.0:1789431565.571399:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431565.571423:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.571455:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526f2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f5c expref: 223 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.571473:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526f34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f5c expref: 222 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.571481:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431565.571484:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431565.571487:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2200, rc 0)
00000100:00100000:0.0:1789431565.571520:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14617:x1876351933538944:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1174us (1446us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.571528:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296135
00000100:00100000:3.0:1789431565.577356:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.577414:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.577617:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933539200
00000100:00100000:0.0:1789431565.577632:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933539200
00000100:00100000:0.0:1789431565.577755:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12502
00000100:00100000:0.0:1789431565.577768:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14617:x1876351933539200:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431565.578965:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933539072
00000100:00100000:1.0:1789431565.578980:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933539072
00000100:00100000:1.0:1789431565.579074:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296136
00000100:00100000:1.0:1789431565.579086:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14616:x1876351933539072:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431565.579105:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431565.579143:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526f3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f63 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.579231:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.579323:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.579340:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.579361:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.579367:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.579375:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.579613:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.579622:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.579629:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.579635:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.579640:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.579648:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.579664:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431565.579667:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.579673:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.579680:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.579695:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.579701:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.579707:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.582155:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14617:x1876351933539200:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 4373us (4723us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.582172:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12502
00010000:00010000:1.0:1789431565.582465:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.582473:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.582485:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.582502:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x7f7efb67 (ffff90ce03149400)
00010000:00010000:1.0:1789431565.582506:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.582511:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.582519:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.582586:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526f3b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f63 expref: 223 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.582598:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431565.582601:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.582605:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526f3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f63 expref: 223 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.582615:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:1.0:1789431565.582644:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14616:x1876351933539072:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3562us (5303us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431565.582652:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296136
00000100:00100000:3.0:1789431565.587838:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.587962:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933539328
00000100:00100000:0.0:1789431565.587978:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933539328
00000100:00100000:0.0:1789431565.588215:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296137
00000100:00100000:0.0:1789431565.588228:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14616:x1876351933539328:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.588256:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431565.588525:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526f50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f6a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.588900:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526f57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.588920:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.588933:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431565.588983:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008d:0x0]: returning size 16384
00000004:00200000:0.0:1789431565.588988:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431565.589012:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.589045:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526f50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f6a expref: 224 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.589093:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526f57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f6a expref: 223 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.589102:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431565.589105:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431565.589109:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2400, rc 0)
00000100:00100000:0.0:1789431565.589198:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14616:x1876351933539328:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 972us (1373us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.589207:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296137
00000100:00100000:3.0:1789431565.591380:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.592785:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933539456
00000100:00100000:2.0:1789431565.592804:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933539456
00000100:00100000:2.0:1789431565.592900:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296138
00000100:00100000:2.0:1789431565.592912:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14617:x1876351933539456:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431565.592940:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431565.592968:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526f5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f71 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593107:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526f65 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593125:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526f65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593139:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526f65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593156:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593163:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593170:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593243:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526f65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593251:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526f65 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593258:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526f65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593265:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.593270:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526f65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593278:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526f65 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593311:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431565.593315:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.593323:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526f65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593330:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63526f65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593345:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593351:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593357:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593363:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.593366:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593372:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593379:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x7f7efb67 (ffff90cf13195b00)
00010000:00010000:2.0:1789431565.593381:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.593385:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593391:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63526f6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593430:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526f5e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f71 expref: 224 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593441:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431565.593443:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.593446:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63526f5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f71 expref: 224 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.593456:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b400, rc 0)
00000100:00100000:2.0:1789431565.593541:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14617:x1876351933539456:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 630us (2173us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431565.593548:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296138
00000100:00100000:3.0:1789431565.597591:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.597850:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933539584
00000100:00100000:1.0:1789431565.597863:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933539584
00000100:00100000:1.0:1789431565.597936:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12503
00000100:00100000:1.0:1789431565.597949:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14616:x1876351933539584:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431565.603660:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.605367:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933539840
00000100:00100000:2.0:1789431565.605387:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933539840
00000100:00100000:2.0:1789431565.605482:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 520
00000100:00100000:2.0:1789431565.605495:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14617:x1876351933539840:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431565.605565:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431565.605604:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63526eaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f32 expref: 225 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.605631:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431565.605644:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63526f34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f5c expref: 224 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.605654:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431565.605659:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431565.605693:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526f73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.605709:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526f73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.605729:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526f73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.605746:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526f7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.605754:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526f7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.605760:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526f7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.605774:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.605781:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.605787:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.605948:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526f88 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.605958:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526f88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.605965:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526f88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431565.606603:0:5861:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005be02925 reply state 0000000013bc5ad3 transno 4295121061 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526f88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.606616:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000004:00010000:2.0:1789431565.606623:0:5861:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005be02925 reply state 0000000013bc5ad3 transno 4295121061 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.606628:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 1
00010000:00010000:2.0:1789431565.606632:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526f73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.606638:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526f73 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.606646:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526f73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.606652:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.606657:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526f73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.606666:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526f73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.606678:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431565.606682:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.606687:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526f73 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.606693:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63526f73 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431565.606706:0:5861:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005be02925 reply state 0000000013bc5ad3 transno 4295121061 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526f7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.606726:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 2
00000100:00100000:2.0:1789431565.606844:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14617:x1876351933539840:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1349us (3196us total) trans 4295121061 rc 0/0
00000100:00100000:2.0:1789431565.606853:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 520
00000100:00100000:1.0:1789431565.608176:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14616:x1876351933539584:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 10217us (10587us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.608190:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12503
00000100:00100000:1.0:1789431565.614789:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.614857:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.614908:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933539968
00000100:00100000:3.0:1789431565.614913:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933540224
00000100:00100000:1.0:1789431565.614922:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933539968
00000100:00100000:3.0:1789431565.614923:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933540224
00000100:00100000:1.0:1789431565.615008:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296139
00010000:00010000:2.0:1789431565.615009:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526f7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.615023:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14617:x1876351933539968:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431565.615027:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526f7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615040:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526f7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615074:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.615082:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526f7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615093:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431565.615093:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526f7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615117:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90cf13195300)
00010000:00010000:2.0:1789431565.615123:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.615125:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526f8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f78 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615131:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526f7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615143:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63526f7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615172:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615179:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615186:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615192:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.615196:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615202:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615211:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x7f7efb67 (ffff90cf13195600)
00010000:00010000:2.0:1789431565.615214:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.615217:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615225:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63526f81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615227:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615250:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615250:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526f88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615269:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526f88 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615274:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615277:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526f88 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615294:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.615300:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526f88 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615308:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526f88 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615311:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615322:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:1.0:1789431565.615323:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615331:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:1.0:1789431565.615337:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615337:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526f88 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.615354:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63526f88 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615430:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615436:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615442:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615447:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.615451:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615457:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615465:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431565.615467:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.615472:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615477:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526f96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615487:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615493:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615513:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615519:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.615522:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615528:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615535:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce03149400)
00010000:00010000:1.0:1789431565.615538:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.615541:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615547:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526f9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615585:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526f8f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f78 expref: 224 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615596:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431565.615599:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.615603:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526f8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f78 expref: 224 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.615613:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:1.0:1789431565.615697:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14617:x1876351933539968:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 678us (924us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431565.615705:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296139
00000100:00100000:0.0:1789431565.619197:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296140
00000100:00100000:0.0:1789431565.619228:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14616:x1876351933540224:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.619261:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431565.619265:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431565.619299:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63526f57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f6a expref: 223 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.619324:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431565.619331:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431565.619349:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526fa4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f7f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.619897:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526fab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.619916:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526fab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.619928:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526fab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.619945:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526fb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.619951:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.619958:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431565.620946:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x517:0x0], index 1: 0
00010000:00010000:0.0:1789431565.621436:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63526fb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.621455:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63526fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.621467:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63526fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.622199:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431565.624329:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431565.624394:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526fab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.624419:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526fab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.624429:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526fab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.624437:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431565.624443:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526fab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.624455:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526fab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.624478:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431565.624482:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431565.624489:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526fab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.624496:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63526fab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431565.624784:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b6033371 reply state 00000000d499200c transno 4295121062 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.624798:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431565.624870:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63526fa4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f7f expref: 224 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.624888:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63526fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f7f expref: 223 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.624896:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aab:0x0].0x0 (ffff90ce07190200)
00010000:00010000:0.0:1789431565.624899:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431565.624901:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3600, rc 0)
00000100:00100000:0.0:1789431565.625085:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14616:x1876351933540224:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 5871us (10225us total) trans 4295121062 rc 0/0
00000100:00100000:0.0:1789431565.625096:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296140
00000100:00100000:0.0:1789431565.625143:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933540352
00000100:00100000:0.0:1789431565.625153:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933540352
00000100:00100000:0.0:1789431565.625213:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296141
00000100:00100000:0.0:1789431565.625224:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14617:x1876351933540352:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.625247:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431565.625269:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63526fc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f86 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.625343:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526fce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.625360:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.625376:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431565.625423:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008c:0x0]: returning size 16384
00000004:00200000:0.0:1789431565.625427:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431565.625444:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.625464:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63526fc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f86 expref: 226 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.625477:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526fce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f86 expref: 225 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.625484:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431565.625486:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431565.625490:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3200, rc 0)
00000100:00100000:0.0:1789431565.625526:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14617:x1876351933540352:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 294us (3325us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.625533:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296141
00010000:00010000:1.0:1789431565.632785:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.632809:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526fb2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.632819:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526fb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.632826:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.632832:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526fb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.632841:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526fb2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.632864:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x7f7efb67 (ffff90ce07190700)
00010000:00010000:1.0:1789431565.632867:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.632874:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526fb2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.632881:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63526fb2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.635888:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.635963:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933540480
00000100:00100000:1.0:1789431565.635978:0:14499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933540480
00000100:00100000:2.0:1789431565.636177:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8352
00000100:00100000:2.0:1789431565.636192:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2347:x1876351933540480:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431565.636217:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431565.636245:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037d3d30f/0xd8e438fb63526fd5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f8d expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789431565.636282:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x517:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:2.0:1789431565.636308:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x517:0x0].0x0 since=3023s v=(0 0)
00010000:00010000:2.0:1789431565.636313:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x517:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431565.636324:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037d3d30f/0xd8e438fb63526fd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f8d expref: 74 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.636344:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000037d3d30f/0xd8e438fb63526fd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f8d expref: 74 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.636360:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7bc00, rc 0)
00000100:00100000:2.0:1789431565.636426:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2347:x1876351933540480:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 238us (555us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.636434:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8352
00000100:00100000:3.0:1789431565.637967:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.638190:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933540608
00000100:00100000:2.0:1789431565.638202:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933540608
00000100:00100000:2.0:1789431565.638266:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12504
00000100:00100000:2.0:1789431565.638277:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14617:x1876351933540608:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:2.0:1789431565.645344:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14617:x1876351933540608:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 7055us (7374us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.645359:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12504
00000100:00100000:3.0:1789431565.649238:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.649695:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933540864
00000100:00100000:2.0:1789431565.649718:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933540864
00000100:00100000:2.0:1789431565.650296:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12505
00000100:00100000:2.0:1789431565.650312:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14616:x1876351933540864:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431565.650904:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14616:x1876351933540864:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 593us (1680us total) trans 4295121063 rc 0/0
00000100:00100000:2.0:1789431565.650917:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12505
00000100:00100000:0.0:1789431565.653369:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.653474:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933541120
00000100:00100000:1.0:1789431565.653487:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933541120
00000100:00100000:1.0:1789431565.653657:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296142
00000100:00100000:1.0:1789431565.653669:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14617:x1876351933541120:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431565.653697:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431565.653736:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526fdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f94 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.653846:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526fe3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.653865:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526fe3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.653884:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526fe3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.653902:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526fea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.653910:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.653917:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.653990:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526fe3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.653998:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526fe3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.654006:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526fe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.654012:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.654017:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526fe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.654026:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526fe3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.654039:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431565.654042:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.654088:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526fe3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.654096:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63526fe3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.654111:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.654118:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526fea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.654124:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526fea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.654129:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.654133:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526fea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.654139:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526fea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.654147:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce03149400)
00010000:00010000:1.0:1789431565.654149:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.654152:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526fea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.654157:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63526fea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.654198:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526fdc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f94 expref: 226 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.654210:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431565.654212:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:1.0:1789431565.654216:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63526fdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f94 expref: 226 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.654227:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:1.0:1789431565.654304:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14617:x1876351933541120:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 638us (950us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431565.654312:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296142
00000100:00100000:1.0:1789431565.663331:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.663417:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933541376
00000100:00100000:3.0:1789431565.663432:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933541376
00000100:00100000:3.0:1789431565.663528:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296143
00000100:00100000:3.0:1789431565.663540:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14617:x1876351933541376:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431565.663575:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431565.663579:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431565.663622:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63526fce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f86 expref: 225 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.663648:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431565.663654:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431565.663852:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526ff1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8f9b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.664011:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ff8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.664029:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ff8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.664046:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ff8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.664440:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526fff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.664449:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526fff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.664456:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526fff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:3.0:1789431565.665434:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x518:0x0], index 0: 0
00010000:00010000:3.0:1789431565.667028:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63527006 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.667088:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63527006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.667103:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63527006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.667154:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ff8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.667162:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ff8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.667170:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ff8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.667182:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b275200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431565.667188:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ff8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.667197:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ff8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.667213:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431565.667216:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431565.667224:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ff8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.667231:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63526ff8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431565.667890:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005c1098e1 reply state 0000000064aa812a transno 4295121064 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526fff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.667902:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431565.667956:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63526ff1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f9b expref: 227 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.667973:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63527006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f9b expref: 226 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.667981:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431565.667984:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431565.667987:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b274400, rc 0)
00000100:00100000:3.0:1789431565.669682:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:14617:x1876351933541376:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6120us (6341us total) trans 4295121064 rc 0/0
00000100:00100000:3.0:1789431565.669698:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296143
00000100:00100000:1.0:1789431565.671203:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.671424:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933541632
00000100:00100000:3.0:1789431565.671438:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933541632
00000100:00100000:3.0:1789431565.671508:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12506
00000100:00100000:3.0:1789431565.671529:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:14616:x1876351933541632:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431565.672809:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14616:x1876351933541632:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 1272us (1605us total) trans 4295121065 rc 0/0
00000100:00100000:3.0:1789431565.672822:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12506
00010000:00010000:2.0:1789431565.676004:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526fff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.676028:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526fff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.676036:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526fff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.676042:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b275400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.676066:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526fff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.676075:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526fff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.676095:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90cf18b78400)
00010000:00010000:2.0:1789431565.676098:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.676104:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526fff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.676111:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb63526fff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.678603:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.678842:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933541888
00000100:00100000:1.0:1789431565.678858:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933541888
00000100:00100000:1.0:1789431565.678967:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12507
00000100:00100000:1.0:1789431565.678980:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:14616:x1876351933541888:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431565.679355:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14616:x1876351933541888:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 377us (766us total) trans 4295121066 rc 0/0
00000100:00100000:1.0:1789431565.679362:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12507
00000100:00100000:3.0:1789431565.681658:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.681935:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933542016
00000100:00100000:0.0:1789431565.681947:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933542016
00000100:00100000:0.0:1789431565.682017:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8353
00000100:00100000:0.0:1789431565.682029:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+76:2348:x1876351933542016:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.682101:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431565.682134:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6f851c1/0xd8e438fb63527014 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8fa2 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789431565.682170:0:8217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x518:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431565.682198:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x518:0x0].0x0 since=3023s v=(0 0)
00010000:00010000:0.0:1789431565.682203:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x518:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431565.682213:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f851c1/0xd8e438fb63527014 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa2 expref: 77 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.682234:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6f851c1/0xd8e438fb63527014 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa2 expref: 77 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.682264:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3400, rc 0)
00000100:00100000:0.0:1789431565.682331:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+77:2348:x1876351933542016:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 304us (687us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.682338:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8353
00000100:00100000:0.0:1789431565.683418:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.683489:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933542272
00000100:00100000:2.0:1789431565.683499:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933542272
00000100:00100000:2.0:1789431565.683601:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12508
00000100:00100000:2.0:1789431565.683621:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14616:x1876351933542272:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431565.683942:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14616:x1876351933542272:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 332us (530us total) trans 4295121067 rc 0/0
00000100:00100000:2.0:1789431565.683950:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12508
00000100:00100000:0.0:1789431565.690868:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.690959:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933542400
00000100:00100000:1.0:1789431565.690973:0:14490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933542400
00000100:00100000:1.0:1789431565.691080:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8354
00000100:00100000:1.0:1789431565.691092:0:14490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+77:14617:x1876351933542400:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431565.691116:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431565.691142:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab95b4b2/0xd8e438fb6352701b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8fa9 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.691184:0:14490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6f851c1/0xd8e438fb63527014 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa2 expref: 78 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.691195:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x518:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431565.691200:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x518:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431565.691206:0:14490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab95b4b2/0xd8e438fb6352701b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa9 expref: 78 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.691245:0:14490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6f851c1/0xd8e438fb63527014 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa2 expref: 78 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.691273:0:14490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6f851c1/0xd8e438fb63527014 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa2 expref: 78 pid: 8217 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.691290:0:14490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:14490:1876351894241920:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431565.691394:0:14490:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1e8c93c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431565.692912:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.693009:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933542656
00000100:00100000:2.0:1789431565.693019:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933542656
00000100:00100000:2.0:1789431565.693116:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296144
00000100:00100000:2.0:1789431565.693128:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14616:x1876351933542656:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431565.693197:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431565.693231:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63526fb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f7f expref: 229 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.693269:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aab:0x0].0x0 (ffff90ce07190200)
00010000:00010000:2.0:1789431565.693288:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431565.693318:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527022 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.693334:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527022 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.693344:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527022 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.693360:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527029 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.693368:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527029 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.693374:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527029 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.693537:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527030 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.693546:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527030 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.693554:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527030 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431565.694408:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1245, 64 off87936
00000004:00080000:2.0:1789431565.694421:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3023725371107ns, next at 3024725367852ns, rc = 0
00010000:00010000:2.0:1789431565.694504:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527037 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694518:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527037 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aab:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694529:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527037 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aab:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694538:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527037 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aab:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694545:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527037 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aab:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694552:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527037 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aab:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694575:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431565.694598:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527030 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694606:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527030 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694613:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527030 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694620:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.694625:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527030 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694633:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527030 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694644:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aab:0x0].0x0 (ffff90cf13195800)
00010000:00010000:2.0:1789431565.694647:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431565.694652:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527030 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694659:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527030 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694681:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527022 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694687:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527022 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694693:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527022 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694699:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.694703:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527022 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694719:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527022 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694727:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431565.694729:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.694733:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527022 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.694739:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527022 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431565.694749:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b57cc504 reply state 000000004df4bcb1 transno 4295121068 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527029 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.694760:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431565.694881:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14616:x1876351933542656:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1750us (1973us total) trans 4295121068 rc 0/0
00000100:00100000:2.0:1789431565.694891:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296144
00010000:00010000:1.0:1789431565.695721:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431565.695732:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527037 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aab:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.695742:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431565.695746:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527037 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aab:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.695755:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527037 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aab:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.695768:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aab:0x0].0x0 (ffff90cf13195800)
00010000:00010000:1.0:1789431565.695771:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431565.695775:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527037 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10aab:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.695781:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527037 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aab:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.695802:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431565.695804:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431565.695805:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431565.702484:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.703436:0:14490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:14490:1876351894241920:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431565.703480:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab95b4b2/0xd8e438fb6352701b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa9 expref: 78 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.703514:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309a00, rc 0)
00000100:00100000:1.0:1789431565.703600:0:14490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+78:14617:x1876351933542400:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12510us (12748us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.703617:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8354
00010000:00010000:2.0:1789431565.703807:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527029 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.703820:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527029 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.703828:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527029 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.703834:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.703840:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527029 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.703849:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527029 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.703871:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x7f7efb67 (ffff90cf13195b00)
00010000:00010000:2.0:1789431565.703875:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.703880:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527029 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.703887:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527029 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.704946:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933542784
00000100:00100000:3.0:1789431565.704963:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933542784
00010000:00010000:2.0:1789431565.705129:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f851c1/0xd8e438fb63527014 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa2 expref: 78 pid: 8217 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.705179:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16623
00000100:00100000:2.0:1789431565.705192:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e829880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+78:2347:x1876351933542784:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431565.705212:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431565.705246:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6f851c1/0xd8e438fb63527014 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x518:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa2 expref: 78 pid: 8217 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.705263:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6f851c1/0xd8e438fb63527014 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x518:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa2 expref: 78 pid: 8217 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.705289:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6f851c1/0xd8e438fb63527014 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x518:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa2 expref: 78 pid: 8217 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.705313:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x518:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431565.705317:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x518:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431565.705327:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab95b4b2/0xd8e438fb6352701b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa9 expref: 77 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.705338:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab95b4b2/0xd8e438fb6352701b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa9 expref: 77 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.705382:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ab95b4b2/0xd8e438fb6352701b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa9 expref: 77 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.705399:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5832:1876351894242048:192.168.203.4@tcp:105:
00000100:00100000:2.0:1789431565.705510:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb389c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431565.705741:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.706235:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933542912
00000100:00100000:0.0:1789431565.706243:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933542912
00000100:00100000:0.0:1789431565.706289:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296145
00000100:00100000:0.0:1789431565.706299:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14616:x1876351933542912:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.706324:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431565.706347:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352703e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8fb0 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.706426:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527045 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.706442:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527045 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.706456:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527045 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.706474:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352704c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.706481:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352704c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.706488:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352704c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.706995:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527053 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707007:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707014:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431565.707216:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000004:00200000:0.0:1789431565.707222:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431565.707341:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707360:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707371:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527045 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707379:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527045 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707387:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527045 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707393:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431565.707397:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527045 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707405:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527045 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707419:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431565.707422:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431565.707428:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527045 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707435:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527045 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707451:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352704c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707458:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352704c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707465:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352704c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707470:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431565.707474:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352704c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707480:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352704c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707488:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce07190500)
00010000:00010000:0.0:1789431565.707491:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431565.707495:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352704c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707500:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352704c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707544:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352703e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fb0 expref: 231 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707560:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fb0 expref: 230 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.707568:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:0.0:1789431565.707570:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431565.707573:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3a00, rc 0)
00000100:00100000:0.0:1789431565.708499:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14616:x1876351933542912:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2191us (2749us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.708514:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296145
00000100:00100000:2.0:1789431565.716344:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5832:1876351894242048:192.168.203.4@tcp:105:
00010000:00010000:2.0:1789431565.716380:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431565.716573:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e829880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+77:2347:x1876351933542784:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 11383us (14104us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.716586:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16623
00000100:00100000:0.0:1789431565.724589:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.725092:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933543168
00000100:00100000:2.0:1789431565.725108:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933543168
00000100:00100000:2.0:1789431565.725240:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12509
00000100:00100000:2.0:1789431565.725253:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14617:x1876351933543168:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431565.725865:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14617:x1876351933543168:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 611us (1287us total) trans 4295121069 rc 0/0
00000100:00100000:2.0:1789431565.725875:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12509
00000100:00100000:3.0:1789431565.726981:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.727204:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933543424
00000100:00100000:0.0:1789431565.727219:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933543424
00000100:00100000:0.0:1789431565.727286:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296146
00000100:00100000:0.0:1789431565.727296:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14616:x1876351933543424:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431565.727321:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431565.727349:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352705a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8fb7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.727493:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527061 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.727511:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527053 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fb0 expref: 232 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.727522:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527061 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.727565:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fb0 expref: 232 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.727579:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527053 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fb0 expref: 232 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.727595:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e829c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894242176:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431565.727868:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b6a2900 going to sleep for 11 seconds
00000100:00100000:3.0:1789431565.731647:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.732017:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933543680
00000100:00100000:1.0:1789431565.732033:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933543680
00000100:00100000:1.0:1789431565.732149:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296147
00000100:00100000:1.0:1789431565.732162:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14617:x1876351933543680:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431565.732196:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431565.732224:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527068 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8fbe expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.732495:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352706f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.732513:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63527006 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f9b expref: 234 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.732523:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352706f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.732566:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63527006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f9b expref: 234 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.732580:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63527006 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f9b expref: 234 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.732604:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894242304:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431565.732977:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1e8c93c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431565.733229:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e829c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894242176:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431565.733267:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527061 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.737192:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894242304:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431565.737233:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352706f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.743389:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.743488:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933543936
00000100:00100000:0.0:1789431565.743501:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933543936
00010000:00010000:0.0:1789431565.743557:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63527006 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f9b expref: 235 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.743619:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16624
00000100:00100000:0.0:1789431565.743630:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:2350:x1876351933543936:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431565.743649:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431565.743657:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63527006 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f9b expref: 235 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.743680:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63527006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f9b expref: 235 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.743720:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb63527006 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f9b expref: 235 pid: 5848 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.743741:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:0.0:1789431565.743747:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352706f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.743765:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352706f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.743774:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352706f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.744102:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431565.744184:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:2350:x1876351933543936:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 554us (810us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.744193:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16624
00010000:00010000:1.0:1789431565.744611:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352706f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.744623:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352706f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431565.744650:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00010000:00010000:1.0:1789431565.745100:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527068 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fbe expref: 235 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.745122:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352706f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fbe expref: 234 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.745130:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:1.0:1789431565.745133:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431565.745136:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309600, rc 0)
00000100:00100000:1.0:1789431565.745190:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14617:x1876351933543680:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 13031us (13559us total) trans 4295121070 rc 0/0
00000100:00100000:1.0:1789431565.745199:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296147
00000100:00100000:2.0:1789431565.745663:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.747570:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933543808
00000100:00100000:3.0:1789431565.747587:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933543808
00010000:00010000:3.0:1789431565.747637:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527053 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fb0 expref: 234 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.747879:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16625
00000100:00100000:3.0:1789431565.747890:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:2348:x1876351933543808:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431565.747914:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431565.747922:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527053 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fb0 expref: 234 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.747937:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fb0 expref: 234 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.747959:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527053 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fb0 expref: 234 pid: 6797 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.747974:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:3.0:1789431565.747980:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527061 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.747989:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527061 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.747996:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527061 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.748027:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431565.748122:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:2348:x1876351933543808:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 234us (2462us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.748130:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16625
00010000:00010000:0.0:1789431565.748443:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527061 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.748461:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527061 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431565.748500:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00010000:00010000:0.0:1789431565.751364:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352705a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fb7 expref: 234 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.751408:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527061 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fb7 expref: 233 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.751419:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:0.0:1789431565.751423:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431565.751429:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3200, rc 0)
00000100:00100000:0.0:1789431565.751530:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14616:x1876351933543424:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 24234us (24554us total) trans 4295121071 rc 0/0
00000100:00100000:0.0:1789431565.751542:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296146
00000100:00100000:0.0:1789431565.755622:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.755986:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933544064
00000100:00100000:1.0:1789431565.756001:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933544064
00000100:00100000:1.0:1789431565.756133:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296148
00000100:00100000:1.0:1789431565.756146:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14616:x1876351933544064:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431565.756181:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431565.756210:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527084 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8fc5 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.756329:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352708b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.756348:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527061 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fb7 expref: 234 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.756358:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352708b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.756845:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527061 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fb7 expref: 234 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.756866:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527061 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fb7 expref: 234 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.756883:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894242432:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431565.756997:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1e8c9d80 going to sleep for 11 seconds
00000100:00100000:2.0:1789431565.762003:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.762079:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.762903:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933544320
00000100:00100000:3.0:1789431565.762918:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933544320
00010000:00010000:3.0:1789431565.762980:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527061 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fb7 expref: 235 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.763039:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16626
00000100:00100000:3.0:1789431565.763079:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:2347:x1876351933544320:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431565.763098:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431565.763106:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527061 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fb7 expref: 235 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.763129:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527061 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fb7 expref: 235 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.763159:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:3.0:1789431565.763166:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352708b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.763178:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352708b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.763188:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352708b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.763214:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431565.763312:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:2347:x1876351933544320:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 262us (1325us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.763321:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16626
00000100:00100000:3.0:1789431565.763352:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933544192
00000100:00100000:3.0:1789431565.763357:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933544192
00000100:00100000:3.0:1789431565.763385:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296149
00000100:00100000:3.0:1789431565.763393:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14617:x1876351933544192:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431565.763415:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431565.763438:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63527092 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8fcc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.763540:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63527099 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.763560:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352706f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fbe expref: 236 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.763569:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63527099 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.765926:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527061 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fb7 expref: 236 pid: 5847 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.765944:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352706f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fbe expref: 236 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.765962:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894242432:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431565.765970:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352706f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fbe expref: 235 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.765992:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce029f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894242560:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431565.766001:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352708b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.766014:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352708b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.766021:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352708b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431565.766142:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000004:00200000:1.0:1789431565.766148:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431565.766176:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352708b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.766222:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527084 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fc5 expref: 236 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.766240:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352708b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fc5 expref: 235 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.766251:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:1.0:1789431565.766255:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431565.766260:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309c00, rc 0)
00000100:00100000:0.0:1789431565.766433:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead900 going to sleep for 11 seconds
00000100:00100000:1.0:1789431565.767296:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14616:x1876351933544064:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11147us (11696us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.767308:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296148
00000100:00100000:0.0:1789431565.772668:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce029f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894242560:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431565.772776:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63527099 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.773077:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.773493:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933544448
00000100:00100000:1.0:1789431565.773506:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933544448
00010000:00010000:1.0:1789431565.773558:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352706f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fbe expref: 235 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.773610:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16627
00000100:00100000:1.0:1789431565.773621:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:2347:x1876351933544448:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.773640:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.773649:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352706f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fbe expref: 235 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.773904:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352706f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fbe expref: 235 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.773936:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352706f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fbe expref: 235 pid: 12181 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.773956:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:1.0:1789431565.773963:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63527099 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.773975:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63527099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.773984:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63527099 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.774020:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431565.774109:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:2347:x1876351933544448:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 489us (1059us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.774117:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16627
00010000:00010000:0.0:1789431565.774225:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63527099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.774234:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63527099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431565.774293:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:0.0:1789431565.774299:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431565.774324:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63527099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.774366:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb63527092 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fcc expref: 234 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.775170:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63527099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fcc expref: 233 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.775181:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:0.0:1789431565.775184:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431565.775187:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b275200, rc 0)
00000100:00100000:0.0:1789431565.775239:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14617:x1876351933544192:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11846us (13160us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431565.775248:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296149
00000100:00100000:2.0:1789431565.782999:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.783516:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933544704
00000100:00100000:1.0:1789431565.783533:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933544704
00000100:00100000:1.0:1789431565.783622:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12510
00000100:00100000:1.0:1789431565.783635:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14616:x1876351933544704:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431565.784014:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14616:x1876351933544704:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 380us (1029us total) trans 4295121072 rc 0/0
00000100:00100000:1.0:1789431565.784022:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12510
00000100:00100000:2.0:1789431565.790042:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.790391:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933544832
00000100:00100000:1.0:1789431565.790406:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933544832
00002000:00100000:1.0:1789431565.790478:0:14435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x518:0x0] (0->83189)  req@ffff90ce20fd4e00 x1876351933544832/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:36/0 lens 488/0 e 0 to 0 dl 1789431576 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431565.790491:0:14435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce20fd4e00 with x1876351933544832 ext(0->83189)
00002000:00010000:1.0:1789431565.790499:0:14435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce20fd4e00
00000100:00100000:1.0:1789431565.790548:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1553
00000100:00100000:1.0:1789431565.790560:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+77:2348:x1876351933544832:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:1.0:1789431565.812981:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+79:2348:x1876351933544832:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 22405us (22935us total) trans 4294969652 rc 0/0
00000100:00100000:1.0:1789431565.813001:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1553
00002000:00100000:1.0:1789431565.813022:0:14435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x518:0x0] (0->83189)  req@ffff90ce20fd4e00 x1876351933544832/t4294969652(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:36/0 lens 488/448 e 0 to 0 dl 1789431576 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431565.813034:0:14435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce20fd4e00 with x1876351933544832 ext(0->83189)
00002000:00010000:1.0:1789431565.813045:0:14435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce20fd4e00
00000100:00100000:0.0:1789431565.814857:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.814992:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933544960
00000100:00100000:2.0:1789431565.815005:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933544960
00000100:00100000:2.0:1789431565.815098:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296150
00000100:00100000:2.0:1789431565.815111:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14616:x1876351933544960:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431565.815143:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431565.815173:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635270a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8fd3 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815268:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815287:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815301:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815318:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815325:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815332:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815573:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635270b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815583:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635270b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815590:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635270b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431565.815631:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000004:00200000:2.0:1789431565.815636:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431565.815661:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635270b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815676:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635270b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815685:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815691:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815699:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815705:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.815720:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815730:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815744:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431565.815747:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.815754:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815760:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815776:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815783:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815789:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815795:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.815798:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815803:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815811:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf13195b00)
00010000:00010000:2.0:1789431565.815813:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.815816:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815823:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815860:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635270a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fd3 expref: 236 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815875:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635270b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fd3 expref: 235 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.815884:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:2.0:1789431565.815887:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431565.815890:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b000, rc 0)
00000100:00100000:2.0:1789431565.815977:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14616:x1876351933544960:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 869us (1141us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.815986:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296150
00000100:00100000:2.0:1789431565.823517:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.823627:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933545216
00000100:00100000:0.0:1789431565.823641:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933545216
00000100:00100000:0.0:1789431565.823725:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296151
00000100:00100000:0.0:1789431565.823738:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14617:x1876351933545216:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:0.0:1789431565.824117:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.824169:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933545088
00000100:00100000:1.0:1789431565.824175:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933545088
00000100:00100000:1.0:1789431565.824227:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14362
00000100:00100000:1.0:1789431565.824237:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:2347:x1876351933545088:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.824250:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.824294:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635270b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fd3 expref: 236 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.824317:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:1.0:1789431565.824323:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431565.824395:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:2347:x1876351933545088:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 160us (279us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.824404:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14362
00000100:00100000:0.0:1789431565.829421:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.833123:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933545344
00000100:00100000:1.0:1789431565.833145:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933545344
00000100:00100000:1.0:1789431565.833222:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296152
00000100:00100000:1.0:1789431565.833235:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14616:x1876351933545344:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431565.833262:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431565.833290:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635270bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8fda expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.833374:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635270c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.833393:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635270c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.833408:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635270c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.833426:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635270ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.833435:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635270ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.833893:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635270ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.834250:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635270c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.834260:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635270c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.834267:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635270c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.834275:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.834280:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635270c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.834289:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635270c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.834306:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431565.834309:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.834315:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635270c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.834322:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635270c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.834338:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635270ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.834345:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635270ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.834352:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635270ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.834358:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.834361:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635270ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.834368:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635270ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.834374:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x7f7efb67 (ffff90ce03149400)
00010000:00010000:1.0:1789431565.834377:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.834380:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635270ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.834387:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635270ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.834440:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635270bc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fda expref: 236 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.837349:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431565.837353:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.837366:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635270bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fda expref: 236 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.837389:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309600, rc 0)
00000100:00100000:0.0:1789431565.839857:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14616:x1876351933545344:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6605us (10433us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431565.839873:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296152
00000100:00100000:1.0:1789431565.845203:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.845314:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933545472
00000100:00100000:3.0:1789431565.845329:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933545472
00000100:00100000:3.0:1789431565.845407:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296153
00000100:00100000:3.0:1789431565.845418:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14616:x1876351933545472:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431565.845447:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431565.845482:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb635270d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8fe1 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.845571:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb635270d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.845744:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb635270d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.845765:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb635270d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431565.845812:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008d:0x0]: returning size 16384
00000004:00200000:3.0:1789431565.846035:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431565.846094:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb635270d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.846131:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb635270d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fe1 expref: 237 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.846152:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb635270d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fe1 expref: 236 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.846162:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431565.846166:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431565.846171:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b275400, rc 0)
00000100:00100000:3.0:1789431565.846318:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14616:x1876351933545472:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 901us (1131us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.846328:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296153
00000100:00100000:0.0:1789431565.850722:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.850969:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933545600
00000100:00100000:1.0:1789431565.850983:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933545600
00000100:00100000:1.0:1789431565.851488:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12511
00000100:00100000:1.0:1789431565.851505:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14616:x1876351933545600:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:2.0:1789431565.862746:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14616:x1876351933545600:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 11229us (12034us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.862764:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12511
00000100:00100000:0.0:1789431565.867013:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431565.867105:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933545728
00000100:00100000:2.0:1789431565.867123:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933545728
00000100:00100000:2.0:1789431565.867210:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296154
00000100:00100000:2.0:1789431565.867223:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14616:x1876351933545728:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431565.867252:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431565.867282:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635270df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8fe8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.867381:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.867402:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.867417:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.867435:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.867702:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.867725:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.867991:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.868000:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.868009:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.868016:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.868021:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.868035:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.868219:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431565.868224:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.868232:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.868239:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635270e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.868256:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.868263:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.868270:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.868276:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431565.868279:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.868286:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.868295:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x7f7efb67 (ffff90cf13195a00)
00010000:00010000:2.0:1789431565.868298:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.868301:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.868309:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635270ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.868353:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635270df lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fe8 expref: 237 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.868365:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431565.868368:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431565.868372:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635270df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fe8 expref: 237 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.868383:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a000, rc 0)
00000100:00100000:2.0:1789431565.868468:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14616:x1876351933545728:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1246us (1463us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431565.868477:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296154
00000100:00100000:3.0:1789431565.876656:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431565.878397:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933545984
00000100:00100000:0.0:1789431565.878417:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933545984
00000100:00100000:0.0:1789431565.878501:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 521
00000100:00100000:0.0:1789431565.878514:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14616:x1876351933545984:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431565.878579:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:0.0:1789431565.878614:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352708b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fc5 expref: 236 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.878637:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:0.0:1789431565.878651:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb635270d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fe1 expref: 235 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.878661:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431565.878665:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431565.878702:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635270f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.878728:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635270f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.878743:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635270f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.878760:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635270fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.878768:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635270fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.878774:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635270fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.878788:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527102 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.878795:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527102 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.878802:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527102 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.879201:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527109 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.879212:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527109 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.879221:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527109 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431565.880025:0:5862:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005218b270 reply state 000000001b1c3be6 transno 4295121073 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527109 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.880040:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000004:00010000:0.0:1789431565.880078:0:5862:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005218b270 reply state 000000001b1c3be6 transno 4295121073 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527102 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.880085:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 1
00010000:00010000:0.0:1789431565.880090:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635270f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.880096:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635270f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.880104:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635270f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.880110:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431565.880116:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635270f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.880124:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635270f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.880138:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431565.880141:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431565.880146:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635270f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.880153:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635270f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431565.880167:0:5862:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005218b270 reply state 000000001b1c3be6 transno 4295121073 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635270fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.880178:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 2
00000100:00100000:0.0:1789431565.880300:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14616:x1876351933545984:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1784us (3655us total) trans 4295121073 rc 0/0
00000100:00100000:0.0:1789431565.880309:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 521
00010000:00010000:0.0:1789431565.888526:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635270fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888543:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635270fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888550:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635270fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888556:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431565.888560:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635270fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888568:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635270fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888583:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce07190800)
00010000:00010000:0.0:1789431565.888586:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431565.888591:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635270fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888597:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635270fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888626:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527102 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888633:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527102 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888638:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527102 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888643:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431565.888646:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527102 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888652:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527102 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888660:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x7f7efb67 (ffff90ce07190500)
00010000:00010000:0.0:1789431565.888662:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431565.888666:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527102 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888671:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527102 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888683:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527109 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888689:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527109 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888693:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527109 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888698:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431565.888701:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527109 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888706:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527109 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888726:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:0.0:1789431565.888728:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:0.0:1789431565.888732:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527109 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.888737:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527109 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.888982:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.889349:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933546112
00000100:00100000:1.0:1789431565.889369:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933546112
00000100:00100000:1.0:1789431565.889481:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296155
00000100:00100000:1.0:1789431565.889492:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14616:x1876351933546112:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431565.889513:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431565.889530:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527110 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8fef expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.889591:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527117 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.889603:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527117 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890010:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527117 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890028:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352711e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890041:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352711e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890065:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352711e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890117:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527117 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890124:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527117 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890131:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527117 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890136:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.890140:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527117 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890147:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527117 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890158:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431565.890160:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.890165:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527117 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890172:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527117 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890182:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352711e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890189:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352711e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890194:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352711e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890200:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431565.890202:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352711e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890209:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352711e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890216:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce03149400)
00010000:00010000:1.0:1789431565.890218:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.890221:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352711e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890226:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352711e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890258:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527110 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fef expref: 236 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890268:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431565.890270:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431565.890274:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527110 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fef expref: 236 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.890288:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:1.0:1789431565.890350:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14616:x1876351933546112:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 859us (1371us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431565.890370:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296155
00000100:00100000:0.0:1789431565.902387:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.902599:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933546240
00000100:00100000:3.0:1789431565.902613:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933546240
00000100:00100000:3.0:1789431565.902692:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296156
00000100:00100000:3.0:1789431565.902705:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14616:x1876351933546240:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431565.903979:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431565.904017:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63527125 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ff6 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.904127:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb6352712c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.904146:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb6352712c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.904161:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb6352712c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431565.904211:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008d:0x0]: returning size 16384
00000004:00200000:3.0:1789431565.904215:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431565.904240:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb6352712c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.904274:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb63527125 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ff6 expref: 237 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.904299:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb6352712c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ff6 expref: 236 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.904308:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431565.904312:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431565.904316:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b274400, rc 0)
00000100:00100000:3.0:1789431565.904410:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14616:x1876351933546240:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1706us (2046us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.904419:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296156
00000001:00080000:0.0:1789431565.906554:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121071 is committed
00000100:00100000:1.0:1789431565.906619:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14617:x1876351933545216:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 82874us (83107us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.906636:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296151
00000001:00080000:0.0:1789431565.906638:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121072 is committed
00000004:00080000:0.0:1789431565.907151:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 368 committed
00000004:00080000:0.0:1789431565.907227:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 370 committed
00000100:00100000:1.0:1789431565.907838:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894243072:0@lo:6:osp-syn-1-0.0
00000100:00100000:3.0:1789431565.907847:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b2c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894242688:0@lo:6:osp-syn-1-0.0
00000100:00100000:2.0:1789431565.908157:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894242816:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431565.908325:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431565.908407:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894243200:0@lo:6:osp-syn-1-0.0
00000100:00100000:3.0:1789431565.908433:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431565.908467:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894243712:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431565.908492:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431565.908512:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1789431565.908519:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894243584:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431565.908543:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431565.908559:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894244096:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431565.908583:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431565.908619:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894242688
00000100:00100000:3.0:1789431565.908627:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894242688
00000100:00100000:3.0:1789431565.908678:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894243200
00000100:00100000:3.0:1789431565.908682:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894243200
00000100:00100000:2.0:1789431565.908809:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431565.908833:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894243328:0@lo:6:osp-syn-1-0.0
00000100:00100000:2.0:1789431565.908856:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431565.908871:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894243840:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431565.908893:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431565.908915:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:2.0:1789431565.908921:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce17f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894242944:0@lo:6:osp-syn-1-0.0
00000100:00100000:2.0:1789431565.908942:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431565.908962:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894243456:0@lo:6:osp-syn-1-0.0
00000100:00100000:2.0:1789431565.908984:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431565.909001:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894243968:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431565.909021:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431565.909085:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894243712
00000100:00100000:2.0:1789431565.909090:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894243712
00000100:00100000:0.0:1789431565.909226:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894243584
00000100:00100000:0.0:1789431565.909231:0:14491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894243584
00000100:00100000:3.0:1789431565.909378:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894244096
00000100:00100000:3.0:1789431565.909382:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894244096
00000100:00100000:2.0:1789431565.909428:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894242816
00000100:00100000:2.0:1789431565.909432:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894242816
00000100:00100000:2.0:1789431565.909452:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894243328
00000100:00100000:2.0:1789431565.909456:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894243328
00000100:00100000:2.0:1789431565.909473:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894243840
00000100:00100000:2.0:1789431565.909476:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894243840
00000100:00100000:2.0:1789431565.909493:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894242944
00000100:00100000:2.0:1789431565.909495:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894242944
00000100:00100000:2.0:1789431565.909513:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894243456
00000100:00100000:2.0:1789431565.909516:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894243456
00000100:00100000:2.0:1789431565.909531:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894243968
00000100:00100000:2.0:1789431565.909534:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894243968
00000100:00100000:2.0:1789431565.909550:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8355
00000100:00100000:2.0:1789431565.909558:0:14482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3314:x1876351894242688:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:2.0:1789431565.909595:0:14482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1249 count 1
00010000:00010000:2.0:1789431565.909631:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2dcbad/0xd8e438fb63527133 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.909658:0:14482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f443ef31/0xd8e438fb63520482 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c71c6 expref: 73 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.909668:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4e1:0x0].0x0 since=14s v=(0 0)
00010000:00010000:2.0:1789431565.909672:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431565.909676:0:14482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2dcbad/0xd8e438fb63527133 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.909732:0:14482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f443ef31/0xd8e438fb63520482 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c71c6 expref: 73 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.909750:0:14482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f443ef31/0xd8e438fb63520482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c71c6 expref: 73 pid: 14502 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.909765:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14482:1876351894244224:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431565.909848:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb383c0 going to sleep for 11 seconds
00000100:00100000:2.0:1789431565.909872:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8356
00000100:00100000:2.0:1789431565.909881:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3314:x1876351894243200:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:2.0:1789431565.909895:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1252 count 1
00010000:00010000:2.0:1789431565.909909:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb6352713a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.909922:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000098f005cd/0xd8e438fb635208e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c732b expref: 73 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.909930:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4e4:0x0].0x0 since=13s v=(0 0)
00010000:00010000:2.0:1789431565.909933:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431565.909937:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb6352713a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.909956:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000098f005cd/0xd8e438fb635208e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c732b expref: 73 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.909971:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000098f005cd/0xd8e438fb635208e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c732b expref: 73 pid: 14502 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.909982:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1876351894244352:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431565.910009:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38f00 going to sleep for 11 seconds
00000100:00100000:2.0:1789431565.910028:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8357
00000100:00100000:2.0:1789431565.910036:0:14502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+42:3314:x1876351894243712:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431565.910086:0:14502:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1208 count 1
00010000:00010000:2.0:1789431565.910105:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006abb289d/0xd8e438fb63527141 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910118:0:14502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003910a4b6/0xd8e438fb63518230 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c4828 expref: 78 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910125:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4b8:0x0].0x0 since=37s v=(0 0)
00010000:00010000:2.0:1789431565.910128:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431565.910132:0:14502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006abb289d/0xd8e438fb63527141 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910155:0:14502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003910a4b6/0xd8e438fb63518230 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c4828 expref: 78 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910165:0:14502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003910a4b6/0xd8e438fb63518230 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c4828 expref: 78 pid: 14500 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.910183:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:14502:1876351894244480:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431565.910215:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38300 going to sleep for 11 seconds
00000100:00100000:2.0:1789431565.910235:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8358
00000100:00100000:2.0:1789431565.910257:0:14464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3311:x1876351894242816:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431565.910272:0:14464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1201 count 1
00010000:00010000:2.0:1789431565.910286:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f7fd317/0xd8e438fb63527148 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910298:0:14464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000709daef9/0xd8e438fb6351668b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3edc expref: 78 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910305:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4b1:0x0].0x0 since=42s v=(0 0)
00010000:00010000:2.0:1789431565.910308:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431565.910312:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f7fd317/0xd8e438fb63527148 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910331:0:14464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000709daef9/0xd8e438fb6351668b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3edc expref: 78 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910340:0:14464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000709daef9/0xd8e438fb6351668b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3edc expref: 78 pid: 14501 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.910350:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14464:1876351894244608:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431565.910374:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38780 going to sleep for 11 seconds
00000100:00100000:2.0:1789431565.910394:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8359
00000100:00100000:2.0:1789431565.910402:0:14505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+9:3311:x1876351894243328:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:2.0:1789431565.910415:0:14505:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1253 count 1
00010000:00010000:2.0:1789431565.910430:0:14505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb6352714f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910442:0:14505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb63520abe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c73be expref: 73 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910450:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4e5:0x0].0x0 since=13s v=(0 0)
00010000:00010000:2.0:1789431565.910453:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431565.910457:0:14505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb6352714f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910476:0:14505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb63520abe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c73be expref: 73 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910487:0:14505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb63520abe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c73be expref: 73 pid: 14472 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.910497:0:14505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:14505:1876351894244736:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431565.910523:0:14505:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38900 going to sleep for 11 seconds
00000100:00100000:2.0:1789431565.910544:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8360
00000100:00100000:2.0:1789431565.910553:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+42:3311:x1876351894243840:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431565.910565:0:6699:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1251 count 1
00010000:00010000:2.0:1789431565.910579:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63527156 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910592:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd41e627/0xd8e438fb63520706 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c728a expref: 78 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910599:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4e3:0x0].0x0 since=14s v=(0 0)
00010000:00010000:2.0:1789431565.910602:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4e3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431565.910606:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63527156 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910625:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd41e627/0xd8e438fb63520706 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c728a expref: 78 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910634:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd41e627/0xd8e438fb63520706 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c728a expref: 78 pid: 6698 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.910644:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1876351894244864:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431565.910670:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38540 going to sleep for 11 seconds
00000100:00100000:2.0:1789431565.910690:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8361
00000100:00100000:2.0:1789431565.910698:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3311:x1876351894242944:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:2.0:1789431565.910721:0:14469:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1245 count 1
00010000:00010000:2.0:1789431565.910737:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd11ad65/0xd8e438fb6352715d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910749:0:14469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d2532a5/0xd8e438fb6351fe8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6fce expref: 73 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910762:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4dd:0x0].0x0 since=15s v=(0 0)
00010000:00010000:2.0:1789431565.910765:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4dd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431565.910769:0:14469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd11ad65/0xd8e438fb6352715d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910788:0:14469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d2532a5/0xd8e438fb6351fe8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6fce expref: 73 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910797:0:14469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d2532a5/0xd8e438fb6351fe8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6fce expref: 73 pid: 14501 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.910806:0:14469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14469:1876351894244992:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431565.910830:0:14469:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38e40 going to sleep for 11 seconds
00000100:00100000:2.0:1789431565.910850:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8362
00000100:00100000:2.0:1789431565.910858:0:14501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+9:3311:x1876351894243456:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:2.0:1789431565.910872:0:14501:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1303 count 1
00010000:00010000:2.0:1789431565.910887:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63527164 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x517:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910900:0:14501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000037d3d30f/0xd8e438fb63526fd5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x517:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f8d expref: 73 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910908:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x517:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431565.910911:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x517:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431565.910915:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63527164 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x517:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910933:0:14501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000037d3d30f/0xd8e438fb63526fd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x517:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f8d expref: 73 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.910943:0:14501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000037d3d30f/0xd8e438fb63526fd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x517:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f8d expref: 73 pid: 6700 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.910952:0:14501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14501:1876351894245120:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431565.910977:0:14501:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb38a80 going to sleep for 11 seconds
00000100:00100000:2.0:1789431565.910995:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8363
00000100:00100000:2.0:1789431565.911003:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3311:x1876351894243968:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431565.911017:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1301 count 1
00010000:00010000:2.0:1789431565.911029:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb6352716b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.911042:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087c926ad/0xd8e438fb635266f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d41 expref: 78 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.911084:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x515:0x0].0x0 since=1s v=(0 0)
00010000:00010000:2.0:1789431565.911087:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x515:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431565.911090:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb6352716b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.911108:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000087c926ad/0xd8e438fb635266f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d41 expref: 78 pid: 14469 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.911119:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000087c926ad/0xd8e438fb635266f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d41 expref: 78 pid: 14469 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.911129:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1876351894245248:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431565.911159:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bb389c0 going to sleep for 11 seconds
00000100:00100000:1.0:1789431565.912871:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431565.913089:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894243072
00000100:00100000:2.0:1789431565.913173:0:14499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894243072
00000100:00100000:2.0:1789431565.913230:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8364
00000100:00100000:2.0:1789431565.913241:0:14499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+10:3313:x1876351894243072:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:2.0:1789431565.913271:0:14499:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1208 count 1
00010000:00010000:2.0:1789431565.913296:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baca1a4f/0xd8e438fb63527172 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.913318:0:14499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd90a59a/0xd8e438fb6351871c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c49c5 expref: 73 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.913327:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4b8:0x0].0x0 since=36s v=(0 0)
00010000:00010000:2.0:1789431565.913332:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431565.913336:0:14499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baca1a4f/0xd8e438fb63527172 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.913513:0:14499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd90a59a/0xd8e438fb6351871c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c49c5 expref: 73 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.913526:0:14499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd90a59a/0xd8e438fb6351871c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c49c5 expref: 73 pid: 14471 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.913542:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e97800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:14499:1876351894245376:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431565.913591:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf0620a900 going to sleep for 11 seconds
00000100:00100000:0.0:1789431565.914575:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8365
00000100:00100000:0.0:1789431565.914604:0:14491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+42:3314:x1876351894243584:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431565.914645:0:14491:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1203 count 1
00010000:00010000:0.0:1789431565.914676:0:14491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f73e5691/0xd8e438fb63527179 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.914700:0:14491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000200c53b8/0xd8e438fb63516f36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c41bb expref: 78 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.914725:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4b3:0x0].0x0 since=40s v=(0 0)
00010000:00010000:0.0:1789431565.914730:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431565.914735:0:14491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f73e5691/0xd8e438fb63527179 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.914774:0:14491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000200c53b8/0xd8e438fb63516f36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c41bb expref: 78 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.914788:0:14491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000200c53b8/0xd8e438fb63516f36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c41bb expref: 78 pid: 14482 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.914803:0:14491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1e918000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:14491:1876351894245504:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431565.914878:0:14491:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf143c9540 going to sleep for 11 seconds
00000100:00100000:1.0:1789431565.918370:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.919271:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933546368
00000100:00100000:1.0:1789431565.919282:0:14490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933546368
00000100:00100000:3.0:1789431565.919290:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8366
00000100:00100000:3.0:1789431565.919313:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3314:x1876351894244096:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:3.0:1789431565.919358:0:14486:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1302 count 1
00010000:00010000:3.0:1789431565.919405:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb63527180 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.919431:0:14486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000005adae1/0xd8e438fb63526a87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8de2 expref: 79 pid: 14505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.919441:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x516:0x0].0x0 since=1s v=(0 0)
00010000:00010000:3.0:1789431565.919447:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x516:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431565.919453:0:14486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb63527180 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.919483:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8367
00000100:00100000:1.0:1789431565.919495:0:14490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+79:2348:x1876351933546368:12345-192.168.203.4@tcp:16:dbench.0
00010000:00010000:3.0:1789431565.919503:0:14486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000005adae1/0xd8e438fb63526a87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8de2 expref: 79 pid: 14505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.919523:0:14486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000005adae1/0xd8e438fb63526a87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8de2 expref: 79 pid: 14505 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.919542:0:14486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce029f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14486:1876351894245632:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431565.920576:0:14486:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead900 going to sleep for 11 seconds
00000100:00100000:0.0:1789431565.953472:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431565.954181:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933546496
00000100:00100000:3.0:1789431565.954686:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933546496
00000100:00100000:3.0:1789431565.954780:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12512
00000100:00100000:3.0:1789431565.954791:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14616:x1876351933546496:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431565.962361:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.962399:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.962422:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.962456:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.962477:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.962498:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.962535:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.962589:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.962916:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.962943:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.962956:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.962971:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431565.963086:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933546624
00000100:00100000:1.0:1789431565.963099:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933546624
00010000:00010000:1.0:1789431565.963158:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f443ef31/0xd8e438fb63520482 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c71c6 expref: 74 pid: 14502 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.963195:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933546880
00000100:00100000:1.0:1789431565.963198:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933546880
00010000:00010000:1.0:1789431565.964011:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003910a4b6/0xd8e438fb63518230 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c4828 expref: 80 pid: 14500 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.964044:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933547136
00000100:00100000:1.0:1789431565.964079:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933547136
00010000:00010000:1.0:1789431565.964097:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb63520abe lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c73be expref: 75 pid: 14472 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.964110:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933547392
00000100:00100000:1.0:1789431565.964114:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933547392
00010000:00010000:1.0:1789431565.964126:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd41e627/0xd8e438fb63520706 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c728a expref: 81 pid: 6698 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.964139:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933546752
00000100:00100000:1.0:1789431565.964142:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933546752
00010000:00010000:1.0:1789431565.964155:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000098f005cd/0xd8e438fb635208e2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c732b expref: 76 pid: 14502 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431565.964168:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933547008
00000100:00100000:1.0:1789431565.964170:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933547008
00010000:00010000:1.0:1789431565.964184:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000709daef9/0xd8e438fb6351668b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3edc expref: 82 pid: 14501 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.964443:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933547264
00000100:00100000:3.0:1789431565.964449:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933547264
00010000:00010000:3.0:1789431565.964473:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d2532a5/0xd8e438fb6351fe8c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6fce expref: 77 pid: 14501 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.964491:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933547520
00000100:00100000:3.0:1789431565.964493:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933547520
00010000:00010000:3.0:1789431565.964511:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000037d3d30f/0xd8e438fb63526fd5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x517:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f8d expref: 78 pid: 6700 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.964523:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933547776
00000100:00100000:3.0:1789431565.964526:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933547776
00010000:00010000:3.0:1789431565.964540:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd90a59a/0xd8e438fb6351871c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c49c5 expref: 79 pid: 14471 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.964551:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933548032
00000100:00100000:3.0:1789431565.964554:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933548032
00010000:00010000:3.0:1789431565.964568:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000005adae1/0xd8e438fb63526a87 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8de2 expref: 83 pid: 14505 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.964579:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933547648
00000100:00100000:3.0:1789431565.964582:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933547648
00010000:00010000:3.0:1789431565.964596:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000087c926ad/0xd8e438fb635266f9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d41 expref: 84 pid: 14469 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.965125:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933547904
00000100:00100000:2.0:1789431565.965133:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933547904
00010000:00010000:2.0:1789431565.965156:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000200c53b8/0xd8e438fb63516f36 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c41bb expref: 85 pid: 14482 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.965179:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16628
00000100:00100000:2.0:1789431565.965191:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb07050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+79:2348:x1876351933546624:12345-192.168.203.4@tcp:103:ldlm_bl.0
00000100:00100000:1.0:1789431565.965317:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16629
00000100:00100000:1.0:1789431565.965326:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+85:2348:x1876351933546880:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.965345:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.965353:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003910a4b6/0xd8e438fb63518230 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c4828 expref: 85 pid: 14500 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.965367:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003910a4b6/0xd8e438fb63518230 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c4828 expref: 85 pid: 14500 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.965401:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431565.965406:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431565.965414:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006abb289d/0xd8e438fb63527141 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.965425:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006abb289d/0xd8e438fb63527141 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.965453:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431565.965540:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+85:2348:x1876351933546880:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 215us (3139us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.965549:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16629
00000100:00100000:1.0:1789431565.965573:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16630
00000100:00100000:1.0:1789431565.965580:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+79:2348:x1876351933547136:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.965591:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.965598:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb63520abe lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c73be expref: 79 pid: 14472 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.966395:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb63520abe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c73be expref: 79 pid: 14472 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.966424:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431565.966428:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431565.966434:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb6352714f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.966443:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb6352714f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.966464:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431565.966511:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+79:2348:x1876351933547136:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 929us (4086us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.966520:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16630
00000100:00100000:1.0:1789431565.966549:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16631
00000100:00100000:1.0:1789431565.966559:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+84:2348:x1876351933547392:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.966573:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.966581:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd41e627/0xd8e438fb63520706 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c728a expref: 84 pid: 6698 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.966592:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd41e627/0xd8e438fb63520706 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c728a expref: 84 pid: 6698 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.967070:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16632
00000100:00100000:3.0:1789431565.967083:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+78:2348:x1876351933546752:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431565.967096:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431565.967104:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000098f005cd/0xd8e438fb635208e2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c732b expref: 78 pid: 14502 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.967114:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000098f005cd/0xd8e438fb635208e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c732b expref: 78 pid: 14502 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.967131:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431565.967134:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431565.967140:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb6352713a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.967155:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb6352713a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.967171:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431565.967387:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431565.967395:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f443ef31/0xd8e438fb63520482 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c71c6 expref: 78 pid: 14502 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.967408:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f443ef31/0xd8e438fb63520482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c71c6 expref: 78 pid: 14502 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.967422:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431565.967426:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431565.967431:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d2dcbad/0xd8e438fb63527133 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.967440:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2dcbad/0xd8e438fb63527133 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.967461:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431565.967487:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb07050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+78:2348:x1876351933546624:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 2299us (5144us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.967496:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16628
00000100:00100000:2.0:1789431565.967567:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16633
00000100:00100000:2.0:1789431565.967576:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+77:2348:x1876351933547264:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431565.967584:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431565.967590:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d2532a5/0xd8e438fb6351fe8c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6fce expref: 77 pid: 14501 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.967601:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d2532a5/0xd8e438fb6351fe8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6fce expref: 77 pid: 14501 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.967718:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4e3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431565.967723:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4e3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431565.967728:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63527156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.967735:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63527156 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.967750:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431565.967772:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+84:2348:x1876351933547392:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1216us (5314us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.967779:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16631
00000100:00100000:1.0:1789431565.967796:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16634
00000100:00100000:1.0:1789431565.967804:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb07c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+77:2349:x1876351933547520:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.967813:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.967820:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000037d3d30f/0xd8e438fb63526fd5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x517:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f8d expref: 77 pid: 6700 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.967831:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000037d3d30f/0xd8e438fb63526fd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x517:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f8d expref: 77 pid: 6700 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.967844:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x517:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431565.967848:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x517:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431565.967852:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63527164 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x517:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.967860:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63527164 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x517:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.967873:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431565.967893:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb07c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+77:2349:x1876351933547520:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 89us (5303us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.967899:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16634
00000100:00100000:1.0:1789431565.967916:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16635
00000100:00100000:1.0:1789431565.967924:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+76:2349:x1876351933547776:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.967935:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.967941:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd90a59a/0xd8e438fb6351871c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c49c5 expref: 76 pid: 14471 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.967951:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd90a59a/0xd8e438fb6351871c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c49c5 expref: 76 pid: 14471 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.967974:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431565.967978:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1789431565.967982:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000baca1a4f/0xd8e438fb63527172 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.967990:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baca1a4f/0xd8e438fb63527172 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.968003:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431565.968022:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+76:2349:x1876351933547776:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 99us (5416us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.968029:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16635
00000100:00100000:1.0:1789431565.968043:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16636
00000100:00100000:1.0:1789431565.968067:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+83:2349:x1876351933548032:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.968077:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431565.968084:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000005adae1/0xd8e438fb63526a87 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x516:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8de2 expref: 83 pid: 14505 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.968094:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000005adae1/0xd8e438fb63526a87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x516:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8de2 expref: 83 pid: 14505 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.968107:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x516:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431565.968109:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x516:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431565.968113:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb63527180 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x516:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.968120:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb63527180 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x516:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.968132:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431565.968151:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+83:2349:x1876351933548032:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 85us (5207us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.968157:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16636
00000100:00100000:1.0:1789431565.968171:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16637
00000100:00100000:1.0:1789431565.968178:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+82:2349:x1876351933547648:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431565.968188:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:3.0:1789431565.968729:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+75:2348:x1876351933546752:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1645us (6246us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.968739:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16632
00000100:00100000:3.0:1789431565.968765:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16638
00000100:00100000:3.0:1789431565.968776:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+82:2349:x1876351933547904:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431565.968788:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431565.968795:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000200c53b8/0xd8e438fb63516f36 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c41bb expref: 82 pid: 14482 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.968807:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000200c53b8/0xd8e438fb63516f36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c41bb expref: 82 pid: 14482 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.968823:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431565.968826:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431565.968831:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f73e5691/0xd8e438fb63527179 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.968839:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f73e5691/0xd8e438fb63527179 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.968855:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431565.968879:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+82:2349:x1876351933547904:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 107us (5907us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.968885:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16638
00000100:00100000:3.0:1789431565.968902:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16639
00000100:00100000:3.0:1789431565.968909:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+81:2348:x1876351933547008:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431565.968916:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431565.968923:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000709daef9/0xd8e438fb6351668b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3edc expref: 81 pid: 14501 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.968934:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000709daef9/0xd8e438fb6351668b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3edc expref: 81 pid: 14501 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.968946:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431565.968949:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431565.968953:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f7fd317/0xd8e438fb63527148 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.968961:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f7fd317/0xd8e438fb63527148 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.968974:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431565.968988:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+81:2348:x1876351933547008:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 80us (6490us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.968994:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16639
00010000:00010000:3.0:1789431565.969080:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000005adae1/0xd8e438fb63526a87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8de2 expref: 80 pid: 14505 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.969103:0:14486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce029f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14486:1876351894245632:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431565.969130:0:14486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb63527180 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.969142:0:14486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb63527180 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.969150:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb63527180 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.969163:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb63527180 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.969172:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb63527180 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.969200:0:14486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431565.969404:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4dd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431565.969408:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4dd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431565.969413:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd11ad65/0xd8e438fb6352715d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.969423:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd11ad65/0xd8e438fb6352715d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.969439:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431565.969464:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2348:x1876351933547264:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1888us (6928us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431565.969473:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16633
00000100:00100000:3.0:1789431565.974283:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+43:3314:x1876351894244096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 54969us (65686us total) trans 4294969653 rc 0/0
00000100:00100000:3.0:1789431565.974299:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8366
00000004:00080000:3.0:1789431565.974400:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba1b100/2, rc 0, transno 4294969653
00000100:00100000:3.0:1789431565.974421:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894244096:0@lo:6:osp-syn-0-0.0
00010000:00010000:0.0:1789431565.975068:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000200c53b8/0xd8e438fb63516f36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c41bb expref: 79 pid: 14482 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.975093:0:14491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf1e918000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:14491:1876351894245504:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431565.975122:0:14491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f73e5691/0xd8e438fb63527179 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.975135:0:14491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f73e5691/0xd8e438fb63527179 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.975149:0:14491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f73e5691/0xd8e438fb63527179 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.975161:0:14491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f73e5691/0xd8e438fb63527179 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.975171:0:14491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f73e5691/0xd8e438fb63527179 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.975195:0:14491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:0.0:1789431565.975643:0:14491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+43:3314:x1876351894243584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 61053us (67095us total) trans 4294969654 rc 0/0
00000100:00100000:0.0:1789431565.975653:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8365
00010000:00010000:0.0:1789431565.975690:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:0.0:1789431565.975700:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb63527180 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.975722:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b275400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431565.975728:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb63527180 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.975740:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb63527180 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.975766:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb63527180 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.975776:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008032e43b/0xd8e438fb63527180 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.975799:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431565.975803:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f73e5691/0xd8e438fb63527179 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.975811:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431565.975814:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f73e5691/0xd8e438fb63527179 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.975821:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f73e5691/0xd8e438fb63527179 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.975830:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f73e5691/0xd8e438fb63527179 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.975837:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f73e5691/0xd8e438fb63527179 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.975851:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431565.975853:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431565.975855:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431565.975862:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:0.0:1789431565.975891:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba19500/2, rc 0, transno 4294969654
00000100:00100000:0.0:1789431565.975899:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894243584:0@lo:6:osp-syn-0-0.0
00010000:00010000:1.0:1789431565.976490:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087c926ad/0xd8e438fb635266f9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x515:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d41 expref: 78 pid: 14469 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.976512:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087c926ad/0xd8e438fb635266f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x515:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d41 expref: 78 pid: 14469 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.976542:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x515:0x0].0x0 since=1s v=(0 0)
00010000:00010000:1.0:1789431565.976547:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x515:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431565.976555:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb6352716b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x515:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.976565:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb6352716b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x515:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.976993:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431565.977076:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+78:2349:x1876351933547648:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 8893us (14113us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431565.977090:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16637
00010000:00010000:3.0:1789431565.977779:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098f005cd/0xd8e438fb635208e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c732b expref: 73 pid: 14502 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.977812:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1876351894244352:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431565.978935:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb6352713a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.978960:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb6352713a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.978969:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb6352713a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.978983:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb6352713a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.978991:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb6352713a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.979022:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:3.0:1789431565.982442:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3314:x1876351894243200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 72549us (73994us total) trans 4294970049 rc 0/0
00000100:00100000:3.0:1789431565.982459:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8356
00010000:00010000:3.0:1789431565.982547:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f443ef31/0xd8e438fb63520482 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c71c6 expref: 72 pid: 14502 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431565.982570:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14482:1876351894244224:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431565.982779:0:14482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007d2dcbad/0xd8e438fb63527133 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.982795:0:14482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007d2dcbad/0xd8e438fb63527133 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.982803:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d2dcbad/0xd8e438fb63527133 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.982814:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2dcbad/0xd8e438fb63527133 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.982824:0:14482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d2dcbad/0xd8e438fb63527133 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.982856:0:14482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:0.0:1789431565.983251:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294970032 gen 2
00000004:00080000:0.0:1789431565.983264:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce156b0a80, transno 4294970009
00000004:00080000:0.0:1789431565.983279:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf37e3fb80, transno 4294970010
00000004:00080000:0.0:1789431565.983282:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf37e3c380, transno 4294970011
00000004:00080000:0.0:1789431565.983284:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf37e3f480, transno 4294970012
00000004:00080000:0.0:1789431565.983287:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf37e3ea00, transno 4294970013
00000004:00080000:0.0:1789431565.983290:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce20fd7b80, transno 4294970014
00000004:00080000:0.0:1789431565.983292:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba1bb80, transno 4294970015
00000004:00080000:0.0:1789431565.983295:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba1b800, transno 4294970016
00000004:00080000:0.0:1789431565.983297:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba19f80, transno 4294970017
00000004:00080000:0.0:1789431565.983300:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba1a680, transno 4294970018
00000004:00080000:0.0:1789431565.983304:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba18700, transno 4294970019
00000004:00080000:0.0:1789431565.983306:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce36219c00, transno 4294970020
00000004:00080000:0.0:1789431565.983310:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3c157480, transno 4294970021
00000004:00080000:0.0:1789431565.983317:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3c157800, transno 4294970022
00000004:00080000:0.0:1789431565.983322:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce156b2300, transno 4294970023
00000004:00080000:0.0:1789431565.983325:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce156b2d80, transno 4294970024
00000004:00080000:0.0:1789431565.983327:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1ac75f80, transno 4294970025
00000004:00080000:0.0:1789431565.983329:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce156b2680, transno 4294970026
00000004:00080000:0.0:1789431565.983331:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1ac74e00, transno 4294970027
00000004:00080000:0.0:1789431565.983333:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce156b0380, transno 4294970028
00000004:00080000:0.0:1789431565.983335:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1ac76680, transno 4294970029
00000004:00080000:0.0:1789431565.983339:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce3a046d80, transno 4294970030
00000004:00080000:0.0:1789431565.983343:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce3a047100, transno 4294970032
00000100:00100000:3.0:1789431565.983517:0:14482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3314:x1876351894242688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 73955us (75187us total) trans 4294970050 rc 0/0
00000100:00100000:3.0:1789431565.983528:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8355
00010000:00010000:3.0:1789431565.983565:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:3.0:1789431565.983573:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb6352713a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.983585:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431565.983590:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb6352713a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.983600:0:3314:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search  req@ffff90ce1ac75880 x1876351894243200/t4294970049(4294970049) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789431581 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295
00000004:00080000:0.0:1789431565.983616:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1ac75880/2, rc 0, transno 4294970049
00000100:00100000:0.0:1789431565.983622:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894243200:0@lo:6:osp-syn-1-0.0
00000004:00080000:0.0:1789431565.983655:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3b2c5880/2, rc 0, transno 4294970050
00000100:00100000:0.0:1789431565.983660:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b2c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894242688:0@lo:6:osp-syn-1-0.0
00010000:00010000:3.0:1789431565.983890:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb6352713a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.983923:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb6352713a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.983931:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb6352713a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.983966:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431565.983971:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d2dcbad/0xd8e438fb63527133 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.983979:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431565.983982:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d2dcbad/0xd8e438fb63527133 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.983990:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d2dcbad/0xd8e438fb63527133 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431565.984004:0:8062:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 6 in progress, 4 in flight, 23 done
00010000:00010000:3.0:1789431565.984005:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d2dcbad/0xd8e438fb63527133 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.984020:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d2dcbad/0xd8e438fb63527133 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.984043:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431565.984044:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431565.984079:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431565.984589:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd41e627/0xd8e438fb63520706 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c728a expref: 77 pid: 6698 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.984612:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1876351894244864:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431565.984647:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63527156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.984660:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63527156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.984668:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63527156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.984679:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63527156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.984688:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63527156 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.984718:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431565.985418:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+43:3311:x1876351894243840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 74863us (76521us total) trans 4294969655 rc 0/0
00000100:00100000:0.0:1789431565.985432:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8360
00010000:00010000:0.0:1789431565.985472:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431565.985480:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63527156 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.985491:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7aa00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431565.985495:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63527156 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.985506:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63527156 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.985528:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63527156 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.985536:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63527156 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.985561:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431565.985565:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431565.985566:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431565.985600:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037d3d30f/0xd8e438fb63526fd5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x517:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8f8d expref: 71 pid: 6700 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.985612:0:14501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:14501:1876351894245120:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431565.985629:0:14501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63527164 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.985638:0:14501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63527164 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.985646:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63527164 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.985655:0:14501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63527164 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.985662:0:14501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63527164 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.985677:0:14501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431565.987971:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431565.987989:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63527164 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.988006:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431565.988012:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63527164 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.988024:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63527164 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.988073:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63527164 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.988082:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e39d45/0xd8e438fb63527164 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.988108:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431565.988110:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431565.988112:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431565.988389:0:14499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd90a59a/0xd8e438fb6351871c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c49c5 expref: 70 pid: 14471 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.988403:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e97800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:14499:1876351894245376:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431565.988435:0:14499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000baca1a4f/0xd8e438fb63527172 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.988451:0:14499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000baca1a4f/0xd8e438fb63527172 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.988458:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baca1a4f/0xd8e438fb63527172 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.988468:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baca1a4f/0xd8e438fb63527172 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.988475:0:14499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baca1a4f/0xd8e438fb63527172 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.988500:0:14499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:3.0:1789431565.991383:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14616:x1876351933546496:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 36571us (37907us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431565.991405:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12512
00000100:00100000:0.0:1789431565.991789:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+12:3311:x1876351894243456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 80921us (82793us total) trans 4294970051 rc 0/0
00000100:00100000:0.0:1789431565.991805:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8362
00010000:00010000:0.0:1789431565.991851:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431565.991860:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baca1a4f/0xd8e438fb63527172 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.991869:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431565.991874:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431565.991882:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baca1a4f/0xd8e438fb63527172 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.991894:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baca1a4f/0xd8e438fb63527172 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.991936:0:14499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+11:3313:x1876351894243072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 78693us (79068us total) trans 4294970052 rc 0/0
00000100:00100000:2.0:1789431565.991947:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8364
00010000:00010000:0.0:1789431565.991994:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baca1a4f/0xd8e438fb63527172 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.992006:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baca1a4f/0xd8e438fb63527172 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00080000:2.0:1789431565.992022:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2d50bb80/2, rc 0, transno 4294970052
00000100:00100000:2.0:1789431565.992032:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894243072:0@lo:6:osp-syn-1-0.0
00010000:00010000:0.0:1789431565.992038:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431565.992043:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431565.992046:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431565.992169:0:14505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb63520abe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c73be expref: 69 pid: 14472 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.992183:0:14505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:14505:1876351894244736:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431565.992210:0:14505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb6352714f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.992220:0:14505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb6352714f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.992304:0:14505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb6352714f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.992314:0:14505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb6352714f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.992328:0:14505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb6352714f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431565.992363:0:14505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431565.992485:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431565.992492:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb6352714f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.992501:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431565.992504:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb6352714f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.992514:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb6352714f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.992525:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb6352714f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.992532:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000630d03d0/0xd8e438fb6352714f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.993115:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431565.993119:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431565.993121:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431565.994186:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087c926ad/0xd8e438fb635266f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d41 expref: 76 pid: 14469 timeout: 3123 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.994206:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1876351894245248:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431565.994242:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb6352716b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.994254:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb6352716b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.994261:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb6352716b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.994278:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb6352716b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.994285:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb6352716b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.994308:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431565.994574:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431565.994738:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb6352716b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.994752:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431565.994757:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb6352716b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.994769:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb6352716b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431565.994782:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+11:3311:x1876351894243328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 84374us (85918us total) trans 4294970053 rc 0/0
00000100:00100000:0.0:1789431565.994794:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8359
00010000:00010000:3.0:1789431565.994800:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb6352716b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.994812:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043e0f543/0xd8e438fb6352716b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.997091:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3311:x1876351894243968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 86082us (88061us total) trans 4294969656 rc 0/0
00000100:00100000:2.0:1789431565.997104:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8363
00010000:00010000:2.0:1789431565.997670:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d2532a5/0xd8e438fb6351fe8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c6fce expref: 68 pid: 14501 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.997689:0:14469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14469:1876351894244992:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431565.997725:0:14469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd11ad65/0xd8e438fb6352715d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.997736:0:14469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd11ad65/0xd8e438fb6352715d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.997743:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd11ad65/0xd8e438fb6352715d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.997754:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd11ad65/0xd8e438fb6352715d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.997762:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd11ad65/0xd8e438fb6352715d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.997783:0:14469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1789431565.998229:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3311:x1876351894242944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 87529us (89283us total) trans 4294970054 rc 0/0
00000100:00100000:2.0:1789431565.998238:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8361
00010000:00010000:2.0:1789431565.998282:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000709daef9/0xd8e438fb6351668b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c3edc expref: 75 pid: 14501 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.998295:0:14464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14464:1876351894244608:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431565.998309:0:14464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008f7fd317/0xd8e438fb63527148 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.998318:0:14464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008f7fd317/0xd8e438fb63527148 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.998324:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f7fd317/0xd8e438fb63527148 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.998333:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f7fd317/0xd8e438fb63527148 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.998341:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f7fd317/0xd8e438fb63527148 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.998364:0:14464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:1.0:1789431565.998472:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1789431565.998490:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd11ad65/0xd8e438fb6352715d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.998508:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431565.998515:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd11ad65/0xd8e438fb6352715d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.998536:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd11ad65/0xd8e438fb6352715d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.998568:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd11ad65/0xd8e438fb6352715d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.998577:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd11ad65/0xd8e438fb6352715d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.998628:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431565.998634:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f7fd317/0xd8e438fb63527148 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.998641:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b400 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431565.998646:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f7fd317/0xd8e438fb63527148 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.998654:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f7fd317/0xd8e438fb63527148 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.998670:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f7fd317/0xd8e438fb63527148 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.998678:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f7fd317/0xd8e438fb63527148 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431565.998720:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431565.998723:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431565.998726:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431565.998736:0:14464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3311:x1876351894242816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 88491us (89923us total) trans 4294969657 rc 0/0
00000100:00100000:2.0:1789431565.998745:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8358
00010000:00010000:2.0:1789431565.998783:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003910a4b6/0xd8e438fb63518230 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c4828 expref: 74 pid: 14500 timeout: 3123 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.998797:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:14502:1876351894244480:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431565.998810:0:14502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006abb289d/0xd8e438fb63527141 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.998818:0:14502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006abb289d/0xd8e438fb63527141 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.998825:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006abb289d/0xd8e438fb63527141 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.998836:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006abb289d/0xd8e438fb63527141 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.998844:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006abb289d/0xd8e438fb63527141 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431565.998864:0:14502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431565.999238:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431565.999253:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006abb289d/0xd8e438fb63527141 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.999265:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc16f78b0)
00000100:00100000:2.0:1789431565.999268:0:14502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+43:3314:x1876351894243712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 89230us (90772us total) trans 4294969658 rc 0/0
00010000:00010000:3.0:1789431565.999272:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006abb289d/0xd8e438fb63527141 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431565.999285:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8357
00010000:00010000:3.0:1789431565.999298:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006abb289d/0xd8e438fb63527141 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.999318:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006abb289d/0xd8e438fb63527141 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.999325:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006abb289d/0xd8e438fb63527141 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431565.999362:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431565.999366:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431565.999371:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431565.999443:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431565.999628:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:0.0:1789431566.000120:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba18a80/2, rc 0, transno 4294969658
00000100:00100000:0.0:1789431566.000141:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894243712:0@lo:6:osp-syn-0-0.0
00000004:00080000:2.0:1789431566.000703:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce17f3c380/2, rc 0, transno 4294970054
00000100:00100000:2.0:1789431566.000720:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894242944:0@lo:6:osp-syn-1-0.0
00000004:00080000:2.0:1789431566.000741:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1ac77100/2, rc 0, transno 4294970051
00000100:00100000:2.0:1789431566.000745:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894243456:0@lo:6:osp-syn-1-0.0
00000004:00080000:2.0:1789431566.000755:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba1ad80/2, rc 0, transno 4294969656
00000100:00100000:2.0:1789431566.000759:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894243968:0@lo:6:osp-syn-0-0.0
00000004:00080000:2.0:1789431566.000767:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce20fd7100/2, rc 0, transno 4294969657
00000100:00100000:2.0:1789431566.000771:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894242816:0@lo:6:osp-syn-0-0.0
00000004:00080000:2.0:1789431566.000779:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1ac74700/2, rc 0, transno 4294970053
00000100:00100000:2.0:1789431566.000782:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894243328:0@lo:6:osp-syn-1-0.0
00000004:00080000:2.0:1789431566.000790:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ba18e00/2, rc 0, transno 4294969655
00000100:00100000:2.0:1789431566.000793:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894243840:0@lo:6:osp-syn-0-0.0
00000100:00100000:1.0:1789431566.020214:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.021238:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933548288
00000100:00100000:2.0:1789431566.021253:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933548288
00000100:00100000:2.0:1789431566.021337:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296157
00000100:00100000:2.0:1789431566.021353:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14616:x1876351933548288:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431566.021376:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431566.021398:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527187 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c8ffd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.021471:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352718e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.021491:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352718e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.021506:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352718e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.021521:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63527195 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.021527:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63527195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.021534:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63527195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.021595:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352718e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.021602:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352718e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.021616:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352718e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.021622:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431566.021625:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352718e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.021633:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352718e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.022623:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431566.022627:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431566.022635:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352718e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.022722:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb6352718e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.022745:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63527195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.022752:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63527195 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.022760:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63527195 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.022765:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ace00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431566.022769:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63527195 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.022777:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63527195 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.022786:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf13195600)
00010000:00010000:2.0:1789431566.022788:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431566.022792:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63527195 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.022798:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63527195 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.022844:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527187 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ffd expref: 194 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.022857:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431566.022859:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:2.0:1789431566.022864:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527187 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ffd expref: 194 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.022877:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad800, rc 0)
00000100:00100000:2.0:1789431566.023112:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14616:x1876351933548288:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1762us (2920us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431566.023122:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296157
00000100:00080000:3.0:1789431566.023231:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:3.0:1789431566.044559:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.044617:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933548544
00000100:00100000:3.0:1789431566.044631:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933548544
00000100:00100000:3.0:1789431566.045147:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296158
00000100:00100000:3.0:1789431566.045162:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14616:x1876351933548544:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431566.045450:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431566.045455:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431566.045496:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274400/0xd8e438fb6352712c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ff6 expref: 193 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.045522:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431566.045529:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431566.045547:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274c00/0xd8e438fb6352719c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9004 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.046463:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb635271a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.046492:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb635271a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.046507:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb635271a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.046526:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb635271aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.046534:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb635271aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.046541:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb635271aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:3.0:1789431566.048654:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x518:0x0], index 1: 0
00010000:00010000:3.0:1789431566.048927:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb635271b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.048949:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb635271b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.048968:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb635271b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.049015:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb635271a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.049023:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb635271a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.049031:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb635271a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.049036:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b275600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431566.049041:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb635271a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.049084:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb635271a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.049100:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431566.049104:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431566.049110:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb635271a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.049117:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275600/0xd8e438fb635271a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431566.049135:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007d09daa4 reply state 00000000f95871cc transno 4295121074 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb635271aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.049146:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431566.049196:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b274c00/0xd8e438fb6352719c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9004 expref: 195 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.049214:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb635271b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9004 expref: 194 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.049221:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf18b78200)
00010000:00010000:3.0:1789431566.049224:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431566.049226:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b275400, rc 0)
00000100:00100000:3.0:1789431566.049336:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14616:x1876351933548544:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4178us (4790us total) trans 4295121074 rc 0/0
00000100:00100000:3.0:1789431566.049346:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296158
00010000:00010000:1.0:1789431566.062162:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb635271aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.062181:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb635271aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.062190:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb635271aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.062197:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b275a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431566.062211:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb635271aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.062222:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb635271aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431566.062237:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431566.062262:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf18b78400)
00010000:00010000:1.0:1789431566.062267:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431566.062274:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb635271aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.062281:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275a00/0xd8e438fb635271aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.063084:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933548672
00000100:00100000:3.0:1789431566.063099:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933548672
00000100:00100000:3.0:1789431566.063267:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8368
00000100:00100000:3.0:1789431566.063284:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2348:x1876351933548672:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431566.063302:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431566.063326:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635271bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c900b expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431566.063355:0:8217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x518:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00000100:00080000:1.0:1789431566.063369:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1789431566.063378:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x518:0x0].0x0 since=3024s v=(0 0)
00010000:00010000:3.0:1789431566.063384:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x518:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431566.063394:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635271bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c900b expref: 69 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.063412:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635271bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c900b expref: 69 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.063426:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b600, rc 0)
00000100:00100000:3.0:1789431566.063495:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2348:x1876351933548672:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 216us (1275us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431566.063503:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8368
00000100:00100000:2.0:1789431566.088752:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.088890:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933548800
00000100:00100000:3.0:1789431566.088906:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933548800
00000100:00100000:3.0:1789431566.088974:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8369
00000100:00100000:3.0:1789431566.088985:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:14616:x1876351933548800:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431566.089004:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431566.089031:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb635271c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9012 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.089084:0:14497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635271bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c900b expref: 70 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.089094:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x518:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431566.089099:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x518:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431566.089104:0:14497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb635271c6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9012 expref: 70 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.089138:0:14497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635271bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c900b expref: 70 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.089152:0:14497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635271bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c900b expref: 70 pid: 8217 timeout: 3124 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.089167:0:14497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce029f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:14497:1876351894245760:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431566.089276:0:14497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead480 going to sleep for 11 seconds
00000001:00080000:2.0:1789431566.100221:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969641 is committed
00000001:00080000:3.0:1789431566.102183:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969652 is committed
00000001:00080000:3.0:1789431566.102223:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969647 is committed
00000001:00080000:3.0:1789431566.102289:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969649 is committed
00000100:00100000:1.0:1789431566.102960:0:14490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2348:x1876351933546368:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 183457us (184593us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431566.102974:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8367
00000100:00100000:2.0:1789431566.108375:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.108563:0:14497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce029f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:14497:1876351894245760:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431566.108625:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb635271c6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9012 expref: 70 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.108652:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b400, rc 0)
00000100:00100000:3.0:1789431566.108751:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:14616:x1876351933548800:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 19768us (20013us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431566.108763:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8369
00000100:00100000:0.0:1789431566.109292:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933548928
00000100:00100000:0.0:1789431566.109304:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933548928
00010000:00010000:0.0:1789431566.109352:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635271bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c900b expref: 70 pid: 8217 timeout: 3124 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431566.109396:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16640
00000100:00100000:0.0:1789431566.109408:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2347:x1876351933548928:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431566.109426:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431566.109461:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635271bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x518:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c900b expref: 70 pid: 8217 timeout: 3124 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.109475:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635271bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x518:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c900b expref: 70 pid: 8217 timeout: 3124 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.109510:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635271bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x518:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c900b expref: 70 pid: 8217 timeout: 3124 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.109529:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x518:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431566.109534:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x518:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431566.109543:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb635271c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9012 expref: 69 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.109555:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb635271c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9012 expref: 69 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.109609:0:6715:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb635271c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9012 expref: 69 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431566.109626:0:6715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1e91aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6715:1876351894245888:192.168.203.4@tcp:105:
00000100:00100000:0.0:1789431566.109983:0:6715:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1e8c93c0 going to sleep for 11 seconds
00000100:00100000:2.0:1789431566.118533:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431566.118641:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933549056
00000100:00100000:0.0:1789431566.118651:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933549056
00002000:00100000:0.0:1789431566.118732:0:14439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x518:0x0] (0->4095)  req@ffff90cf37e97b80 x1876351933549056/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/0 e 0 to 0 dl 1789431577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431566.118743:0:14439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e97b80 with x1876351933549056 ext(0->4095)
00002000:00010000:0.0:1789431566.118749:0:14439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf37e97b80
00000100:00100000:0.0:1789431566.118780:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1554
00000100:00100000:0.0:1789431566.118789:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2348:x1876351933549056:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:0.0:1789431566.119250:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2348:x1876351933549056:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 448us (712us total) trans 4294969659 rc 0/0
00000100:00100000:0.0:1789431566.119258:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1554
00002000:00100000:0.0:1789431566.119265:0:14439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x518:0x0] (0->4095)  req@ffff90cf37e97b80 x1876351933549056/t4294969659(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/448 e 0 to 0 dl 1789431577 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431566.119272:0:14439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e97b80 with x1876351933549056 ext(0->4095)
00002000:00010000:0.0:1789431566.119276:0:14439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf37e97b80
00000100:00100000:0.0:1789431566.122478:0:6715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf1e91aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6715:1876351894245888:192.168.203.4@tcp:105:
00010000:00010000:0.0:1789431566.122519:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431566.122796:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2347:x1876351933548928:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 13285us (14329us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431566.122811:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16640
00000100:00100000:1.0:1789431566.131516:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.132099:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933549184
00000100:00100000:2.0:1789431566.132114:0:14472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933549184
00000100:00100000:2.0:1789431566.132210:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8370
00000100:00100000:2.0:1789431566.132224:0:14472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2347:x1876351933549184:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:2.0:1789431566.152219:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431566.152911:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933549440
00000100:00100000:1.0:1789431566.152926:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933549440
00000100:00100000:1.0:1789431566.152995:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12513
00000100:00100000:1.0:1789431566.153007:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+194:14616:x1876351933549440:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431566.153993:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14616:x1876351933549440:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 982us (1796us total) trans 4295121075 rc 0/0
00000100:00100000:1.0:1789431566.154004:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12513
00000100:00100000:1.0:1789431566.161830:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.162856:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933549696
00000100:00100000:2.0:1789431566.162869:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933549696
00000100:00100000:2.0:1789431566.162936:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296159
00000100:00100000:2.0:1789431566.162946:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14616:x1876351933549696:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431566.162971:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431566.162992:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635271cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9019 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.163123:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635271d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.163139:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb635271b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9004 expref: 196 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.163148:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635271d4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.163182:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb635271b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9004 expref: 196 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.163194:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb635271b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9004 expref: 196 pid: 5847 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431566.163208:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e97800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894246016:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431566.163514:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e900 going to sleep for 11 seconds
00000100:00100000:0.0:1789431566.170851:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e97800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894246016:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431566.170895:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635271d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431566.173254:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431566.173915:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933549824
00000100:00100000:1.0:1789431566.173932:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933549824
00010000:00010000:1.0:1789431566.173978:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb635271b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9004 expref: 197 pid: 5847 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431566.174014:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16641
00000100:00100000:1.0:1789431566.174024:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:2348:x1876351933549824:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431566.174037:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431566.174045:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb635271b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9004 expref: 197 pid: 5847 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.174094:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb635271b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9004 expref: 197 pid: 5847 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.174117:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275400/0xd8e438fb635271b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9004 expref: 197 pid: 5847 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.174136:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf18b78200)
00010000:00010000:1.0:1789431566.174143:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635271d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.174154:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635271d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.174162:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635271d4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.174191:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431566.174252:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:2348:x1876351933549824:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 230us (1019us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431566.174259:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16641
00010000:00010000:1.0:1789431566.175225:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635271d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.175239:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635271d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431566.175260:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00010000:00010000:1.0:1789431566.175432:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635271cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9019 expref: 197 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.175451:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635271d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9019 expref: 196 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.175459:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf18b78200)
00010000:00010000:1.0:1789431566.175462:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431566.175465:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad000, rc 0)
00000100:00100000:1.0:1789431566.175503:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933549696:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12559us (13683us total) trans 4295121076 rc 0/0
00000100:00100000:1.0:1789431566.175510:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296159
00000100:00100000:2.0:1789431566.191347:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.191381:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933549952
00000100:00100000:2.0:1789431566.191399:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933549952
00000100:00100000:2.0:1789431566.191453:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296160
00000100:00100000:2.0:1789431566.191463:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933549952:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431566.191487:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431566.191512:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635271e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9020 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.191596:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635271e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.191611:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635271d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9019 expref: 197 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.191618:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635271e9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.192806:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635271d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9019 expref: 197 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.192825:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635271d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9019 expref: 197 pid: 12181 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431566.192841:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e97480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894246144:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431566.192919:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065ea80 going to sleep for 11 seconds
00000100:00100000:0.0:1789431566.202021:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e97480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894246144:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431566.202083:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635271e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431566.203556:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431566.206258:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933550080
00000100:00100000:1.0:1789431566.206275:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933550080
00010000:00010000:1.0:1789431566.206323:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635271d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9019 expref: 198 pid: 12181 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431566.206358:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16642
00000100:00100000:1.0:1789431566.206368:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb06850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:2347:x1876351933550080:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431566.206383:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431566.206390:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635271d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9019 expref: 198 pid: 12181 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.206403:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635271d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9019 expref: 198 pid: 12181 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.206427:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635271d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9019 expref: 198 pid: 12181 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.206443:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf18b78200)
00010000:00010000:1.0:1789431566.206448:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635271e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.206458:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635271e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.206470:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635271e9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.206501:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431566.206558:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb06850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:2347:x1876351933550080:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 192us (3009us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431566.206565:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16642
00010000:00010000:1.0:1789431566.206617:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635271e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.206625:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635271e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431566.206690:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:1.0:1789431566.206695:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431566.207894:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635271e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.207940:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635271e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9020 expref: 197 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.207959:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635271e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9020 expref: 196 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.207968:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf18b78200)
00010000:00010000:1.0:1789431566.207971:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431566.207974:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7acc00, rc 0)
00000100:00100000:1.0:1789431566.208027:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933549952:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 16565us (16689us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431566.208038:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296160
00000100:00100000:1.0:1789431566.221966:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.222255:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933550208
00000100:00100000:3.0:1789431566.222266:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933550208
00002000:00100000:3.0:1789431566.222318:0:14449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x518:0x0] (0->83189)  req@ffff90ce2a7e9f80 x1876351933550208/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 488/0 e 0 to 0 dl 1789431577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431566.222331:0:14449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce2a7e9f80 with x1876351933550208 ext(0->83189)
00002000:00010000:3.0:1789431566.222337:0:14449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce2a7e9f80
00000100:00100000:3.0:1789431566.222373:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1555
00000100:00100000:3.0:1789431566.222382:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2349:x1876351933550208:12345-192.168.203.4@tcp:4:dbench.0
00000001:00080000:3.0:1789431566.229294:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969659 is committed
00000001:00080000:3.0:1789431566.229313:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969655 is committed
00000001:00080000:3.0:1789431566.229321:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969658 is committed
00000100:00100000:1.0:1789431566.229528:0:14472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2347:x1876351933549184:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 97300us (98023us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431566.229540:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8370
00000100:00100000:3.0:1789431566.241030:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2349:x1876351933550208:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 18639us (19066us total) trans 4294970055 rc 0/0
00000100:00100000:3.0:1789431566.241043:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1555
00002000:00100000:3.0:1789431566.241095:0:14449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x518:0x0] (0->83189)  req@ffff90ce2a7e9f80 x1876351933550208/t4294970055(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 488/448 e 0 to 0 dl 1789431577 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431566.241105:0:14449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce2a7e9f80 with x1876351933550208 ext(0->83189)
00002000:00010000:3.0:1789431566.241112:0:14449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce2a7e9f80
00000100:00100000:2.0:1789431566.245095:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431566.245176:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933550336
00000100:00100000:0.0:1789431566.245186:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933550336
00002000:00100000:0.0:1789431566.245234:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x518:0x0] (0->4095)  req@ffff90cf37e94e00 x1876351933550336/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/0 e 0 to 0 dl 1789431577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431566.245255:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e94e00 with x1876351933550336 ext(0->4095)
00002000:00010000:0.0:1789431566.245262:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf37e94e00
00000100:00100000:0.0:1789431566.245294:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1556
00000100:00100000:0.0:1789431566.245303:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2348:x1876351933550336:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:0.0:1789431566.245732:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2348:x1876351933550336:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 429us (682us total) trans 4294969660 rc 0/0
00000100:00100000:0.0:1789431566.245740:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1556
00002000:00100000:0.0:1789431566.245748:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x518:0x0] (0->4095)  req@ffff90cf37e94e00 x1876351933550336/t4294969660(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/448 e 0 to 0 dl 1789431577 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431566.245756:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e94e00 with x1876351933550336 ext(0->4095)
00002000:00010000:0.0:1789431566.245760:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf37e94e00
00000100:00100000:1.0:1789431566.251808:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.251939:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933550464
00000100:00100000:2.0:1789431566.251949:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933550464
00000100:00100000:2.0:1789431566.252008:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296161
00000100:00100000:2.0:1789431566.252018:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933550464:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:2.0:1789431566.260651:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.260928:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933550592
00000100:00100000:3.0:1789431566.260938:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933550592
00000100:00100000:3.0:1789431566.260991:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8371
00000100:00100000:3.0:1789431566.261000:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2347:x1876351933550592:12345-192.168.203.4@tcp:16:dbench.0
00000001:00080000:3.0:1789431566.298829:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969660 is committed
00000100:00100000:1.0:1789431566.300784:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2347:x1876351933550592:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 39774us (40140us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431566.300797:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8371
00000100:00100000:3.0:1789431566.310373:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.310509:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933550720
00000100:00100000:2.0:1789431566.310519:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933550720
00002000:00100000:2.0:1789431566.310570:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x518:0x0] (0->4095)  req@ffff90ce029f5500 x1876351933550720/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/0 e 0 to 0 dl 1789431577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431566.310581:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce029f5500 with x1876351933550720 ext(0->4095)
00002000:00010000:2.0:1789431566.310587:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce029f5500
00000100:00100000:2.0:1789431566.310621:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1557
00000100:00100000:2.0:1789431566.310630:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2349:x1876351933550720:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:2.0:1789431566.311105:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2349:x1876351933550720:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 473us (738us total) trans 4294969661 rc 0/0
00000100:00100000:2.0:1789431566.311114:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1557
00002000:00100000:2.0:1789431566.311120:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x518:0x0] (0->4095)  req@ffff90ce029f5500 x1876351933550720/t4294969661(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/448 e 0 to 0 dl 1789431577 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431566.311128:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce029f5500 with x1876351933550720 ext(0->4095)
00002000:00010000:2.0:1789431566.311132:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce029f5500
00000001:00080000:0.0:1789431566.314552:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121073 is committed
00000001:00080000:0.0:1789431566.314567:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121076 is committed
00000100:00100000:1.0:1789431566.314923:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+192:14616:x1876351933550464:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 62901us (63117us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431566.314934:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296161
00000100:00100000:0.0:1789431566.320692:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431566.320860:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.320962:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933550848
00000100:00100000:2.0:1789431566.320971:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933550848
00000100:00100000:2.0:1789431566.321025:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933550976
00000100:00100000:2.0:1789431566.321028:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933550976
00000100:00100000:2.0:1789431566.321158:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8372
00000100:00100000:2.0:1789431566.321169:0:14482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2348:x1876351933550848:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:1.0:1789431566.323841:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8373
00000100:00100000:1.0:1789431566.324344:0:14501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2350:x1876351933550976:12345-192.168.203.4@tcp:16:dbench.0
00000001:00080000:0.0:1789431566.385862:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969661 is committed
00000100:00100000:1.0:1789431566.386022:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2350:x1876351933550976:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 62164us (65157us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431566.386034:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8373
00000100:00100000:0.0:1789431566.392356:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.392671:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933551104
00000100:00100000:2.0:1789431566.392681:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933551104
00002000:00100000:2.0:1789431566.392807:0:14461:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x518:0x0] (0->4095)  req@ffff90cf1e919500 x1876351933551104/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/0 e 0 to 0 dl 1789431577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431566.392818:0:14461:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf1e919500 with x1876351933551104 ext(0->4095)
00002000:00010000:2.0:1789431566.392824:0:14461:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf1e919500
00000100:00100000:2.0:1789431566.392858:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1558
00000100:00100000:2.0:1789431566.392868:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2347:x1876351933551104:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:2.0:1789431566.393309:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2347:x1876351933551104:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 440us (961us total) trans 4294969662 rc 0/0
00000100:00100000:2.0:1789431566.393317:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1558
00002000:00100000:2.0:1789431566.393325:0:14461:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x518:0x0] (0->4095)  req@ffff90cf1e919500 x1876351933551104/t4294969662(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/448 e 0 to 0 dl 1789431577 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431566.393332:0:14461:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf1e919500 with x1876351933551104 ext(0->4095)
00002000:00010000:2.0:1789431566.393336:0:14461:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf1e919500
00000100:00100000:2.0:1789431566.398648:0:14482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2348:x1876351933550848:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 77471us (77956us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431566.398661:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8372
00000001:00080000:1.0:1789431566.399849:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970053 is committed
00000001:00080000:1.0:1789431566.399872:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970054 is committed
00000001:00080000:1.0:1789431566.399881:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970048 is committed
00000001:00080000:1.0:1789431566.399891:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970055 is committed
00000100:00100000:0.0:1789431566.402135:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.402253:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933551232
00000100:00100000:2.0:1789431566.402263:0:14499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933551232
00000100:00100000:2.0:1789431566.402323:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8374
00000100:00100000:2.0:1789431566.402333:0:14499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2350:x1876351933551232:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:0.0:1789431566.411439:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.413344:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933551360
00000100:00100000:3.0:1789431566.413358:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933551360
00002000:00100000:3.0:1789431566.413409:0:14439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x518:0x0] (0->4095)  req@ffff90cf1e919880 x1876351933551360/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/0 e 0 to 0 dl 1789431577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431566.413421:0:14439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf1e919880 with x1876351933551360 ext(0->4095)
00002000:00010000:3.0:1789431566.413427:0:14439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf1e919880
00000100:00100000:3.0:1789431566.414110:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1559
00000100:00100000:3.0:1789431566.414123:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2350:x1876351933551360:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:3.0:1789431566.414604:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2350:x1876351933551360:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 482us (3173us total) trans 4294970056 rc 0/0
00000100:00100000:3.0:1789431566.414612:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1559
00002000:00100000:3.0:1789431566.414621:0:14439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x518:0x0] (0->4095)  req@ffff90cf1e919880 x1876351933551360/t4294970056(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/448 e 0 to 0 dl 1789431577 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431566.414631:0:14439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf1e919880 with x1876351933551360 ext(0->4095)
00002000:00010000:3.0:1789431566.414636:0:14439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf1e919880
00000100:00100000:0.0:1789431566.427870:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.428461:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933551488
00000100:00100000:2.0:1789431566.428472:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933551488
00000100:00100000:2.0:1789431566.428523:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8375
00000100:00100000:2.0:1789431566.428532:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2349:x1876351933551488:12345-192.168.203.4@tcp:16:dbench.0
00000001:00080000:3.0:1789431566.431653:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969662 is committed
00000100:00100000:2.0:1789431566.431824:0:14499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2350:x1876351933551232:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 29486us (29692us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431566.431836:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8374
00000100:00100000:0.0:1789431566.440884:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431566.441335:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933551616
00000100:00100000:1.0:1789431566.441345:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933551616
00000100:00100000:1.0:1789431566.441392:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296162
00000100:00100000:1.0:1789431566.441402:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+192:14617:x1876351933551616:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431566.441423:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431566.441442:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635271f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9027 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441500:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635271f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441514:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635271f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441526:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635271f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441539:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635271fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441546:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635271fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441553:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635271fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441793:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527205 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441803:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441811:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431566.441844:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:1.0:1789431566.441848:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431566.441867:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441877:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441885:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635271f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441892:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635271f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441898:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635271f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441905:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431566.441909:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635271f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441917:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635271f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441927:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431566.441931:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431566.441936:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635271f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441942:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635271f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441955:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635271fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441966:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635271fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441972:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635271fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441977:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431566.441980:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635271fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441986:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635271fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.441993:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce03149400)
00010000:00010000:1.0:1789431566.441995:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431566.441998:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635271fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.442005:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635271fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.442032:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635271f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9027 expref: 194 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.442046:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527205 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9027 expref: 193 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.442085:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:1.0:1789431566.442087:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431566.442089:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309600, rc 0)
00000100:00100000:1.0:1789431566.442142:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933551616:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 741us (1267us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431566.442149:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296162
00000100:00100000:3.0:1789431566.446552:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.446589:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933551872
00000100:00100000:3.0:1789431566.446599:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933551872
00000100:00100000:3.0:1789431566.446651:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296163
00000100:00100000:3.0:1789431566.446663:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933551872:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431566.446734:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:3.0:1789431566.446763:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527205 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9027 expref: 193 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.446785:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b275200/0xd8e438fb63527099 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fcc expref: 192 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.446795:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431566.446804:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431566.446846:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352720c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.446859:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352720c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.446870:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352720c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431566.447094:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000023211f5d reply state 00000000bf79c982 transno 4295121077 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352720c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.447104:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431566.447194:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933551872:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 533us (651us total) trans 4295121077 rc 0/0
00000100:00100000:3.0:1789431566.447201:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296163
00010000:00010000:0.0:1789431566.454135:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352720c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.454152:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352720c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.454161:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352720c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.454167:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7be00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431566.454172:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352720c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.454180:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352720c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.454195:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78700)
00010000:00010000:0.0:1789431566.454198:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431566.454202:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352720c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.454208:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352720c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431566.458747:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.464148:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933552000
00000100:00100000:3.0:1789431566.464163:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933552000
00000100:00100000:3.0:1789431566.464233:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296164
00000100:00100000:3.0:1789431566.464252:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+192:14617:x1876351933552000:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431566.464275:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431566.464297:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527213 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c902e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.464368:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527213 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c902e expref: 193 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.464384:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527213 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c902e expref: 193 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.464404:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431566.464407:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00010000:3.0:1789431566.464411:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b000, rc 0)
00000100:00100000:3.0:1789431566.464472:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933552000:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 222us (5733us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431566.464483:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296164
00000100:00100000:3.0:1789431566.468580:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.468687:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933552128
00000100:00100000:2.0:1789431566.468697:0:14464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933552128
00000100:00100000:2.0:1789431566.468763:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8376
00000100:00100000:2.0:1789431566.468772:0:14464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2349:x1876351933552128:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:2.0:1789431566.468982:0:14464:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x518:0x0] updating lvb size from disk: 0 -> 83190
00002000:00010000:2.0:1789431566.468985:0:14464:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x518:0x0] updating lvb mtime from disk: 0 -> 1789431553
00002000:00010000:2.0:1789431566.468988:0:14464:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x518:0x0] updating lvb atime from disk: 0 -> 1789431555
00002000:00010000:2.0:1789431566.468990:0:14464:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x518:0x0] updating lvb ctime from disk: 0 -> 1789431565
00002000:00010000:2.0:1789431566.468992:0:14464:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x518:0x0] updating lvb blocks from disk: 1 -> 259
00000100:00100000:2.0:1789431566.469068:0:14464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+66:2349:x1876351933552128:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 277us (477us total) trans 4294969663 rc 0/0
00000100:00100000:2.0:1789431566.469075:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8376
00000100:00100000:0.0:1789431566.476946:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.477045:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933552384
00000100:00100000:2.0:1789431566.477070:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933552384
00000100:00100000:2.0:1789431566.477113:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296165
00000100:00100000:2.0:1789431566.477122:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933552384:12345-192.168.203.4@tcp:55:dbench.0
00010000:00010000:2.0:1789431566.477175:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb6352721a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.477191:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb6352721a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.477202:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb6352721a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.477225:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb6352721a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.477231:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb6352721a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.477252:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb6352721a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.477258:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431566.477262:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb6352721a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.477270:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb6352721a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.477279:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:2.0:1789431566.477282:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:2.0:1789431566.477286:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb6352721a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.477292:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb6352721a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431566.477407:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933552384:12345-192.168.203.4@tcp:55:dbench.0 Request processed in 286us (470us total) trans 0 rc -22/-22
00000100:00100000:2.0:1789431566.477415:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296165
00000001:00080000:1.0:1789431566.481568:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970056 is committed
00000100:00100000:2.0:1789431566.481872:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2349:x1876351933551488:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 53336us (54006us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431566.481885:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8375
00000100:00100000:0.0:1789431566.487806:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431566.487910:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933552512
00000100:00100000:1.0:1789431566.487920:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933552512
00002000:00100000:1.0:1789431566.487970:0:14484:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x518:0x0] (0->4095)  req@ffff90cf1e91b480 x1876351933552512/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/0 e 0 to 0 dl 1789431577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431566.487980:0:14484:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf1e91b480 with x1876351933552512 ext(0->4095)
00002000:00010000:1.0:1789431566.487986:0:14484:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf1e91b480
00000100:00100000:1.0:1789431566.488096:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1560
00000100:00100000:1.0:1789431566.488107:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+66:2347:x1876351933552512:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:1.0:1789431566.488513:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2347:x1876351933552512:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 407us (715us total) trans 4294969664 rc 0/0
00000100:00100000:1.0:1789431566.488521:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1560
00002000:00100000:1.0:1789431566.488528:0:14484:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x518:0x0] (0->4095)  req@ffff90cf1e91b480 x1876351933552512/t4294969664(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/448 e 0 to 0 dl 1789431577 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431566.488537:0:14484:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf1e91b480 with x1876351933552512 ext(0->4095)
00002000:00010000:1.0:1789431566.488540:0:14484:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf1e91b480
00000100:00100000:3.0:1789431566.508135:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.508171:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.508462:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933552768
00000100:00100000:2.0:1789431566.508472:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933552768
00000100:00100000:2.0:1789431566.508527:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296166
00000100:00100000:2.0:1789431566.508538:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933552768:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:2.0:1789431566.508662:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933552768:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 126us (489us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431566.508669:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296166
00000100:00100000:1.0:1789431566.509076:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933552640
00000100:00100000:1.0:1789431566.509083:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933552640
00002000:00100000:1.0:1789431566.509113:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x518:0x0] (0->4095)  req@ffff90ce029f4e00 x1876351933552640/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/0 e 0 to 0 dl 1789431577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431566.509122:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce029f4e00 with x1876351933552640 ext(0->4095)
00002000:00010000:1.0:1789431566.509128:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce029f4e00
00000100:00100000:1.0:1789431566.509155:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1561
00000100:00100000:1.0:1789431566.509163:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2348:x1876351933552640:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:0.0:1789431566.509763:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2348:x1876351933552640:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 597us (1634us total) trans 4294970057 rc 0/0
00000100:00100000:0.0:1789431566.509772:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1561
00002000:00100000:0.0:1789431566.509778:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x518:0x0] (0->4095)  req@ffff90ce029f4e00 x1876351933552640/t4294970057(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/448 e 0 to 0 dl 1789431577 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431566.509787:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce029f4e00 with x1876351933552640 ext(0->4095)
00002000:00010000:0.0:1789431566.509790:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce029f4e00
00000100:00100000:3.0:1789431566.516167:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431566.516429:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933552896
00000100:00100000:1.0:1789431566.516439:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933552896
00000100:00100000:1.0:1789431566.516496:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8377
00000100:00100000:1.0:1789431566.516506:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2347:x1876351933552896:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:0.0:1789431566.522363:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.522439:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933553024
00000100:00100000:3.0:1789431566.522449:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933553024
00000100:00100000:3.0:1789431566.522500:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8378
00000100:00100000:3.0:1789431566.522509:0:14500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2350:x1876351933553024:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:1.0:1789431566.557617:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2347:x1876351933552896:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 41103us (41450us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431566.557630:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8377
00000001:00080000:3.0:1789431566.559553:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969664 is committed
00000001:00080000:1.0:1789431566.562128:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970057 is committed
00000100:00100000:2.0:1789431566.562278:0:14500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2350:x1876351933553024:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 39765us (39919us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431566.562290:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8378
00000100:00100000:0.0:1789431566.564714:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431566.564801:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933553280
00000100:00100000:1.0:1789431566.564811:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933553280
00000100:00100000:1.0:1789431566.564870:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12514
00000100:00100000:1.0:1789431566.564879:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933553280:12345-192.168.203.4@tcp:35:dbench.0
00000001:00080000:1.0:1789431566.565161:0:14495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4295121078
00000100:00100000:1.0:1789431566.565272:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14617:x1876351933553280:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 393us (576us total) trans 4295121079 rc 0/0
00000100:00100000:1.0:1789431566.565279:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12514
00000020:00080000:1.0:1789431566.565284:0:14495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC
00000100:00100000:0.0:1789431566.570635:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.570745:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933553408
00000100:00100000:3.0:1789431566.570755:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933553408
00000100:00100000:3.0:1789431566.570814:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296167
00000100:00100000:3.0:1789431566.570824:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14617:x1876351933553408:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431566.570853:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431566.570875:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527221 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9035 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.570937:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527228 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.570952:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527228 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.570964:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527228 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.570977:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352722f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.570984:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352722f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.570991:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352722f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.571526:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527236 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.571536:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.571544:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431566.571579:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:3.0:1789431566.571583:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431566.571603:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.571615:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.571623:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527228 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.571629:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527228 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.571636:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527228 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.571645:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431566.571650:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527228 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431566.571772:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.571854:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933553536
00000100:00100000:2.0:1789431566.571860:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933553536
00010000:00010000:3.0:1789431566.571865:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527228 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.571877:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431566.571880:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431566.571885:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527228 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.571891:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527228 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00002000:00100000:2.0:1789431566.571893:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x518:0x0] (0->4095)  req@ffff90cf37e3fb80 x1876351933553536/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/0 e 0 to 0 dl 1789431577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431566.571902:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e3fb80 with x1876351933553536 ext(0->4095)
00010000:00010000:3.0:1789431566.571904:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352722f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789431566.571907:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf37e3fb80
00010000:00010000:3.0:1789431566.571910:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352722f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.571915:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352722f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.571920:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431566.571923:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352722f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.571929:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352722f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431566.571935:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1562
00010000:00010000:3.0:1789431566.571940:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90cf18b78100)
00000100:00100000:2.0:1789431566.571943:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2347:x1876351933553536:12345-192.168.203.4@tcp:4:dbench.0
00010000:00010000:3.0:1789431566.571943:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431566.571946:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352722f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.571951:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352722f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.571982:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527221 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9035 expref: 197 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.571995:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527236 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9035 expref: 196 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.572002:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431566.572004:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431566.572007:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7ba00, rc 0)
00000100:00100000:3.0:1789431566.572296:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14617:x1876351933553408:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1472us (1669us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431566.572303:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296167
00000100:00100000:2.0:1789431566.572316:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2347:x1876351933553536:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 374us (545us total) trans 4294970058 rc 0/0
00000100:00100000:2.0:1789431566.572323:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1562
00002000:00100000:2.0:1789431566.572328:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x518:0x0] (0->4095)  req@ffff90cf37e3fb80 x1876351933553536/t4294970058(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/448 e 0 to 0 dl 1789431577 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431566.572337:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e3fb80 with x1876351933553536 ext(0->4095)
00002000:00010000:2.0:1789431566.572341:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf37e3fb80
00000100:00100000:0.0:1789431566.576536:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.576617:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933553664
00000100:00100000:3.0:1789431566.576626:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933553664
00000100:00100000:3.0:1789431566.576737:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8379
00000100:00100000:3.0:1789431566.576748:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2349:x1876351933553664:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:0.0:1789431566.579486:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.579818:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933553920
00000100:00100000:2.0:1789431566.579829:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933553920
00000100:00100000:2.0:1789431566.579889:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296168
00000100:00100000:2.0:1789431566.579900:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14617:x1876351933553920:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431566.579923:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431566.579944:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb6352723d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c903c expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.580045:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527244 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.580104:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527236 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9035 expref: 197 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.580114:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527244 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.580147:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527236 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9035 expref: 197 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.580161:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527236 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9035 expref: 197 pid: 5847 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431566.580174:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e97480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894246272:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431566.581888:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bffe9c0 going to sleep for 11 seconds
00000100:00100000:1.0:1789431566.588386:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431566.588419:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933554048
00000100:00100000:1.0:1789431566.588427:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933554048
00010000:00010000:1.0:1789431566.588466:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527236 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9035 expref: 198 pid: 5847 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431566.588503:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16643
00000100:00100000:1.0:1789431566.588514:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:2350:x1876351933554048:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431566.588528:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431566.588534:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527236 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9035 expref: 198 pid: 5847 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.588547:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527236 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9035 expref: 198 pid: 5847 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.588568:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:1.0:1789431566.588574:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527244 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.588584:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527244 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.588592:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527244 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.588610:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431566.589317:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527236 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9035 expref: 198 pid: 5847 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.589339:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e97480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894246272:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431566.589359:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527244 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.589368:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527244 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.589374:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527244 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431566.589392:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00010000:00010000:3.0:1789431566.589543:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb6352723d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c903c expref: 199 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.589559:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527244 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c903c expref: 198 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.589567:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431566.589570:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431566.589572:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad800, rc 0)
00000100:00100000:3.0:1789431566.589622:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933553920:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9724us (10146us total) trans 4295121080 rc 0/0
00000100:00100000:3.0:1789431566.589629:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296168
00000100:00100000:1.0:1789431566.589760:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:2350:x1876351933554048:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 155us (291us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431566.589771:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16643
00000100:00100000:1.0:1789431566.597571:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.597644:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933554176
00000100:00100000:2.0:1789431566.597656:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933554176
00000100:00100000:2.0:1789431566.597733:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296169
00000100:00100000:2.0:1789431566.597744:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14617:x1876351933554176:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431566.597769:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431566.597790:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63527252 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9043 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.597878:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63527259 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.597894:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527244 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c903c expref: 198 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.597902:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63527259 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.597934:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527244 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c903c expref: 198 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.597946:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527244 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c903c expref: 198 pid: 6797 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431566.597959:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e97800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894246400:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431566.598039:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bffeb40 going to sleep for 11 seconds
00000100:00100000:1.0:1789431566.602372:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e97800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894246400:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431566.602512:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63527259 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431566.603264:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.603701:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933554304
00000100:00100000:3.0:1789431566.603718:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933554304
00010000:00010000:3.0:1789431566.603756:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527244 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c903c expref: 199 pid: 6797 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.603801:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16644
00000100:00100000:3.0:1789431566.603812:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:2347:x1876351933554304:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431566.603827:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431566.603834:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527244 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c903c expref: 199 pid: 6797 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.603848:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527244 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c903c expref: 199 pid: 6797 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.603869:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527244 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c903c expref: 199 pid: 6797 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.603885:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431566.603890:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63527259 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.603899:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63527259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.603908:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63527259 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.603943:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431566.603986:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63527259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.603996:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63527259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.604002:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:2347:x1876351933554304:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 190us (738us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431566.604012:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16644
00000004:00200000:0.0:1789431566.604043:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:0.0:1789431566.604065:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431566.604086:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63527259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.604117:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63527252 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9043 expref: 198 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.604133:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63527259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9043 expref: 197 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.604140:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:0.0:1789431566.604143:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431566.604146:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad000, rc 0)
00000100:00100000:0.0:1789431566.604175:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14617:x1876351933554176:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6434us (6614us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431566.604183:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296169
00000100:00100000:3.0:1789431566.612925:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431566.613040:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933554432
00000100:00100000:1.0:1789431566.613079:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933554432
00000100:00100000:1.0:1789431566.613135:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296170
00000100:00100000:1.0:1789431566.613147:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14617:x1876351933554432:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431566.613170:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431566.613192:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527260 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c904a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.613259:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527267 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.613274:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527267 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.613657:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527267 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.613797:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352726e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.613807:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352726e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.613814:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352726e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.613991:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527275 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614001:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614012:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431566.614044:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:1.0:1789431566.614120:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431566.614145:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614157:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614164:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527267 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614171:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527267 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614177:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527267 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614183:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431566.614187:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527267 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614194:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527267 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614205:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431566.614208:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431566.614213:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527267 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614221:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527267 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614232:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352726e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614238:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352726e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614244:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352726e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614248:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431566.614250:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352726e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614255:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352726e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614261:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce03149300)
00010000:00010000:1.0:1789431566.614263:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431566.614265:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352726e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614270:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352726e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614360:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527260 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c904a expref: 199 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614381:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527275 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c904a expref: 198 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.614582:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:1.0:1789431566.614585:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431566.614587:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308c00, rc 0)
00000100:00100000:1.0:1789431566.614779:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933554432:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1633us (1863us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431566.614788:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296170
00000100:00100000:3.0:1789431566.622598:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.622638:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933554688
00000100:00100000:3.0:1789431566.622648:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933554688
00000100:00100000:3.0:1789431566.622700:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296171
00000100:00100000:3.0:1789431566.622718:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933554688:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431566.622768:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:3.0:1789431566.622794:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527275 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c904a expref: 198 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.622816:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb63527259 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9043 expref: 197 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.622826:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431566.622831:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431566.622872:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352727c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.622885:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352727c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.622895:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352727c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431566.623025:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c174fff0 reply state 0000000054ed34a6 transno 4295121081 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352727c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.623034:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431566.623149:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933554688:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 432us (560us total) trans 4295121081 rc 0/0
00000100:00100000:3.0:1789431566.623161:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296171
00010000:00010000:0.0:1789431566.626296:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352727c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.626314:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352727c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.626322:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352727c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.626330:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431566.626336:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352727c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.626344:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352727c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.626360:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:0.0:1789431566.626363:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431566.626367:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352727c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.626725:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352727c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431566.637027:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.638355:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933554816
00000100:00100000:3.0:1789431566.638367:0:14472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933554816
00000100:00100000:3.0:1789431566.638428:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8380
00000100:00100000:3.0:1789431566.638439:0:14472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2348:x1876351933554816:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:3.0:1789431566.638662:0:14472:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x518:0x0] updating lvb size from disk: 83190 -> 83190
00002000:00010000:3.0:1789431566.638666:0:14472:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x518:0x0] updating lvb mtime from disk: 1789431553 -> 1789431554
00002000:00010000:3.0:1789431566.638669:0:14472:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x518:0x0] updating lvb atime from disk: 1789431555 -> 1789431545
00002000:00010000:3.0:1789431566.638672:0:14472:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x518:0x0] updating lvb ctime from disk: 1789431565 -> 1789431566
00002000:00010000:3.0:1789431566.638675:0:14472:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x518:0x0] updating lvb blocks from disk: 259 -> 259
00000100:00100000:3.0:1789431566.638745:0:14472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+66:2348:x1876351933554816:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 308us (1726us total) trans 4294969665 rc 0/0
00000100:00100000:3.0:1789431566.638752:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8380
00010000:00010000:2.0:1789431566.642005:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789431566.643830:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970058 is committed
00000100:00100000:3.0:1789431566.644855:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2349:x1876351933553664:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 68102us (68320us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431566.644867:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8379
00000100:00100000:1.0:1789431566.648207:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.648386:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933555072
00000100:00100000:3.0:1789431566.648397:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933555072
00000100:00100000:3.0:1789431566.648465:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12515
00000100:00100000:3.0:1789431566.648476:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14617:x1876351933555072:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431566.648734:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933555072:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 259us (536us total) trans 4295121082 rc 0/0
00000100:00100000:3.0:1789431566.648742:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12515
00000100:00100000:1.0:1789431566.662666:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431566.662768:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933555200
00000100:00100000:0.0:1789431566.662778:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933555200
00000100:00100000:0.0:1789431566.662839:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296172
00000100:00100000:0.0:1789431566.662849:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933555200:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431566.662873:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431566.662893:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527283 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9051 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.662961:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352728a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.662976:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352728a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.662987:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352728a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663002:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527291 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663009:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663016:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663310:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527298 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663320:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663328:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431566.663359:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:0.0:1789431566.663363:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431566.663381:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663396:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663404:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352728a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663411:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352728a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663418:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352728a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663423:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431566.663427:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352728a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663434:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352728a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663445:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431566.663448:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431566.663453:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352728a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663460:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352728a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663473:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663480:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527291 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663486:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663491:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431566.663494:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663500:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527291 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663506:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce07190800)
00010000:00010000:0.0:1789431566.663509:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431566.663511:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527291 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663517:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb63527291 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663545:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527283 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9051 expref: 200 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663558:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9051 expref: 199 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.663566:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:0.0:1789431566.663568:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431566.663570:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2000, rc 0)
00000100:00100000:0.0:1789431566.663619:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933555200:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 771us (963us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431566.663626:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296172
00000100:00100000:2.0:1789431566.671916:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.672189:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933555328
00000100:00100000:3.0:1789431566.672201:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933555328
00002000:00100000:3.0:1789431566.672265:0:14461:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x518:0x0] (0->4095)  req@ffff90cf37e94000 x1876351933555328/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/0 e 0 to 0 dl 1789431577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431566.672275:0:14461:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e94000 with x1876351933555328 ext(0->4095)
00002000:00010000:3.0:1789431566.672281:0:14461:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf37e94000
00000100:00100000:3.0:1789431566.672315:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1563
00000100:00100000:3.0:1789431566.672325:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2347:x1876351933555328:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:2.0:1789431566.673146:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2347:x1876351933555328:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 818us (1235us total) trans 4294970059 rc 0/0
00000100:00100000:2.0:1789431566.673155:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1563
00002000:00100000:2.0:1789431566.673164:0:14461:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x518:0x0] (0->4095)  req@ffff90cf37e94000 x1876351933555328/t4294970059(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/448 e 0 to 0 dl 1789431577 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431566.673173:0:14461:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e94000 with x1876351933555328 ext(0->4095)
00002000:00010000:2.0:1789431566.673177:0:14461:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf37e94000
00000100:00100000:3.0:1789431566.685536:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431566.685754:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933555712
00000100:00100000:1.0:1789431566.685764:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933555712
00000100:00100000:1.0:1789431566.685825:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8381
00000100:00100000:1.0:1789431566.685834:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2349:x1876351933555712:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:3.0:1789431566.692268:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431566.695899:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933555584
00000100:00100000:0.0:1789431566.695914:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933555584
00000100:00100000:0.0:1789431566.696116:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296173
00000100:00100000:0.0:1789431566.696128:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933555584:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431566.696150:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431566.696174:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352729f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9058 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.696285:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635272a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.696310:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527298 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9051 expref: 200 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.696319:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635272a6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.696352:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9051 expref: 200 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.696365:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527298 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9051 expref: 200 pid: 12181 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431566.696379:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894246528:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431566.696476:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1e8c9900 going to sleep for 11 seconds
00000100:00100000:3.0:1789431566.701924:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.701980:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894246528:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431566.702005:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635272a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431566.707228:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933555840
00000100:00100000:1.0:1789431566.707250:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933555840
00010000:00010000:1.0:1789431566.707308:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527298 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9051 expref: 201 pid: 12181 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431566.707352:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16645
00000100:00100000:1.0:1789431566.707362:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:2348:x1876351933555840:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431566.707376:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431566.707382:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527298 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9051 expref: 201 pid: 12181 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.707395:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9051 expref: 201 pid: 12181 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.707418:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527298 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9051 expref: 201 pid: 12181 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.707433:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:1.0:1789431566.707438:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635272a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.707447:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635272a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.707455:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635272a6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.707480:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431566.707533:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:2348:x1876351933555840:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 172us (5629us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431566.707541:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16645
00010000:00010000:3.0:1789431566.708117:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635272a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.708127:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635272a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431566.708147:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00010000:00010000:3.0:1789431566.708310:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352729f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9058 expref: 201 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.708328:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635272a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9058 expref: 200 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.708335:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431566.708339:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431566.708342:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2400, rc 0)
00000100:00100000:3.0:1789431566.708375:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14617:x1876351933555584:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12250us (16117us total) trans 4295121083 rc 0/0
00000100:00100000:3.0:1789431566.708383:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296173
00000100:00100000:1.0:1789431566.730232:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.730330:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933555968
00000100:00100000:3.0:1789431566.730341:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933555968
00000100:00100000:3.0:1789431566.730409:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296174
00000100:00100000:3.0:1789431566.730420:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14617:x1876351933555968:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431566.730443:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431566.730463:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635272b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c905f expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.730550:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635272bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.730565:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635272a6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9058 expref: 201 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.730586:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635272bb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.730621:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635272a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9058 expref: 201 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.730636:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635272a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9058 expref: 201 pid: 5848 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.730649:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce029f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894246656:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431566.730758:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf377c6780 going to sleep for 11 seconds
00000100:00100000:3.0:1789431566.744785:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.744824:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933556096
00000100:00100000:3.0:1789431566.744834:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933556096
00010000:00010000:3.0:1789431566.744872:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635272a6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9058 expref: 202 pid: 5848 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.744921:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16646
00000100:00100000:3.0:1789431566.744932:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:2348:x1876351933556096:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431566.744945:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431566.744952:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635272a6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9058 expref: 202 pid: 5848 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.744965:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635272a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9058 expref: 202 pid: 5848 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.744986:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431566.744992:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635272bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.745001:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635272bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.745010:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635272bb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.745030:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431566.745102:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:2348:x1876351933556096:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 171us (326us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431566.745113:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16646
00010000:00010000:1.0:1789431566.746155:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635272a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9058 expref: 201 pid: 5848 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431566.746174:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce029f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894246656:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431566.746194:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635272bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.746207:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635272bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.746213:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635272bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431566.746262:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:1.0:1789431566.746267:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431566.746583:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635272bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.746623:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635272b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c905f expref: 201 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.746640:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635272bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c905f expref: 200 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.746649:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:1.0:1789431566.746823:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431566.746827:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a000, rc 0)
00000100:00100000:1.0:1789431566.746959:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14617:x1876351933555968:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 16539us (16739us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431566.746967:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296174
00000100:00100000:3.0:1789431566.769557:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431566.769773:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933556224
00000100:00100000:0.0:1789431566.769783:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933556224
00000100:00100000:0.0:1789431566.769843:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296175
00000100:00100000:0.0:1789431566.769854:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14617:x1876351933556224:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431566.769874:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431566.769904:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635272c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9066 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.769970:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635272c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.769983:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635272c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.769994:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635272c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770007:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635272d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770013:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635272d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770019:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635272d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770277:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635272d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770420:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635272d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770431:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635272d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431566.770466:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000004:00200000:0.0:1789431566.770470:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431566.770488:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635272d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770500:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635272d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770508:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635272c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770515:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635272c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770521:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635272c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770528:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431566.770532:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635272c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770541:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635272c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770551:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431566.770554:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431566.770559:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635272c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770565:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635272c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770592:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635272d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770598:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635272d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770604:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635272d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770609:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431566.770612:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635272d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770618:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635272d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770625:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x7f7efb67 (ffff90ce07190800)
00010000:00010000:0.0:1789431566.770627:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431566.770631:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635272d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770636:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635272d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770795:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635272c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9066 expref: 202 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770811:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635272d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9066 expref: 201 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.770824:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:0.0:1789431566.770826:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431566.770829:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2e00, rc 0)
00000100:00100000:0.0:1789431566.771003:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:14617:x1876351933556224:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1150us (1453us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431566.771011:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296175
00000100:00100000:1.0:1789431566.779265:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2349:x1876351933555712:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 93421us (93727us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431566.779279:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8381
00000001:00080000:2.0:1789431566.780123:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970059 is committed
00000100:00100000:3.0:1789431566.785306:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.785527:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933556352
00000100:00100000:2.0:1789431566.785538:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933556352
00000100:00100000:2.0:1789431566.785666:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296176
00000100:00100000:2.0:1789431566.785677:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:14616:x1876351933556352:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431566.785698:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431566.785728:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635272de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c906d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.785795:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb635272e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.785809:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb635272e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.785821:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb635272e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.785835:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb635272ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.785843:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb635272ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.785850:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb635272ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786363:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb635272f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786378:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb635272f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786386:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb635272f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431566.786420:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:2.0:1789431566.786425:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431566.786443:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb635272f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786453:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb635272f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786460:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb635272e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786466:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb635272e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786472:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb635272e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786478:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431566.786482:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb635272e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786489:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb635272e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786500:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431566.786503:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431566.786508:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb635272e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786514:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb635272e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786526:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb635272ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786533:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb635272ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786538:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb635272ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786543:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431566.786545:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb635272ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786551:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb635272ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786558:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf13195a00)
00010000:00010000:2.0:1789431566.786561:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431566.786564:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb635272ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786570:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb635272ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786799:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb635272de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c906d expref: 203 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786814:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb635272f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c906d expref: 202 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.786821:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf18b78200)
00010000:00010000:2.0:1789431566.786824:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431566.786827:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce387a4e00, rc 0)
00000100:00100000:2.0:1789431566.786964:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:14616:x1876351933556352:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1287us (1667us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431566.786973:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296176
00000100:00100000:3.0:1789431566.792509:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431566.792739:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933556480
00000100:00100000:1.0:1789431566.792750:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933556480
00000100:00100000:1.0:1789431566.792862:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14363
00000100:00100000:1.0:1789431566.792873:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:2350:x1876351933556480:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431566.792961:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431566.792986:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb635272f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c906d expref: 202 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.793007:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf18b78200)
00010000:00010000:1.0:1789431566.793012:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431566.793229:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:2350:x1876351933556480:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 356us (727us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431566.793246:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14363
00000100:00100000:3.0:1789431566.799899:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.799944:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431566.800104:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933556864
00000100:00100000:0.0:1789431566.800113:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933556864
00000100:00100000:0.0:1789431566.800171:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933556992
00000100:00100000:0.0:1789431566.800175:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933556992
00000100:00100000:0.0:1789431566.800203:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296177
00000100:00100000:0.0:1789431566.800214:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:14616:x1876351933556864:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431566.800265:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431566.800292:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635271e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9020 expref: 202 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.800312:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf18b78200)
00010000:00010000:0.0:1789431566.800322:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431566.800366:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635272fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.800389:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635272fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.800399:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635272fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.800476:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296178
00000100:00100000:3.0:1789431566.800486:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:14617:x1876351933556992:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431566.800496:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431566.800507:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527301 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9074 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431566.800558:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004819c366 reply state 00000000d0ed6ff4 transno 4295121084 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635272fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431566.800568:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431566.800748:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527308 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.801000:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635272d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9066 expref: 204 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.801013:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527308 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.801080:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635272d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9066 expref: 204 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.801096:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635272d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9066 expref: 204 pid: 12181 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.801117:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894246784:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431566.801233:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf2ac35900 going to sleep for 11 seconds
00000100:00100000:0.0:1789431566.801452:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:14616:x1876351933556864:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1239us (1570us total) trans 4295121084 rc 0/0
00000100:00100000:0.0:1789431566.801460:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296177
00010000:00010000:0.0:1789431566.805459:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635272fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.805476:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635272fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.805484:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635272fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.805491:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431566.805496:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635272fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.805503:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635272fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.805520:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90ce07190800)
00010000:00010000:0.0:1789431566.805523:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431566.805528:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635272fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.805534:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635272fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.809635:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894246784:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431566.809664:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527308 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431566.809946:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431566.810016:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431566.810074:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933557248
00000100:00100000:1.0:1789431566.810084:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933557248
00010000:00010000:1.0:1789431566.810123:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635272d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9066 expref: 203 pid: 12181 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431566.810159:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16647
00000100:00100000:1.0:1789431566.810170:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:2349:x1876351933557248:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431566.810185:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431566.810192:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635272d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9066 expref: 203 pid: 12181 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.810205:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635272d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9066 expref: 203 pid: 12181 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.810230:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635272d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9066 expref: 203 pid: 12181 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.810247:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:1.0:1789431566.810252:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527308 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.810262:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527308 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.810271:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527308 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.810299:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431566.810394:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933557120
00000100:00100000:2.0:1789431566.810399:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933557120
00000100:00100000:2.0:1789431566.810429:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296179
00000100:00100000:2.0:1789431566.810436:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14616:x1876351933557120:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431566.810454:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431566.810469:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb6352730f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c907b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.810519:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb6352730f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c907b expref: 204 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.810531:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb6352730f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c907b expref: 204 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.810548:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431566.810550:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00010000:2.0:1789431566.810553:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce387a4a00, rc 0)
00010000:00010000:3.0:1789431566.811018:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527308 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.811029:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527308 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431566.811503:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00010000:00010000:3.0:1789431566.811654:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527301 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9074 expref: 206 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.811674:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527308 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9074 expref: 205 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.811681:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:3.0:1789431566.811684:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431566.811687:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7aa00, rc 0)
00000100:00100000:3.0:1789431566.811872:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14617:x1876351933556992:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11387us (11926us total) trans 4295121085 rc 0/0
00000100:00100000:2.0:1789431566.811880:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14616:x1876351933557120:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1439us (1930us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431566.811885:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296178
00000100:00100000:2.0:1789431566.811902:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296179
00000100:00100000:1.0:1789431566.811905:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:2349:x1876351933557248:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1350us (1500us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431566.811913:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16647
00000100:00100000:1.0:1789431566.820668:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.821095:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933557376
00000100:00100000:2.0:1789431566.821106:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933557376
00000100:00100000:2.0:1789431566.821215:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296180
00000100:00100000:2.0:1789431566.821227:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14617:x1876351933557376:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431566.821250:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431566.821272:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb6352731d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9082 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.821354:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63527324 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.821368:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527308 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9074 expref: 204 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.821377:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63527324 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.821411:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527308 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9074 expref: 204 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.821425:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527308 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9074 expref: 204 pid: 5849 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431566.821439:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894246912:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431566.821523:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3bffe3c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431566.822655:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.822865:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933557504
00000100:00100000:2.0:1789431566.822872:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933557504
00000100:00100000:2.0:1789431566.822962:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8382
00000100:00100000:2.0:1789431566.822973:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2348:x1876351933557504:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:2.0:1789431566.823267:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x518:0x0] updating lvb size from disk: 0 -> 83190
00002000:00010000:2.0:1789431566.823271:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x518:0x0] updating lvb mtime from disk: 0 -> 1789431554
00002000:00010000:2.0:1789431566.823273:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x518:0x0] updating lvb atime from disk: 0 -> 1789431555
00002000:00010000:2.0:1789431566.823276:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x518:0x0] updating lvb ctime from disk: 0 -> 1789431566
00002000:00010000:2.0:1789431566.823278:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x518:0x0] updating lvb blocks from disk: 1 -> 259
00000100:00100000:2.0:1789431566.823344:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2348:x1876351933557504:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 371us (693us total) trans 4294970060 rc 0/0
00000100:00100000:2.0:1789431566.823352:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8382
00000100:00100000:2.0:1789431566.828873:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894246912:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431566.828903:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63527324 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431566.831416:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.832289:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933557632
00000100:00100000:3.0:1789431566.832300:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933557632
00010000:00010000:3.0:1789431566.832338:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527308 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9074 expref: 205 pid: 5849 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.832387:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16648
00000100:00100000:3.0:1789431566.832397:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb04050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:2348:x1876351933557632:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431566.832412:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431566.832418:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527308 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9074 expref: 205 pid: 5849 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.832432:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527308 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9074 expref: 205 pid: 5849 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.832455:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527308 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9074 expref: 205 pid: 5849 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.832470:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:3.0:1789431566.832476:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63527324 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.832486:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63527324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.832495:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63527324 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.832529:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431566.832579:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb04050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:2348:x1876351933557632:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 183us (1171us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431566.832587:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16648
00000100:00100000:3.0:1789431566.833083:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431566.833389:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63527324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.833400:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63527324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431566.833443:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000004:00200000:2.0:1789431566.833447:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431566.833468:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63527324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.833502:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb6352731d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9082 expref: 204 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.833530:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63527324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9082 expref: 203 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.833538:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431566.833541:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431566.833545:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce387a5e00, rc 0)
00000100:00100000:2.0:1789431566.833591:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14617:x1876351933557376:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12367us (12932us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431566.833598:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296180
00000100:00100000:2.0:1789431566.833801:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933557888
00000100:00100000:2.0:1789431566.833808:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933557888
00000100:00100000:2.0:1789431566.834034:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296181
00000100:00100000:2.0:1789431566.834044:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14616:x1876351933557888:12345-192.168.203.4@tcp:55:dbench.0
00010000:00010000:2.0:1789431566.834127:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb6352732b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.834139:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb6352732b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.834148:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb6352732b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.834167:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb6352732b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.834177:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb6352732b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.834183:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb6352732b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.834188:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a4e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431566.834193:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb6352732b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.834200:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb6352732b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.834209:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431566.834211:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:2.0:1789431566.834215:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb6352732b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.834220:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb6352732b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431566.834256:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14616:x1876351933557888:12345-192.168.203.4@tcp:55:dbench.0 Request processed in 213us (1206us total) trans 0 rc -22/-22
00000100:00100000:2.0:1789431566.834264:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296181
00000100:00100000:1.0:1789431566.835506:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1789431566.835591:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1789431566.835622:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876351894247424:0@lo:400:kworker.0
00000100:00100000:2.0:1789431566.835689:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431566.835741:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876351894247296:0@lo:400:kworker.0
00000100:00100000:2.0:1789431566.835764:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431566.835781:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1789431566.835786:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876351894247168:0@lo:400:kworker.0
00000100:00100000:2.0:1789431566.835805:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431566.835831:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894247424
00000100:00100000:2.0:1789431566.835849:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894247424
00000100:00100000:2.0:1789431566.835898:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894247296
00000100:00100000:2.0:1789431566.835902:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894247296
00000100:00100000:2.0:1789431566.835921:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894247168
00000100:00100000:2.0:1789431566.835925:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894247168
00000100:00100000:2.0:1789431566.835940:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1714
00000100:00100000:2.0:1789431566.835947:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876351894247424:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789431566.835995:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876351894247424:12345-0@lo:400:kworker.0 Request processed in 47us (305us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431566.836002:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1714
00000100:00100000:2.0:1789431566.836015:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1715
00000100:00100000:2.0:1789431566.836021:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876351894247296:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789431566.836077:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876351894247296:12345-0@lo:400:kworker.0 Request processed in 56us (312us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431566.836083:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1715
00000100:00100000:2.0:1789431566.836095:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1716
00000100:00100000:2.0:1789431566.836101:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876351894247168:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789431566.836130:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876351894247168:12345-0@lo:400:kworker.0 Request processed in 31us (324us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431566.836135:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1716
00000100:00080000:2.0:1789431566.836150:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:2.0:1789431566.836177:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876351894247168:0@lo:400:kworker.0
00000100:00100000:2.0:1789431566.836186:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876351894247296:0@lo:400:kworker.0
00000100:00100000:2.0:1789431566.836212:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876351894247424:0@lo:400:kworker.0
00000100:00100000:1.0:1789431566.836802:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:366be534-ad36-4915-90c5-622719f64be8:3313:1876351894247040:0@lo:400:kworker.0
00000100:00100000:1.0:1789431566.839036:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431566.839418:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894247040
00000100:00100000:3.0:1789431566.839429:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894247040
00000100:00100000:3.0:1789431566.839810:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307
00000100:00100000:3.0:1789431566.839821:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2ad6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:366be534-ad36-4915-90c5-622719f64be8+19:3313:x1876351894247040:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789431566.839919:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2ad6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:366be534-ad36-4915-90c5-622719f64be8+19:3313:x1876351894247040:12345-0@lo:400:kworker.0 Request processed in 100us (889us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431566.839925:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307
00000100:00100000:2.0:1789431566.840002:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:366be534-ad36-4915-90c5-622719f64be8:3313:1876351894247040:0@lo:400:kworker.0
00000100:00100000:3.0:1789431566.849419:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431566.849524:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933558016
00000100:00100000:0.0:1789431566.849535:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933558016
00002000:00100000:0.0:1789431566.849588:0:14440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x518:0x0] (0->4095)  req@ffff90cf37e91c00 x1876351933558016/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/0 e 0 to 0 dl 1789431577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431566.849599:0:14440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e91c00 with x1876351933558016 ext(0->4095)
00002000:00010000:0.0:1789431566.849605:0:14440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf37e91c00
00000100:00100000:0.0:1789431566.849648:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1564
00000100:00100000:0.0:1789431566.849667:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2350:x1876351933558016:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:0.0:1789431566.850428:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2350:x1876351933558016:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 759us (1012us total) trans 4294970061 rc 0/0
00000100:00100000:0.0:1789431566.850438:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1564
00002000:00100000:0.0:1789431566.850445:0:14440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x518:0x0] (0->4095)  req@ffff90cf37e91c00 x1876351933558016/t4294970061(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:37/0 lens 4584/448 e 0 to 0 dl 1789431577 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431566.850453:0:14440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e91c00 with x1876351933558016 ext(0->4095)
00002000:00010000:0.0:1789431566.850458:0:14440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf37e91c00
00000100:00100000:3.0:1789431566.860362:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431566.861178:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933558272
00000100:00100000:1.0:1789431566.861188:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933558272
00000100:00100000:2.0:1789431566.861498:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12516
00000100:00100000:2.0:1789431566.861511:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14617:x1876351933558272:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431566.861803:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:14617:x1876351933558272:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 294us (1479us total) trans 4295121086 rc 0/0
00000100:00100000:2.0:1789431566.861810:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12516
00000100:00100000:1.0:1789431566.867420:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.867577:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933558400
00000100:00100000:2.0:1789431566.867587:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933558400
00000100:00100000:2.0:1789431566.867812:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296182
00000100:00100000:2.0:1789431566.867824:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:14616:x1876351933558400:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:3.0:1789431566.868257:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.870670:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:14616:x1876351933558400:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 2840us (3251us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431566.870683:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296182
00000100:00100000:2.0:1789431566.870722:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933558528
00000100:00100000:2.0:1789431566.870729:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933558528
00000100:00100000:2.0:1789431566.870775:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296183
00000100:00100000:2.0:1789431566.870784:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:14617:x1876351933558528:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431566.870799:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431566.870828:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63527332 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9089 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.870884:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63527339 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.870902:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63527339 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871105:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63527339 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871127:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63527340 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871134:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63527340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871141:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63527340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871373:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527347 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871383:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871391:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431566.871417:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa7:0x0]: returning size 85515
00000004:00200000:2.0:1789431566.871421:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431566.871437:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871448:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871460:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63527339 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871467:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63527339 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871473:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63527339 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871479:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce387a5400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431566.871483:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63527339 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871490:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63527339 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871501:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431566.871504:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431566.871509:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63527339 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871515:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5400/0xd8e438fb63527339 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871525:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63527340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871531:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63527340 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871536:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63527340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871542:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf42157200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431566.871545:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63527340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871551:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63527340 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871557:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x7f7efb67 (ffff90cf13195600)
00010000:00010000:2.0:1789431566.871560:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431566.871562:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63527340 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871568:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf42157200/0xd8e438fb63527340 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871597:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4e00/0xd8e438fb63527332 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9089 expref: 206 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871608:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527347 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9089 expref: 205 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.871615:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431566.871618:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431566.871620:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522c00, rc 0)
00000100:00100000:2.0:1789431566.871653:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14617:x1876351933558528:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 870us (3398us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431566.871659:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296183
00000100:00100000:1.0:1789431566.881156:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.881255:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933558656
00000100:00100000:2.0:1789431566.881266:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933558656
00000100:00100000:2.0:1789431566.881317:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8383
00000100:00100000:2.0:1789431566.881327:0:14482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2349:x1876351933558656:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:3.0:1789431566.891428:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.891486:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.891517:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933558784
00000100:00100000:3.0:1789431566.891528:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933558784
00000100:00100000:3.0:1789431566.891585:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14364
00000100:00100000:3.0:1789431566.891596:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:2347:x1876351933558784:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431566.891610:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431566.891634:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527347 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9089 expref: 205 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.891652:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:3.0:1789431566.891658:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431566.893091:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933559040
00000100:00100000:0.0:1789431566.893103:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933559040
00000100:00100000:0.0:1789431566.893156:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296184
00000100:00100000:0.0:1789431566.893165:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14617:x1876351933559040:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431566.893214:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:0.0:1789431566.893248:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5e00/0xd8e438fb63527324 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9082 expref: 205 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.893271:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a5200/0xd8e438fb63526b59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aa7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e28 expref: 204 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.893281:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90cf13195700)
00010000:00010000:0.0:1789431566.893292:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431566.893312:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb6352734e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.893325:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb6352734e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.893334:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb6352734e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.893348:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527355 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.893356:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.893362:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.893576:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352735c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.893585:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352735c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.893591:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352735c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.894164:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:2347:x1876351933558784:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 2565us (2740us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431566.894178:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14364
00000040:00080000:0.0:1789431566.898015:0:12775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1246, 64 off88000
00000004:00080000:0.0:1789431566.898028:0:12775:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3024928978916ns, next at 3025928976221ns, rc = 0
00010000:00010000:0.0:1789431566.898129:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527363 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898146:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527363 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898158:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527363 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898167:0:12775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527363 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898172:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527363 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898178:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527363 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898194:0:12775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431566.898219:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352735c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898225:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352735c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898231:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352735c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898237:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431566.898241:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352735c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898249:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352735c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898260:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90ce07190500)
00010000:00010000:0.0:1789431566.898263:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431566.898267:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352735c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898273:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb6352735c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898291:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb6352734e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898297:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb6352734e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898303:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb6352734e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898307:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431566.898310:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb6352734e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898317:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb6352734e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898324:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431566.898327:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431566.898331:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb6352734e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.898336:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb6352734e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431566.898346:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004f322508 reply state 00000000b17d62f6 transno 4295121087 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431566.898356:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431566.898445:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:14617:x1876351933559040:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 5278us (6955us total) trans 4295121087 rc 0/0
00000100:00100000:0.0:1789431566.898453:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296184
00010000:00010000:3.0:1789431566.898901:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431566.898909:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527363 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.898917:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2e00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431566.898920:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527363 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.898927:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527363 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.898937:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa7:0x0].0x0 (ffff90ce07190500)
00010000:00010000:3.0:1789431566.898939:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431566.898943:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527363 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.898948:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527363 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aa7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.898964:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431566.898966:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431566.898968:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431566.907764:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.907783:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527355 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.907791:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527355 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.907799:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431566.907805:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527355 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.907813:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527355 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.907830:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x7f7efb67 (ffff90ce07190800)
00010000:00010000:3.0:1789431566.907834:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431566.907839:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527355 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.907845:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527355 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.920978:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431566.924576:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933559168
00000100:00100000:0.0:1789431566.924591:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933559168
00000100:00100000:0.0:1789431566.924652:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296185
00000100:00100000:0.0:1789431566.924664:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14617:x1876351933559168:12345-192.168.203.4@tcp:41:dbench.0
00000004:00000024:0.0:1789431566.924869:0:6797:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7643070464 avail 7560232960
00000100:00100000:0.0:1789431566.925502:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14617:x1876351933559168:12345-192.168.203.4@tcp:41:dbench.0 Request processed in 837us (4530us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431566.925511:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296185
00000001:00080000:3.0:1789431566.932114:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970061 is committed
00000100:00100000:1.0:1789431566.935876:0:14482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2349:x1876351933558656:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 50954us (51132us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431566.935901:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8383
00000100:00100000:3.0:1789431566.939025:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.939327:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933559296
00000100:00100000:2.0:1789431566.939337:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933559296
00000100:00100000:2.0:1789431566.939396:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296186
00000100:00100000:2.0:1789431566.939406:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14617:x1876351933559296:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431566.939425:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431566.939446:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352736a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9090 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.939510:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb63527371 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.939525:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb63527371 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.939537:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb63527371 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.939552:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527378 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xf4ed591 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.939559:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527378 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.939565:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527378 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431566.940077:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431566.940415:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352737f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.940427:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352737f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.940436:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352737f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431566.940468:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10092:0x0]: returning size 260096
00000004:00200000:2.0:1789431566.940472:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431566.940489:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352737f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.940489:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933559552
00000100:00100000:3.0:1789431566.940497:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933559552
00010000:00010000:2.0:1789431566.940502:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352737f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.940511:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb63527371 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.940516:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb63527371 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.940523:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb63527371 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.940528:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431566.940533:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb63527371 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.940541:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb63527371 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.940542:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12517
00000100:00100000:3.0:1789431566.940555:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14616:x1876351933559552:12345-192.168.203.4@tcp:35:dbench.0
00010000:00010000:2.0:1789431566.940557:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431566.940562:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431566.940567:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb63527371 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.940573:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb63527371 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.940587:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527378 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.940594:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527378 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.940599:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527378 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.940604:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431566.940607:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527378 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.940613:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527378 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.940619:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xf4ed591 (ffff90cf13195600)
00010000:00010000:2.0:1789431566.940621:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431566.940624:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527378 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.940629:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527378 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.940671:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352736a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9090 expref: 206 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.940686:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352737f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9090 expref: 205 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.940694:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10092:0x0].0x0 (ffff90ce24af1a00)
00010000:00010000:2.0:1789431566.940696:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431566.940698:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522400, rc 0)
00000100:00100000:3.0:1789431566.941605:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14616:x1876351933559552:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 1046us (1523us total) trans 4295121088 rc 0/0
00000100:00100000:3.0:1789431566.941615:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12517
00000100:00100000:2.0:1789431566.941639:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14617:x1876351933559296:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2231us (2620us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431566.941656:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296186
00000100:00100000:3.0:1789431566.951071:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431566.951689:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933559808
00000100:00100000:1.0:1789431566.951699:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933559808
00000100:00100000:1.0:1789431566.951773:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296187
00000100:00100000:1.0:1789431566.951785:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14617:x1876351933559808:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431566.951803:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431566.951822:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527386 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9097 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.951916:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.951930:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635118ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c26da expref: 206 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.951938:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352737f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9090 expref: 206 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.951946:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 5/0,1 mode: --/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.951978:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352737f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9090 expref: 206 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.951992:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352737f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9090 expref: 206 pid: 5847 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431566.952004:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894247552:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431566.952132:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635118ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c26da expref: 206 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.952147:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635118ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c26da expref: 206 pid: 5848 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431566.952155:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894247680:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431566.952179:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf22256a80 going to sleep for 11 seconds
00000100:00100000:0.0:1789431566.954497:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431566.954542:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431566.954719:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933559936
00000100:00100000:1.0:1789431566.954728:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933559936
00000100:00100000:2.0:1789431566.954760:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933560064
00000100:00100000:2.0:1789431566.954767:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933560064
00000100:00100000:1.0:1789431566.954784:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296188
00010000:00010000:2.0:1789431566.954797:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352737f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9090 expref: 208 pid: 5847 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431566.954798:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14616:x1876351933559936:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431566.954823:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00000100:00100000:2.0:1789431566.954832:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16649
00000100:00100000:2.0:1789431566.954843:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:2350:x1876351933560064:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431566.954844:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527394 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c909e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.954858:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431566.954866:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352737f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9090 expref: 209 pid: 5847 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.954904:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352739b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.954917:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352739b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.954929:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352739b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.954942:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635273a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.954949:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635273a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.954959:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635273a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955384:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635273a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955395:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635273a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955403:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635273a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431566.955436:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:0.0:1789431566.955440:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431566.955456:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635273a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955467:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635273a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955475:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352739b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955481:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352739b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955487:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352739b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955493:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431566.955497:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352739b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955505:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352739b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955516:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431566.955519:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431566.955524:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352739b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955530:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352739b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955544:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635273a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955550:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635273a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955555:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635273a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955560:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431566.955563:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635273a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955568:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635273a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955574:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce03149300)
00010000:00010000:0.0:1789431566.955576:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431566.955578:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635273a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955583:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635273a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955623:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527394 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c909e expref: 210 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955636:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635273a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c909e expref: 209 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.955649:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:0.0:1789431566.955652:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431566.955654:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2800, rc 0)
00000100:00100000:0.0:1789431566.955955:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:14616:x1876351933559936:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1161us (1465us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431566.955964:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296188
00010000:00010000:2.0:1789431566.958598:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352737f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9090 expref: 208 pid: 5847 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.958628:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10092:0x0].0x0 (ffff90ce24af1a00)
00010000:00010000:2.0:1789431566.958634:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.958644:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.958660:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431566.958727:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:2350:x1876351933560064:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 3885us (4182us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431566.958736:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16649
00010000:00010000:0.0:1789431566.958917:0:12181:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@00000000f03cc97c x1876351894247552) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352737f lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9090 expref: 207 pid: 5847 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.958936:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352737f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9090 expref: 207 pid: 5847 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431566.958953:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894247552:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431566.958967:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894247680:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431566.959003:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10092:0x0].0x0 (ffff90ce24af1a00)
00010000:00010000:0.0:1789431566.959007:0:12181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.959014:0:12181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.959024:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.960672:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.960986:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933560192
00000100:00100000:2.0:1789431566.960996:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933560192
00010000:00010000:2.0:1789431566.961036:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635118ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c26da expref: 207 pid: 5848 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431566.961290:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16650
00000100:00100000:2.0:1789431566.961508:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:2348:x1876351933560192:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431566.961529:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431566.961538:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635118ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c26da expref: 207 pid: 5848 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.961553:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635118ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c26da expref: 207 pid: 5848 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.961575:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635118ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c26da expref: 207 pid: 5848 timeout: 3124 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.961590:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10092:0x0].0x0 (ffff90ce24af1a00)
00010000:00010000:2.0:1789431566.961596:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.961607:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.961615:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.961697:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431566.961773:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2348:x1876351933560192:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 473us (1109us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431566.961781:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16650
00010000:00010000:0.0:1789431566.965751:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.965768:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431566.965794:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10092:0x0]: returning size 260096
00010000:00010000:0.0:1789431566.966112:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527386 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9097 expref: 207 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.966136:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9097 expref: 206 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.966156:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10092:0x0].0x0 (ffff90ce24af1a00)
00010000:00010000:0.0:1789431566.966159:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431566.966163:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:0.0:1789431566.966228:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14617:x1876351933559808:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 14446us (15186us total) trans 4295121089 rc 0/0
00000100:00100000:0.0:1789431566.966236:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296187
00000100:00100000:3.0:1789431566.970503:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431566.970542:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933560448
00000100:00100000:1.0:1789431566.970553:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933560448
00000100:00100000:1.0:1789431566.970622:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296189
00000100:00100000:1.0:1789431566.970633:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14616:x1876351933560448:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431566.970653:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431566.970678:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635273b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c90a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.970789:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635273be lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.970805:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635273a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c909e expref: 207 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.970814:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635273be lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.970847:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635273a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c909e expref: 207 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.970861:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635273a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c909e expref: 207 pid: 5848 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431566.970890:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894247808:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431566.970970:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf22256a80 going to sleep for 11 seconds
00000100:00100000:3.0:1789431566.977101:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431566.977149:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933560576
00000100:00100000:0.0:1789431566.977161:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933560576
00000100:00100000:0.0:1789431566.977223:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296190
00000100:00100000:0.0:1789431566.977234:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14617:x1876351933560576:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431566.977257:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431566.977276:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635273c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10092:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c90ac expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.977370:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635273cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.977390:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9097 expref: 209 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.977398:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635273cc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.977432:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9097 expref: 209 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.977444:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9097 expref: 209 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431566.977458:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba1a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894247936:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431566.977544:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba39b40 going to sleep for 11 seconds
00000100:00100000:1.0:1789431566.977690:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894247808:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431566.977719:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635273be lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.978565:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431566.978638:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933560704
00000100:00100000:2.0:1789431566.978646:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933560704
00010000:00010000:2.0:1789431566.978752:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635273a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c909e expref: 210 pid: 5848 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431566.978824:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16651
00000100:00100000:2.0:1789431566.978834:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:2350:x1876351933560704:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431566.978846:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431566.978864:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635273a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c909e expref: 210 pid: 5848 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.978882:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635273a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c909e expref: 210 pid: 5848 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.978903:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635273a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c909e expref: 210 pid: 5848 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.978922:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431566.978927:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635273be lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.978936:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635273be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.978943:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635273be lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.978973:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431566.979020:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:2350:x1876351933560704:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 188us (460us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431566.979027:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16651
00010000:00010000:1.0:1789431566.979194:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635273be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.979203:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635273be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431566.979221:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00010000:00010000:1.0:1789431566.979379:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635273b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90a5 expref: 210 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.979397:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635273be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90a5 expref: 209 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431566.979404:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:1.0:1789431566.979407:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431566.979409:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309600, rc 0)
00000100:00100000:1.0:1789431566.979448:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:14616:x1876351933560448:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8818us (8958us total) trans 4295121090 rc 0/0
00000100:00100000:1.0:1789431566.979455:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296189
00000100:00100000:0.0:1789431566.982264:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba1a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894247936:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431566.982305:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635273cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431566.985730:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431566.985898:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933560832
00000100:00100000:3.0:1789431566.985908:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933560832
00010000:00010000:3.0:1789431566.985945:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9097 expref: 209 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431566.985987:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16652
00000100:00100000:3.0:1789431566.985997:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:2347:x1876351933560832:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431566.986011:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431566.986018:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9097 expref: 209 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.986030:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9097 expref: 209 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.986088:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352738d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10092:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9097 expref: 209 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.986104:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10092:0x0].0x0 (ffff90ce24af1a00)
00010000:00010000:3.0:1789431566.986109:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635273cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.986119:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635273cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.986127:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635273cc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431566.986159:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431566.986213:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:2347:x1876351933560832:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 219us (492us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431566.986220:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16652
00010000:00010000:2.0:1789431566.986257:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635273cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.986268:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635273cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431566.986321:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10092:0x0]: returning size 260096
00000004:00200000:2.0:1789431566.986326:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431566.986345:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635273cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.986375:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635273c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10092:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90ac expref: 208 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.986391:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2400/0xd8e438fb635273cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10092:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90ac expref: 207 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431566.986399:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10092:0x0].0x0 (ffff90ce24af1a00)
00010000:00010000:2.0:1789431566.986402:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431566.986404:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2400, rc 0)
00000100:00100000:2.0:1789431566.986431:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14617:x1876351933560576:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9200us (9340us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431566.986439:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296190
00000100:00100000:3.0:1789431566.990152:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431566.990231:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933560960
00000100:00100000:0.0:1789431566.990250:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933560960
00000100:00100000:0.0:1789431566.990767:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296191
00000100:00100000:0.0:1789431566.990779:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14616:x1876351933560960:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431566.990804:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431566.990825:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635273da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c90b3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.990909:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635273e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.990924:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635273be lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90a5 expref: 208 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.990933:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635273e1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.990965:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635273be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90a5 expref: 208 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431566.990979:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635273be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90a5 expref: 208 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431566.990992:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894248064:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431566.991157:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba39840 going to sleep for 11 seconds
00000100:00100000:1.0:1789431567.002816:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.002898:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.003129:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933561216
00000100:00100000:2.0:1789431567.003138:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933561216
00000100:00100000:2.0:1789431567.003196:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12518
00000100:00100000:2.0:1789431567.003206:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:14617:x1876351933561216:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431567.003449:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:14617:x1876351933561216:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 244us (641us total) trans 4295121091 rc 0/0
00000100:00100000:2.0:1789431567.003456:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12518
00000100:00100000:3.0:1789431567.003810:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933561344
00000100:00100000:3.0:1789431567.003815:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933561344
00010000:00010000:3.0:1789431567.003840:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635273be lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90a5 expref: 210 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.003875:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16653
00000100:00100000:3.0:1789431567.003883:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:2348:x1876351933561344:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431567.003893:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431567.003899:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635273be lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90a5 expref: 210 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.003912:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635273be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90a5 expref: 210 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.003932:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:3.0:1789431567.003938:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635273e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.003947:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635273e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.003954:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635273e1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.003973:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431567.003994:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:2348:x1876351933561344:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 113us (1097us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431567.004001:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16653
00010000:00010000:0.0:1789431567.004337:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635273be lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90a5 expref: 209 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.004362:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894248064:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431567.004383:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635273e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.004392:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635273e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.004401:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635273e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431567.004437:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:0.0:1789431567.004442:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431567.004458:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635273e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.004483:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635273da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90b3 expref: 209 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.004499:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635273e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90b3 expref: 208 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.004506:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:0.0:1789431567.004509:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431567.004512:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3c00, rc 0)
00000100:00100000:0.0:1789431567.004549:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14616:x1876351933560960:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 13773us (14407us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431567.004556:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296191
00000100:00100000:1.0:1789431567.011462:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.011667:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933561472
00000100:00100000:2.0:1789431567.011677:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933561472
00000100:00100000:2.0:1789431567.011745:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296192
00000100:00100000:2.0:1789431567.011756:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14617:x1876351933561472:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431567.011778:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431567.011797:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635273e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c90ba expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.011860:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635273ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.011872:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635273ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.011883:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635273ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.011896:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635273f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.011903:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635273f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.011908:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635273f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.011998:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635273fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012007:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635273fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012013:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635273fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431567.012044:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:2.0:1789431567.012643:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431567.012681:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635273fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012695:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635273fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012713:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635273ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012723:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635273ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012730:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635273ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012736:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431567.012740:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635273ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012747:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635273ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012758:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431567.012761:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431567.012766:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635273ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012772:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635273ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012784:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635273f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012790:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635273f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012794:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635273f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012798:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431567.012801:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635273f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012806:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635273f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012812:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90cf13195600)
00010000:00010000:2.0:1789431567.012814:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431567.012817:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635273f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012823:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635273f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012854:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635273e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90ba expref: 210 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012867:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635273fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90ba expref: 209 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.012875:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:2.0:1789431567.012877:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431567.012880:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523600, rc 0)
00000100:00100000:2.0:1789431567.014544:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:14617:x1876351933561472:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2781us (3082us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.014555:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296192
00000100:00100000:3.0:1789431567.027381:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.027432:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.027606:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933561856
00000100:00100000:2.0:1789431567.027616:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933561856
00000100:00100000:2.0:1789431567.027688:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14365
00000100:00100000:2.0:1789431567.027698:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb06450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:2350:x1876351933561856:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431567.027723:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431567.027746:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635273fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90ba expref: 209 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.027764:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:2.0:1789431567.027769:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431567.027829:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb06450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:2350:x1876351933561856:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 133us (395us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.027836:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14365
00000100:00100000:1.0:1789431567.028291:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933561728
00000100:00100000:1.0:1789431567.028298:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933561728
00000100:00100000:1.0:1789431567.028331:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296193
00000100:00100000:1.0:1789431567.028340:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14617:x1876351933561728:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.028368:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.028384:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527404 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c90c1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.028479:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352740b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.028492:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635272bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c905f expref: 209 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.028501:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352740b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.028531:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635272bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c905f expref: 209 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.028544:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635272bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c905f expref: 209 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.028557:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894248192:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431567.028623:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf22256e40 going to sleep for 11 seconds
00000100:00100000:3.0:1789431567.033868:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.034002:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933561984
00000100:00100000:1.0:1789431567.034012:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933561984
00000100:00100000:1.0:1789431567.034097:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296194
00000100:00100000:1.0:1789431567.034108:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:14616:x1876351933561984:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.034132:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.034154:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527412 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c90c8 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.034665:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527419 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.034683:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.034694:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.034718:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527420 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.034726:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.034733:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.034954:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527427 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.034963:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.034970:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431567.035002:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:1.0:1789431567.035007:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431567.035025:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.035035:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.035042:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.035077:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527419 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.035084:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527419 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.035090:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.035094:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527419 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.035101:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527419 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.035113:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431567.035115:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.035120:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527419 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.035126:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527419 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.035138:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.035149:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527420 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.035155:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.035159:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.035162:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.035168:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527420 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.035174:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce03149500)
00010000:00010000:1.0:1789431567.035176:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.035179:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527420 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.035183:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527420 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.035212:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527412 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90c8 expref: 212 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.035225:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90c8 expref: 211 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.035232:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:1.0:1789431567.035234:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431567.035237:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309e00, rc 0)
00000100:00100000:1.0:1789431567.037025:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:14616:x1876351933561984:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2910us (3158us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.037037:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296194
00000100:00100000:1.0:1789431567.040732:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894248192:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431567.040761:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352740b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.044034:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.044110:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933562112
00000100:00100000:2.0:1789431567.044121:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933562112
00010000:00010000:2.0:1789431567.044160:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635272bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c905f expref: 211 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.044170:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.044210:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933562240
00000100:00100000:2.0:1789431567.044213:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933562240
00000100:00100000:2.0:1789431567.044243:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16654
00000100:00100000:2.0:1789431567.044253:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:2347:x1876351933562112:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431567.044269:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431567.044275:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635272bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c905f expref: 212 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.044455:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635272bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c905f expref: 212 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.044479:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635272bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c905f expref: 212 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.044499:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:2.0:1789431567.044505:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352740b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.044513:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352740b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.044521:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352740b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.044543:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431567.044827:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14366
00000100:00100000:3.0:1789431567.044838:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:2348:x1876351933562240:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431567.044847:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431567.044861:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527427 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90c8 expref: 211 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.044872:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:3.0:1789431567.044876:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431567.044902:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:2348:x1876351933562240:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 67us (735us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431567.044909:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14366
00000100:00100000:2.0:1789431567.044955:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:2347:x1876351933562112:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 704us (929us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.044961:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16654
00010000:00010000:1.0:1789431567.045029:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352740b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.045037:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352740b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431567.045080:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00010000:00010000:1.0:1789431567.045216:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527404 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90c1 expref: 210 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.045231:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352740b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90c1 expref: 209 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.045237:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:1.0:1789431567.045240:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431567.045243:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309600, rc 0)
00000100:00100000:1.0:1789431567.045269:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:14617:x1876351933561728:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 16931us (17899us total) trans 4295121092 rc 0/0
00000100:00100000:1.0:1789431567.045277:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296193
00000100:00100000:3.0:1789431567.053225:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.053474:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933562496
00000100:00100000:1.0:1789431567.053486:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933562496
00000100:00100000:1.0:1789431567.053542:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296195
00000100:00100000:1.0:1789431567.053552:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:14616:x1876351933562496:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431567.053614:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431567.053638:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635273e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90b3 expref: 209 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.054517:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:1.0:1789431567.054527:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431567.054581:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527435 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.054597:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527435 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.054610:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527435 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431567.054773:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008436b308 reply state 0000000034604229 transno 4295121093 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527435 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.054784:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431567.054892:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:14616:x1876351933562496:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1339us (1674us total) trans 4295121093 rc 0/0
00000100:00100000:1.0:1789431567.054900:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296195
00000100:00100000:3.0:1789431567.055727:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.055781:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933562624
00000100:00100000:2.0:1789431567.055789:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933562624
00000100:00100000:2.0:1789431567.055835:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296196
00000100:00100000:2.0:1789431567.055844:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:14617:x1876351933562624:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431567.055862:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431567.055877:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352743c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c90cf expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.055948:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527443 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.055960:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352740b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90c1 expref: 211 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.055972:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527443 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.056003:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352740b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90c1 expref: 211 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.056016:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352740b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90c1 expref: 211 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.056028:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894248320:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431567.060233:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead780 going to sleep for 11 seconds
00000100:00100000:1.0:1789431567.072598:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.072737:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933562752
00000100:00100000:3.0:1789431567.072747:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933562752
00000100:00100000:3.0:1789431567.072803:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8384
00000100:00100000:3.0:1789431567.072812:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2348:x1876351933562752:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:3.0:1789431567.073038:0:14469:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x518:0x0] updating lvb size from disk: 83190 -> 83190
00002000:00010000:3.0:1789431567.073041:0:14469:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x518:0x0] updating lvb mtime from disk: 1789431554 -> 1789431554
00002000:00010000:3.0:1789431567.073044:0:14469:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x518:0x0] updating lvb atime from disk: 1789431555 -> 1789431545
00002000:00010000:3.0:1789431567.073067:0:14469:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x518:0x0] updating lvb ctime from disk: 1789431566 -> 1789431566
00002000:00010000:3.0:1789431567.073070:0:14469:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x518:0x0] updating lvb blocks from disk: 259 -> 259
00000100:00100000:3.0:1789431567.073119:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2348:x1876351933562752:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 308us (529us total) trans 4294970062 rc 0/0
00000100:00100000:3.0:1789431567.073127:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8384
00000100:00100000:3.0:1789431567.075544:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894248320:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431567.075645:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527443 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.075715:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527435 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.075725:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527435 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.075733:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527435 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.075738:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431567.075742:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527435 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.075750:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527435 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.075766:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431567.075770:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431567.075774:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527435 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.075781:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527435 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.076696:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.076770:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933562880
00000100:00100000:2.0:1789431567.076778:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933562880
00010000:00010000:2.0:1789431567.076813:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352740b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90c1 expref: 211 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.076852:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16655
00000100:00100000:2.0:1789431567.076862:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:2347:x1876351933562880:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431567.076876:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431567.076884:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352740b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90c1 expref: 211 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.076895:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352740b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90c1 expref: 211 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.076914:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb6352740b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90c1 expref: 211 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.076927:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:2.0:1789431567.076931:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527443 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.076942:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.076950:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527443 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.077024:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431567.077101:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:2347:x1876351933562880:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 241us (410us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.077109:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16655
00010000:00010000:3.0:1789431567.081212:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.081230:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431567.082498:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:2.0:1789431567.082506:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431567.082539:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.082651:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352743c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90cf expref: 210 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.082674:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90cf expref: 209 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.082683:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:2.0:1789431567.082686:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431567.082689:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522800, rc 0)
00000100:00100000:2.0:1789431567.082774:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:14617:x1876351933562624:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 26931us (27049us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.082783:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296196
00000100:00100000:3.0:1789431567.086723:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.086996:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933563136
00000100:00100000:2.0:1789431567.087006:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933563136
00000100:00100000:2.0:1789431567.087090:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12519
00000100:00100000:2.0:1789431567.087102:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:14616:x1876351933563136:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431567.087339:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:14616:x1876351933563136:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 239us (635us total) trans 4295121094 rc 0/0
00000100:00100000:2.0:1789431567.087346:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12519
00000100:00100000:3.0:1789431567.100043:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.100124:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.100278:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933563520
00000100:00100000:2.0:1789431567.100299:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933563520
00000100:00100000:2.0:1789431567.100368:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12520
00000100:00100000:2.0:1789431567.100378:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:14617:x1876351933563520:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431567.100620:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:14617:x1876351933563520:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 242us (585us total) trans 4295121095 rc 0/0
00000100:00100000:2.0:1789431567.100629:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12520
00000100:00100000:1.0:1789431567.104709:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933563264
00000100:00100000:1.0:1789431567.104725:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933563264
00000100:00100000:3.0:1789431567.107666:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.107836:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933563648
00000100:00100000:1.0:1789431567.107847:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933563648
00000100:00100000:1.0:1789431567.107916:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296197
00000100:00100000:1.0:1789431567.107926:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14617:x1876351933563648:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.107945:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.107965:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352744a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c90dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108026:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527451 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.108028:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296198
00000100:00100000:0.0:1789431567.108041:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14616:x1876351933563264:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.108043:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527451 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108080:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.108081:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527451 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108094:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527458 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c90d6 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108100:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352745f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108111:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352745f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108117:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352745f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108143:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527466 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108155:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527466 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108164:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527466 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108181:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352746d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108189:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352746d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108195:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352746d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108223:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527474 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108247:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108255:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431567.108290:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:1.0:1789431567.108295:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431567.108312:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108335:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108344:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527451 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108351:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527451 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108358:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527451 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108364:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.108369:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527451 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108377:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527451 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108388:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431567.108392:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.108397:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527451 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108404:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527451 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108413:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352747b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108421:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352745f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108424:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352747b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108436:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352745f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108440:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352747b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108446:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352745f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108454:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.108456:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352745f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108462:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352745f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431567.108464:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:0.0:1789431567.108470:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00010000:00010000:1.0:1789431567.108474:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce03149500)
00010000:00010000:1.0:1789431567.108478:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.108482:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352745f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431567.108483:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352747b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108497:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352745f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108500:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352747b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108517:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527466 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108524:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527466 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108530:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527466 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108534:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352744a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90dd expref: 215 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108538:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431567.108544:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527466 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108553:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527466 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.108555:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527474 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90dd expref: 214 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108563:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431567.108566:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.108569:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527466 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108575:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527466 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108586:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352746d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108591:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352746d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108597:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352746d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108602:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431567.108605:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352746d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108611:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352746d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108618:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce07190b00)
00010000:00010000:0.0:1789431567.108620:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.108623:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352746d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108628:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352746d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108652:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527458 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90d6 expref: 215 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108663:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352747b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90d6 expref: 214 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.108670:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:0.0:1789431567.108672:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431567.108675:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2e00, rc 0)
00010000:00010000:1.0:1789431567.108693:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:1.0:1789431567.108695:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431567.108698:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:0.0:1789431567.108762:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:14616:x1876351933563264:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 723us (8635us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431567.108771:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296198
00000100:00100000:1.0:1789431567.110792:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14617:x1876351933563648:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2859us (3126us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.110803:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296197
00000100:00100000:2.0:1789431567.126864:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.127294:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933563776
00000100:00100000:3.0:1789431567.127306:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933563776
00000100:00100000:3.0:1789431567.127388:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14367
00000100:00100000:3.0:1789431567.127399:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:2350:x1876351933563776:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431567.127414:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431567.127441:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527474 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90dd expref: 213 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.127458:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431567.127464:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431567.127525:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:2350:x1876351933563776:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 129us (671us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431567.127532:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14367
00000100:00100000:3.0:1789431567.132317:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.132375:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.132525:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933564032
00000100:00100000:2.0:1789431567.132542:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933564032
00000100:00100000:1.0:1789431567.132571:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933564288
00000100:00100000:1.0:1789431567.132577:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933564288
00000100:00100000:2.0:1789431567.132616:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296199
00000100:00100000:2.0:1789431567.132628:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14617:x1876351933564032:12345-192.168.203.4@tcp:101:dbench.0
00000100:00100000:1.0:1789431567.132636:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296200
00000100:00100000:1.0:1789431567.132646:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14616:x1876351933564288:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431567.132651:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.132655:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.132676:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527489 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c90eb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.132677:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63527482 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c90e4 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.132800:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527497 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.132800:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527490 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.132827:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352747b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90d6 expref: 215 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.132828:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527443 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90cf expref: 215 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.132850:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527497 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.132851:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527490 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.132896:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352747b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90d6 expref: 215 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.132897:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90cf expref: 215 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.132923:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352747b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90d6 expref: 215 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.132924:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527443 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90cf expref: 215 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.132953:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894248448:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431567.132954:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894248576:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431567.133568:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead3c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431567.133861:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1e8c93c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431567.144997:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.145098:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933564416
00000100:00100000:2.0:1789431567.145109:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933564416
00010000:00010000:2.0:1789431567.145148:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527443 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90cf expref: 216 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.145190:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16656
00000100:00100000:2.0:1789431567.145199:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:2347:x1876351933564416:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431567.145213:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431567.145220:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527443 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90cf expref: 216 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.145239:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527443 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90cf expref: 216 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.145261:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:2.0:1789431567.145267:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527490 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.145276:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527490 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.145285:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527490 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.145288:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527443 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90cf expref: 216 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.145308:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894248576:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431567.145328:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527490 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.145338:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527490 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.145567:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527490 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431567.145587:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00010000:00010000:3.0:1789431567.145744:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63527482 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90e4 expref: 217 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.145761:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527490 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90e4 expref: 216 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.145769:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431567.145772:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431567.145774:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523a00, rc 0)
00010000:00010000:2.0:1789431567.145875:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431567.145878:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14617:x1876351933564032:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 13252us (13569us total) trans 4295121096 rc 0/0
00000100:00100000:3.0:1789431567.145887:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296199
00000100:00100000:2.0:1789431567.145904:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:2347:x1876351933564416:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 704us (914us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.145912:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16656
00000100:00100000:2.0:1789431567.147557:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894248448:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431567.147582:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527497 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.154940:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.155390:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933564672
00000100:00100000:2.0:1789431567.155401:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933564672
00000100:00100000:2.0:1789431567.155462:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296201
00000100:00100000:2.0:1789431567.155472:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14617:x1876351933564672:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431567.155494:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431567.155515:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635274a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c90f2 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.155596:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635274ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.155611:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527490 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90e4 expref: 216 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.155621:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635274ac lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.155667:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527490 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90e4 expref: 216 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.155681:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527490 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90e4 expref: 216 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.155694:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e97800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894248704:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431567.155787:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05eadc00 going to sleep for 11 seconds
00000100:00100000:0.0:1789431567.158264:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.158391:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933564544
00000100:00100000:3.0:1789431567.158402:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933564544
00010000:00010000:3.0:1789431567.158441:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352747b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90d6 expref: 217 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.158483:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16657
00000100:00100000:3.0:1789431567.158493:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:2348:x1876351933564544:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431567.158507:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431567.158514:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352747b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90d6 expref: 217 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.158526:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352747b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90d6 expref: 217 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.158546:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352747b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90d6 expref: 217 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.158563:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:3.0:1789431567.158568:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527497 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.158579:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.158587:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527497 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.158618:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431567.158671:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:2348:x1876351933564544:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 179us (415us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431567.158679:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16657
00010000:00010000:0.0:1789431567.159116:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.159124:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431567.159142:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00010000:00010000:0.0:1789431567.159302:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527489 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90eb expref: 217 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.159319:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90eb expref: 216 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.159327:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:0.0:1789431567.159331:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431567.159333:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308200, rc 0)
00000100:00100000:0.0:1789431567.159370:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14616:x1876351933564288:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 26726us (26995us total) trans 4295121097 rc 0/0
00000100:00100000:0.0:1789431567.159378:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296200
00000100:00100000:2.0:1789431567.160995:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e97800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894248704:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431567.161022:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635274ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.165575:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.165671:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.165978:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933564928
00000100:00100000:3.0:1789431567.165988:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933564928
00000100:00100000:3.0:1789431567.166038:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296202
00000100:00100000:3.0:1789431567.166070:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14616:x1876351933564928:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431567.166093:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431567.166112:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635274ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c90f9 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.166192:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb635274c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.166206:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527497 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90eb expref: 217 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.166215:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb635274c1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.166258:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90eb expref: 217 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.166269:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527497 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90eb expref: 217 pid: 5848 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.166283:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894248832:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431567.166355:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf18a0b3c0 going to sleep for 11 seconds
00000100:00100000:2.0:1789431567.166612:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933564800
00000100:00100000:2.0:1789431567.166619:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933564800
00010000:00010000:2.0:1789431567.166643:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527490 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90e4 expref: 218 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.166672:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16658
00000100:00100000:2.0:1789431567.166679:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb07850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:2348:x1876351933564800:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431567.166689:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431567.166695:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527490 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90e4 expref: 218 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.166717:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527490 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90e4 expref: 218 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.166750:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527490 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90e4 expref: 218 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.166763:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:2.0:1789431567.166768:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635274ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.166776:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635274ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.166783:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635274ac lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.166809:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431567.166836:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb07850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:2348:x1876351933564800:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 156us (1270us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.166843:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16658
00010000:00010000:0.0:1789431567.166991:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635274ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.167000:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635274ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431567.167033:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:0.0:1789431567.167037:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431567.167084:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635274ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.167111:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635274a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90f2 expref: 217 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.167124:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635274ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90f2 expref: 216 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.167131:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:0.0:1789431567.167133:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431567.167136:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523800, rc 0)
00000100:00100000:0.0:1789431567.167174:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14617:x1876351933564672:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11703us (12244us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431567.167181:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296201
00000100:00100000:2.0:1789431567.173040:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894248832:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431567.173094:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb635274c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.181879:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.181983:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.182460:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933565312
00000100:00100000:3.0:1789431567.182472:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933565312
00000100:00100000:3.0:1789431567.182532:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12521
00000100:00100000:3.0:1789431567.182543:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14617:x1876351933565312:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431567.183086:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14617:x1876351933565312:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 509us (1066us total) trans 4295121098 rc 0/0
00000100:00100000:3.0:1789431567.183096:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12521
00000100:00100000:2.0:1789431567.183163:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933565056
00000100:00100000:2.0:1789431567.183168:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933565056
00010000:00010000:2.0:1789431567.183192:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527497 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90eb expref: 217 pid: 5848 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.183227:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16659
00000100:00100000:2.0:1789431567.183251:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:2347:x1876351933565056:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431567.183264:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431567.183270:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527497 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90eb expref: 217 pid: 5848 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.183283:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90eb expref: 217 pid: 5848 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.183304:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527497 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90eb expref: 217 pid: 5848 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.183319:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431567.183324:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb635274c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.183333:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb635274c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.183341:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb635274c1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.183366:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431567.183389:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:2347:x1876351933565056:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 146us (1521us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.183394:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16659
00010000:00010000:2.0:1789431567.183415:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb635274c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.183423:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb635274c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431567.183456:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:2.0:1789431567.183461:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431567.183474:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb635274c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.183498:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635274ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90f9 expref: 216 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.183513:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb635274c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90f9 expref: 215 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.183521:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431567.183524:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431567.183527:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7aa00, rc 0)
00000100:00100000:2.0:1789431567.183548:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14616:x1876351933564928:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 17503us (17876us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.183555:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296202
00000100:00100000:3.0:1789431567.191093:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.191138:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.196890:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933565440
00000100:00100000:1.0:1789431567.196907:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933565440
00000100:00100000:1.0:1789431567.197030:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933565568
00000100:00100000:1.0:1789431567.197034:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933565568
00000100:00100000:1.0:1789431567.197093:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296203
00000100:00100000:1.0:1789431567.197103:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14616:x1876351933565440:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.197124:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.197146:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635274c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9100 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.197211:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635274cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.197225:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635274cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.197248:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635274cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.197265:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635274d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.197272:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635274d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.197279:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635274d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.197513:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635274dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.197523:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635274dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.197531:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635274dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431567.197567:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000004:00200000:1.0:1789431567.197571:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431567.197590:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635274dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.197601:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635274dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.197904:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296204
00000100:00100000:3.0:1789431567.197916:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14617:x1876351933565568:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431567.197927:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431567.197938:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635274e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9107 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.197975:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635274eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.197984:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635274eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.197997:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635274eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198009:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635274f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198015:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635274f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198021:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635274f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198104:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635274f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198113:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635274f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198121:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635274f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431567.198141:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:3.0:1789431567.198144:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431567.198155:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635274f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198164:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635274f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198172:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635274eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198182:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635274eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198188:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635274eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198194:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7be00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.198197:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635274eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198204:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635274eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198215:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431567.198218:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.198222:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635274eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198240:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635274eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198253:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635274f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198259:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635274f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198264:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635274f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198269:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.198273:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635274f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198279:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635274f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198286:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90cf18b78100)
00010000:00010000:3.0:1789431567.198288:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.198291:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635274f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198297:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635274f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198324:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635274e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9107 expref: 219 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198336:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635274f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9107 expref: 218 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.198343:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431567.198346:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431567.198349:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7bc00, rc 0)
00000100:00100000:3.0:1789431567.198408:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14617:x1876351933565568:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 496us (7269us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431567.198416:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296204
00010000:00010000:1.0:1789431567.198680:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635274cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.198687:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635274cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.198693:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635274cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.198707:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.198711:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635274cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.198718:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635274cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.198727:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431567.198729:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.198733:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635274cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.198738:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635274cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.198748:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635274d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.198754:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635274d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.198759:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635274d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.198764:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.198766:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635274d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.198771:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635274d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.198778:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x7f7efb67 (ffff90ce03149500)
00010000:00010000:1.0:1789431567.198780:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.198783:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635274d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.198789:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635274d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.198816:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635274c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9100 expref: 218 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.198828:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635274dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9100 expref: 217 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.198835:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:1.0:1789431567.198837:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431567.198840:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308c00, rc 0)
00000100:00100000:1.0:1789431567.198866:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14616:x1876351933565440:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1765us (7820us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.198873:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296203
00000100:00100000:0.0:1789431567.207786:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431567.207822:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.207886:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933565824
00000100:00100000:2.0:1789431567.207897:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933565824
00000100:00100000:2.0:1789431567.207951:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296205
00000100:00100000:2.0:1789431567.207960:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14617:x1876351933565824:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431567.207982:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431567.208002:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527500 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c910e expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.208125:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.208140:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635274ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90f2 expref: 218 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.208149:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635274f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9107 expref: 218 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.208156:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.208185:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635274f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9107 expref: 218 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.208196:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635274f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9107 expref: 218 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.208208:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e97100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894248960:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431567.208278:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635274ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90f2 expref: 218 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.208287:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635274ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90f2 expref: 218 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.208296:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e97800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894249088:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431567.208312:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05eade40 going to sleep for 11 seconds
00000100:00100000:3.0:1789431567.208504:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933565952
00000100:00100000:3.0:1789431567.208509:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933565952
00010000:00010000:3.0:1789431567.208529:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635274f9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9107 expref: 219 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.208561:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16660
00000100:00100000:3.0:1789431567.208568:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:2349:x1876351933565952:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431567.208577:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431567.208582:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635274f9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9107 expref: 219 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.208592:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635274f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9107 expref: 219 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.208619:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431567.208673:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.208681:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.208687:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431567.208723:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:2349:x1876351933565952:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 155us (900us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431567.208730:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16660
00010000:00010000:2.0:1789431567.215360:0:12181:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@00000000de3948e3 x1876351894248960) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635274f9 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9107 expref: 218 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.215393:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635274f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9107 expref: 218 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.215411:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e97100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894248960:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431567.215424:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e97800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894249088:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431567.215447:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:2.0:1789431567.215453:0:12181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.215462:0:12181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.215473:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.218725:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.219043:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933566336
00000100:00100000:3.0:1789431567.219089:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933566336
00000100:00100000:3.0:1789431567.219155:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296206
00000100:00100000:3.0:1789431567.219165:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14616:x1876351933566336:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431567.219184:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431567.219205:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352750e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9115 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.219309:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527515 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.219324:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635274dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9100 expref: 219 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.219333:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527515 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.219364:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635274dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9100 expref: 219 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.219375:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635274dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9100 expref: 219 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.219389:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894249216:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431567.219471:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf18a0bb40 going to sleep for 11 seconds
00000100:00100000:0.0:1789431567.229544:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.229733:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933566208
00000100:00100000:2.0:1789431567.229743:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933566208
00010000:00010000:2.0:1789431567.229793:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635274ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90f2 expref: 220 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.229835:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16661
00000100:00100000:2.0:1789431567.229845:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:2347:x1876351933566208:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431567.230002:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431567.230012:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635274ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90f2 expref: 220 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.230033:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635274ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90f2 expref: 220 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.230093:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635274ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90f2 expref: 220 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.230111:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:2.0:1789431567.230116:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.230126:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.230135:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.230158:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431567.230213:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:2347:x1876351933566208:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 369us (677us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.230220:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16661
00000100:00100000:2.0:1789431567.230997:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.231081:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933566464
00000100:00100000:1.0:1789431567.231088:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933566464
00010000:00010000:1.0:1789431567.231115:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635274dd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9100 expref: 219 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.231141:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16662
00000100:00100000:1.0:1789431567.231149:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:2347:x1876351933566464:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431567.231160:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431567.231165:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635274dd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9100 expref: 219 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.231181:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635274dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9100 expref: 219 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.231197:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:1.0:1789431567.231202:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527515 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.231209:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527515 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.231217:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527515 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.231231:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431567.231277:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:2347:x1876351933566464:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 129us (283us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.231284:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16662
00010000:00010000:0.0:1789431567.231942:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.231952:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431567.231971:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00010000:00010000:0.0:1789431567.232151:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527500 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c910e expref: 220 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.232171:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c910e expref: 219 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.232179:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:0.0:1789431567.232182:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431567.232185:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522600, rc 0)
00010000:00010000:3.0:1789431567.232369:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635274dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9100 expref: 219 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.232381:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894249216:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431567.232400:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527515 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.232407:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527515 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.232416:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527515 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431567.232440:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00010000:00010000:3.0:1789431567.232506:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352750e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9115 expref: 220 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.232519:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527515 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9115 expref: 219 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.232526:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:3.0:1789431567.232528:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431567.232531:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b600, rc 0)
00000100:00100000:0.0:1789431567.232569:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14617:x1876351933565824:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 24609us (24790us total) trans 4295121099 rc 0/0
00000100:00100000:0.0:1789431567.232577:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296205
00000100:00100000:3.0:1789431567.239377:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14616:x1876351933566336:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 20203us (20650us total) trans 4295121100 rc 0/0
00000100:00100000:3.0:1789431567.239390:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296206
00000100:00100000:2.0:1789431567.250189:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.250340:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933566592
00000100:00100000:3.0:1789431567.250350:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933566592
00000100:00100000:3.0:1789431567.250410:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296207
00000100:00100000:3.0:1789431567.250421:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14617:x1876351933566592:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431567.250455:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431567.250477:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352752a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c911c expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.250559:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.250586:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c910e expref: 219 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.250596:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527531 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.250638:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c910e expref: 219 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.250652:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c910e expref: 219 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.250665:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894249344:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431567.251211:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf18a0bb40 going to sleep for 11 seconds
00000100:00100000:1.0:1789431567.267729:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.267940:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894249344:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431567.267967:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.268401:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933566720
00000100:00100000:0.0:1789431567.268409:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933566720
00000100:00100000:0.0:1789431567.268475:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296208
00000100:00100000:0.0:1789431567.268486:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14616:x1876351933566720:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431567.268507:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431567.268527:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527538 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9123 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.268613:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352753f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.268628:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527515 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9115 expref: 221 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.268636:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352753f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.268668:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527515 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9115 expref: 221 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.268679:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527515 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9115 expref: 221 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.268691:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce3621bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894249472:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431567.268906:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba39840 going to sleep for 11 seconds
00000100:00100000:3.0:1789431567.269035:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431567.269735:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933566848
00000100:00100000:0.0:1789431567.269742:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933566848
00010000:00010000:0.0:1789431567.269780:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c910e expref: 222 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.269813:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16663
00000100:00100000:0.0:1789431567.269821:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:2347:x1876351933566848:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431567.269833:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431567.269839:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c910e expref: 222 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.269851:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c910e expref: 222 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.269870:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527507 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c910e expref: 222 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.269885:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:0.0:1789431567.269891:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.269899:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.269911:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527531 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.269935:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431567.269970:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:2347:x1876351933566848:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 150us (936us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431567.269978:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16663
00010000:00010000:0.0:1789431567.270003:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.270010:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431567.270091:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:0.0:1789431567.270095:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431567.270115:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.270142:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352752a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c911c expref: 221 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.270155:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c911c expref: 220 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.270162:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:0.0:1789431567.270165:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431567.270167:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7be00, rc 0)
00000100:00100000:0.0:1789431567.270189:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14617:x1876351933566592:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 19771us (20011us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431567.270196:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296207
00000100:00100000:2.0:1789431567.281794:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.281878:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933566976
00000100:00100000:1.0:1789431567.281887:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933566976
00010000:00010000:1.0:1789431567.281927:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527515 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9115 expref: 220 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.281967:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16664
00000100:00100000:1.0:1789431567.281977:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:2348:x1876351933566976:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431567.281991:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431567.281998:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527515 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9115 expref: 220 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.282011:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527515 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9115 expref: 220 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.282032:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:1.0:1789431567.282038:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352753f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.282087:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352753f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.282096:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352753f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.282115:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431567.282165:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:2348:x1876351933566976:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 189us (381us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.282172:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16664
00010000:00010000:0.0:1789431567.282668:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527515 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9115 expref: 219 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.282686:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce3621bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894249472:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431567.282723:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352753f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.282733:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352753f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.282739:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352753f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431567.282791:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000004:00200000:0.0:1789431567.282796:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431567.282818:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352753f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.282853:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527538 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9123 expref: 219 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.282866:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352753f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9123 expref: 218 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.282874:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:0.0:1789431567.282877:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431567.282880:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3200, rc 0)
00000100:00100000:0.0:1789431567.282914:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14616:x1876351933566720:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 14431us (15198us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431567.282923:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296208
00000100:00100000:1.0:1789431567.289485:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431567.289625:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933567104
00000100:00100000:0.0:1789431567.289634:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933567104
00000100:00100000:0.0:1789431567.289695:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296209
00000100:00100000:0.0:1789431567.289715:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14617:x1876351933567104:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431567.289734:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431567.289762:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527546 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c912a expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.289822:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb6352754d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.289836:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb6352754d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.289847:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb6352754d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.289860:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527554 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.289867:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.289874:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.289974:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352755b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.289983:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352755b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.289990:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352755b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431567.290027:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:0.0:1789431567.290031:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431567.290083:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352755b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.290096:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352755b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.290104:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb6352754d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.290112:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb6352754d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.290118:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb6352754d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.290124:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431567.290129:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb6352754d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.290136:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb6352754d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.290148:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431567.290152:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.290157:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb6352754d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.290163:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb6352754d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.290177:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.290183:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527554 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.290189:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.290195:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431567.290198:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.290203:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527554 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.290210:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce07190b00)
00010000:00010000:0.0:1789431567.290213:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.290216:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527554 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.290221:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527554 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.290596:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527546 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c912a expref: 220 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.290930:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.291133:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933567360
00000100:00100000:3.0:1789431567.291141:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933567360
00000100:00100000:3.0:1789431567.291187:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12522
00000100:00100000:3.0:1789431567.291196:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14616:x1876351933567360:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431567.291391:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14616:x1876351933567360:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 196us (461us total) trans 4295121101 rc 0/0
00000100:00100000:3.0:1789431567.291398:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12522
00010000:00010000:0.0:1789431567.292025:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352755b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c912a expref: 220 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.292037:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:0.0:1789431567.292040:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431567.292044:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3c00, rc 0)
00000100:00100000:0.0:1789431567.292347:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14617:x1876351933567104:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2633us (2873us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431567.292355:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296209
00000100:00100000:0.0:1789431567.305645:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431567.305743:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.306527:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933567616
00000100:00100000:2.0:1789431567.306538:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933567616
00000100:00100000:2.0:1789431567.306602:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14368
00000100:00100000:2.0:1789431567.306613:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb04c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:2350:x1876351933567616:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431567.306629:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431567.306653:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352755b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c912a expref: 220 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.306674:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:2.0:1789431567.306679:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431567.306745:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb04c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:2350:x1876351933567616:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 134us (1001us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.306762:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14368
00000100:00100000:1.0:1789431567.306952:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933567488
00000100:00100000:1.0:1789431567.306957:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933567488
00000100:00100000:1.0:1789431567.306997:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296210
00000100:00100000:1.0:1789431567.307004:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14616:x1876351933567488:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.307019:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.307034:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527562 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9131 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307116:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527569 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307130:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527569 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307139:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527569 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307153:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527570 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307160:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307166:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307391:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527577 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307402:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307409:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431567.307450:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aa9:0x0]: returning size 85515
00000004:00200000:1.0:1789431567.307454:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431567.307472:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307484:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307496:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527569 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307502:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527569 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307510:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527569 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307515:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.307519:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527569 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307527:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527569 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307536:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431567.307539:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.307543:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527569 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307550:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527569 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307560:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307565:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527570 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307571:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307577:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.307580:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307586:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527570 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307593:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x7f7efb67 (ffff90ce03149500)
00010000:00010000:1.0:1789431567.307596:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.307598:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527570 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307604:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527570 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307630:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527562 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9131 expref: 221 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307642:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9131 expref: 220 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.307649:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:1.0:1789431567.307652:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431567.307654:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308600, rc 0)
00000100:00100000:1.0:1789431567.307689:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14616:x1876351933567488:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 685us (2053us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.307696:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296210
00000100:00100000:1.0:1789431567.310374:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.311559:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933567872
00000100:00100000:2.0:1789431567.311571:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933567872
00000100:00100000:2.0:1789431567.311628:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296211
00000100:00100000:2.0:1789431567.311638:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14617:x1876351933567872:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431567.311697:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431567.311734:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527531 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c911c expref: 220 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.311762:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:2.0:1789431567.311767:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431567.311809:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352757e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.311823:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352757e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.311833:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352757e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431567.311972:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000060da210 reply state 00000000932d7e68 transno 4295121102 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352757e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.311982:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431567.312092:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14617:x1876351933567872:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 455us (1727us total) trans 4295121102 rc 0/0
00000100:00100000:2.0:1789431567.312100:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296211
00000100:00100000:0.0:1789431567.334086:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.334207:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933568128
00000100:00100000:2.0:1789431567.334217:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933568128
00000100:00100000:2.0:1789431567.334274:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296212
00000100:00100000:2.0:1789431567.334283:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3621aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14616:x1876351933568128:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431567.334339:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0
00010000:00010000:2.0:1789431567.334364:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527577 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9131 expref: 221 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.334387:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352753f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9123 expref: 220 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.334401:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63526c08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aa9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e60 expref: 219 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.334411:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90ce03149800)
00010000:00010000:2.0:1789431567.334420:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431567.334454:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527585 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.334468:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527585 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.334479:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527585 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.334495:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb6352758c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.334502:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb6352758c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.334509:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb6352758c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.334983:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527593 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.334993:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527593 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.335001:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527593 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431567.335924:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1247, 64 off88064
00010000:00010000:2.0:1789431567.335999:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352759a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336012:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352759a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336021:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352759a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336030:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352759a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336037:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352759a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336183:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352759a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336251:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431567.336274:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527593 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336281:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527593 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336288:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527593 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336294:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431567.336298:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527593 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336305:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527593 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336316:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90cf13195300)
00010000:00010000:2.0:1789431567.336319:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431567.336323:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527593 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336329:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527593 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aa9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336351:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527585 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336358:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527585 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336364:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527585 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336369:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431567.336373:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527585 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336379:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527585 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336387:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431567.336390:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431567.336393:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527585 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.336398:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527585 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431567.336408:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000db27eb78 reply state 00000000d953f277 transno 4295121103 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb6352758c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.336416:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431567.336517:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3621aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14616:x1876351933568128:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2231us (2475us total) trans 4295121103 rc 0/0
00000100:00100000:2.0:1789431567.336530:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296212
00010000:00010000:3.0:1789431567.337712:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352757e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.337726:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352757e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.337742:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352757e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.337755:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.337759:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352757e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.337765:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352757e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.337777:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431567.337781:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.337784:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352757e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.337791:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352757e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.343345:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.344125:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933568256
00000100:00100000:3.0:1789431567.344136:0:14464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933568256
00000100:00100000:3.0:1789431567.344275:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8385
00000100:00100000:3.0:1789431567.344286:0:14464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+66:2347:x1876351933568256:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:3.0:1789431567.344481:0:14464:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x518:0x0] updating lvb size from disk: 83190 -> 83190
00002000:00010000:3.0:1789431567.344486:0:14464:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x518:0x0] updating lvb mtime from disk: 1789431554 -> 1789431542
00002000:00010000:3.0:1789431567.344488:0:14464:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x518:0x0] updating lvb atime from disk: 1789431545 -> 1789431556
00002000:00010000:3.0:1789431567.344490:0:14464:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x518:0x0] updating lvb ctime from disk: 1789431566 -> 1789431566
00002000:00010000:3.0:1789431567.344493:0:14464:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x518:0x0] updating lvb blocks from disk: 259 -> 259
00000100:00100000:3.0:1789431567.344542:0:14464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2347:x1876351933568256:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 259us (1208us total) trans 4294969666 rc 0/0
00000100:00100000:3.0:1789431567.344549:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8385
00000100:00080000:1.0:1789431567.344744:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1789431567.345398:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb6352758c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.345412:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb6352758c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.345420:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb6352758c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.345438:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.345443:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb6352758c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.345450:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb6352758c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.345467:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x7f7efb67 (ffff90cf13195600)
00010000:00010000:3.0:1789431567.345471:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.345476:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb6352758c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.345482:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb6352758c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0x7f7efb67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.345926:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894249600:0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1789431567.345981:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431567.346874:0:12256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894249600
00000100:00100000:2.0:1789431567.346883:0:12256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894249600
00000100:00100000:2.0:1789431567.346990:0:12256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135
00000100:00100000:2.0:1789431567.347000:0:12256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876351894249600:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:2.0:1789431567.347023:0:12256:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 17039360 granted 523960320 pending 0 free 3808428032 avail 3800039424
00000100:00100000:2.0:1789431567.347093:0:12256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876351894249600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1111us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.347100:0:12256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135
00000100:00080000:1.0:1789431567.347154:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1789431567.347187:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294970054 gen 2
00000004:00080000:1.0:1789431567.347193:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1ac75880, transno 4294970049
00000004:00080000:1.0:1789431567.347204:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3b2c5880, transno 4294970050
00000004:00080000:1.0:1789431567.347207:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1ac77100, transno 4294970051
00000004:00080000:1.0:1789431567.347209:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2d50bb80, transno 4294970052
00000004:00080000:1.0:1789431567.347212:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1ac74700, transno 4294970053
00000004:00080000:1.0:1789431567.347215:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce17f3c380, transno 4294970054
00000100:00100000:1.0:1789431567.347225:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894249600:0@lo:13:osp-pre-1-0.0
00000004:00080000:1.0:1789431567.347414:0:8062:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 0 in progress, 0 in flight, 6 done
00010000:00010000:0.0:1789431567.351391:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431567.351405:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352759a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.351417:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431567.351421:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352759a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.351442:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352759a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.351461:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aa9:0x0].0x0 (ffff90cf13195300)
00010000:00010000:0.0:1789431567.351464:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431567.351470:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352759a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.351481:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352759a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aa9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.351512:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431567.351515:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431567.351517:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431567.362255:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.362284:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.362389:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933568384
00000100:00100000:3.0:1789431567.362399:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933568384
00000100:00100000:3.0:1789431567.362453:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933568512
00000100:00100000:3.0:1789431567.362455:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933568512
00000100:00100000:3.0:1789431567.362474:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296213
00000100:00100000:3.0:1789431567.362483:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14617:x1876351933568384:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431567.362505:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431567.362524:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635275a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9138 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362580:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635275a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362593:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635275a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362604:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635275a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362617:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635275af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362624:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635275af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362630:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635275af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362683:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635275a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362690:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635275a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362711:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635275a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362726:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.362731:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635275a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362738:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635275a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362757:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431567.362760:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.362765:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635275a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362770:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635275a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362783:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635275af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362789:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635275af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362795:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635275af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362800:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7be00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.362803:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635275af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362811:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635275af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362818:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xbb97fc59 (ffff90cf18b78100)
00010000:00010000:3.0:1789431567.362821:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.362824:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635275af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362830:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635275af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362859:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635275a1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9138 expref: 220 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362869:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431567.362871:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.362874:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635275a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9138 expref: 220 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.362882:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a000, rc 0)
00000100:00100000:3.0:1789431567.362931:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14617:x1876351933568384:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 449us (684us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431567.362937:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296213
00000100:00100000:3.0:1789431567.362955:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296214
00000100:00100000:3.0:1789431567.362962:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14616:x1876351933568512:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431567.362969:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431567.362978:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635275b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c913f expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363006:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635275bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363014:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635275bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363021:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635275bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363032:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635275c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xf4ed591 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363039:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635275c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363081:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635275c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363157:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635275cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363166:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635275cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363174:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635275cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431567.363207:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10093:0x0]: returning size 260096
00000004:00200000:3.0:1789431567.363211:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431567.363241:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635275cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363258:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635275cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363265:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635275bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363271:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635275bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363277:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635275bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363283:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.363286:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635275bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363292:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635275bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363300:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431567.363303:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.363306:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635275bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363311:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635275bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363320:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635275c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363327:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635275c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363333:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635275c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363338:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.363341:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635275c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363347:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635275c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363354:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xf4ed591 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431567.363356:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.363358:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635275c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363364:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635275c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363386:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635275b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c913f expref: 220 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363398:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635275cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c913f expref: 219 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.363405:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10093:0x0].0x0 (ffff90ce15f0ea00)
00010000:00010000:3.0:1789431567.363408:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431567.363410:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7acc00, rc 0)
00000100:00100000:3.0:1789431567.363433:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14616:x1876351933568512:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 472us (1149us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431567.363440:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296214
00000100:00100000:1.0:1789431567.376676:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.376736:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.376857:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933568640
00000100:00100000:2.0:1789431567.376867:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933568640
00000100:00100000:2.0:1789431567.376935:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14369
00000100:00100000:2.0:1789431567.376947:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:2349:x1876351933568640:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431567.376963:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431567.376987:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635275cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c913f expref: 219 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.377005:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10093:0x0].0x0 (ffff90ce15f0ea00)
00010000:00010000:2.0:1789431567.377010:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431567.377109:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:2349:x1876351933568640:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 164us (372us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.377116:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14369
00000100:00100000:0.0:1789431567.377604:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933568896
00000100:00100000:0.0:1789431567.377610:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933568896
00000100:00100000:0.0:1789431567.377653:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296215
00000100:00100000:0.0:1789431567.377661:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14616:x1876351933568896:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431567.377679:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431567.377695:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635275d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9146 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.377874:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635275d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10093:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.377889:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb000/0xd8e438fb63511e5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2877 expref: 219 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.377897:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635275d9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10093:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.377927:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb000/0xd8e438fb63511e5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2877 expref: 219 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.377940:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb000/0xd8e438fb63511e5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2877 expref: 219 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.377958:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce36219c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894249728:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431567.378032:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba39840 going to sleep for 11 seconds
00000100:00100000:1.0:1789431567.388296:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.388756:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933569024
00000100:00100000:3.0:1789431567.388766:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933569024
00000100:00100000:3.0:1789431567.388827:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296216
00000100:00100000:3.0:1789431567.388837:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14617:x1876351933569024:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431567.388857:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431567.388878:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635275e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c914d expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.388944:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635275e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.388958:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635275e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.388968:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635275e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431567.389002:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008c:0x0]: returning size 16384
00000004:00200000:3.0:1789431567.389005:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431567.389022:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635275e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.389096:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635275e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c914d expref: 222 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.389115:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635275e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c914d expref: 221 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.389127:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431567.389130:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431567.389133:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad800, rc 0)
00000100:00100000:3.0:1789431567.389185:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14617:x1876351933569024:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 349us (898us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431567.389192:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296216
00000100:00100000:3.0:1789431567.389949:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce36219c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894249728:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431567.389971:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635275d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10093:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.390735:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.391278:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933569152
00000100:00100000:3.0:1789431567.391287:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933569152
00010000:00010000:3.0:1789431567.391320:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb000/0xd8e438fb63511e5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2877 expref: 221 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.391357:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16665
00000100:00100000:3.0:1789431567.391366:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:2347:x1876351933569152:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431567.391381:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431567.391388:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb000/0xd8e438fb63511e5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2877 expref: 221 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.391402:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb000/0xd8e438fb63511e5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2877 expref: 221 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.391622:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035cb000/0xd8e438fb63511e5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2877 expref: 221 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.391642:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10093:0x0].0x0 (ffff90ce15f0ea00)
00010000:00010000:3.0:1789431567.391647:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635275d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10093:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.391656:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635275d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10093:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.391664:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635275d9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10093:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.391770:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431567.391830:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:2347:x1876351933569152:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 463us (1096us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.391839:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16665
00010000:00010000:3.0:1789431567.392733:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635275d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10093:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.392744:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635275d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10093:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431567.392773:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10093:0x0]: returning size 260096
00010000:00010000:3.0:1789431567.392924:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635275d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9146 expref: 221 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.392941:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635275d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10093:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9146 expref: 220 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.392948:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10093:0x0].0x0 (ffff90ce15f0ea00)
00010000:00010000:3.0:1789431567.392950:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431567.392953:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3a00, rc 0)
00000100:00100000:3.0:1789431567.393004:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14616:x1876351933568896:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 15343us (16336us total) trans 4295121104 rc 0/0
00000100:00100000:3.0:1789431567.393016:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296215
00000100:00100000:1.0:1789431567.395025:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.395166:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933569280
00000100:00100000:3.0:1789431567.395177:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933569280
00000100:00100000:3.0:1789431567.395227:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12523
00000100:00100000:3.0:1789431567.395245:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14617:x1876351933569280:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431567.400996:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.401150:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933569408
00000100:00100000:2.0:1789431567.401159:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933569408
00000100:00100000:2.0:1789431567.401212:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296217
00000100:00100000:2.0:1789431567.401220:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14616:x1876351933569408:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431567.401241:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431567.401259:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635275f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10093:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9154 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.401334:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635275fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.401348:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635275d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10093:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9146 expref: 222 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.401356:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635275fc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.401386:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635275d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10093:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9146 expref: 222 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.401399:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635275d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10093:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9146 expref: 222 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.401412:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e97480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894249856:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431567.401495:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead3c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431567.402010:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14617:x1876351933569280:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 6772us (6990us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431567.402020:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12523
00000100:00100000:2.0:1789431567.410366:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e97480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894249856:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431567.410397:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635275fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.413589:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.413634:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431567.413942:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933569792
00000100:00100000:0.0:1789431567.413953:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933569792
00000100:00100000:0.0:1789431567.414005:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296218
00000100:00100000:0.0:1789431567.414016:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14617:x1876351933569792:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431567.414037:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431567.414041:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431567.414114:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635275e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c914d expref: 222 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.414135:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431567.414141:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431567.414154:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527603 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c915b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.414282:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352760a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.414296:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352760a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.414305:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352760a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.414320:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527611 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.414327:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.414333:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.415268:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933569536
00000100:00100000:2.0:1789431567.415280:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933569536
00010000:00010000:2.0:1789431567.415316:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635275d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10093:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9146 expref: 223 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.415355:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16666
00000100:00100000:2.0:1789431567.415365:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:2348:x1876351933569536:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431567.415378:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431567.415384:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635275d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10093:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9146 expref: 223 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.415397:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635275d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10093:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9146 expref: 223 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.415415:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635275d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10093:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9146 expref: 223 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.415440:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10093:0x0].0x0 (ffff90ce15f0ea00)
00010000:00010000:2.0:1789431567.415445:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635275fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.415453:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635275fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.415461:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635275fc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.415540:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431567.415598:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:2348:x1876351933569536:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 234us (2018us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.415605:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16666
00000004:00080000:0.0:1789431567.415976:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x519:0x0], index 0: 0
00010000:00010000:0.0:1789431567.416191:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527618 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.416202:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.416212:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.416249:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352760a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.416255:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352760a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.416262:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352760a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.416268:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431567.416273:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352760a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.416284:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352760a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.416294:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431567.416296:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.416301:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352760a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.416306:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352760a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431567.416317:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009543e786 reply state 00000000bfb30b08 transno 4295121105 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.416325:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431567.416352:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527603 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c915b expref: 223 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.416365:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c915b expref: 222 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.416373:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aae:0x0].0x0 (ffff90ce07190600)
00010000:00010000:0.0:1789431567.416375:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431567.416377:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2800, rc 0)
00000100:00100000:0.0:1789431567.416421:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14617:x1876351933569792:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2408us (2787us total) trans 4295121105 rc 0/0
00000100:00100000:0.0:1789431567.416428:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296218
00010000:00010000:1.0:1789431567.420267:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635275fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.420284:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635275fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431567.420344:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10093:0x0]: returning size 260096
00000004:00200000:1.0:1789431567.420350:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431567.420372:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635275fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.420412:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635275f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10093:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9154 expref: 223 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.420434:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523400/0xd8e438fb635275fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10093:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9154 expref: 222 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.420442:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10093:0x0].0x0 (ffff90ce15f0ea00)
00010000:00010000:1.0:1789431567.420445:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431567.420449:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523400, rc 0)
00000100:00100000:1.0:1789431567.420689:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14616:x1876351933569408:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 19295us (19528us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.420711:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296217
00010000:00010000:0.0:1789431567.424135:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.424152:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527611 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.424160:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527611 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.424167:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431567.424171:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527611 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.424179:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527611 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.424195:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xbb97fc59 (ffff90ce07190b00)
00010000:00010000:0.0:1789431567.424198:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.424203:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527611 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.424210:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527611 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.434667:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.436001:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933570048
00000100:00100000:3.0:1789431567.436014:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933570048
00000100:00100000:2.0:1789431567.436297:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12524
00000100:00100000:2.0:1789431567.436311:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14616:x1876351933570048:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431567.436558:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14616:x1876351933570048:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 251us (1900us total) trans 4295121106 rc 0/0
00000100:00100000:3.0:1789431567.436810:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.437255:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12524
00000100:00100000:1.0:1789431567.437369:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933570176
00000100:00100000:1.0:1789431567.437376:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933570176
00000100:00100000:1.0:1789431567.437424:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8386
00000100:00100000:1.0:1789431567.437434:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2348:x1876351933570176:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.437447:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.437466:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63527626 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9162 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789431567.437493:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x519:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:1.0:1789431567.437510:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x519:0x0].0x0 since=3025s v=(0 0)
00010000:00010000:1.0:1789431567.437515:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x519:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431567.437524:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63527626 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9162 expref: 68 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.437544:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63527626 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9162 expref: 68 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.437556:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:1.0:1789431567.438421:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2348:x1876351933570176:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 985us (1607us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.438429:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8386
00000100:00100000:3.0:1789431567.445215:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.445678:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933570432
00000100:00100000:1.0:1789431567.445689:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933570432
00000100:00100000:1.0:1789431567.445763:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12525
00000100:00100000:1.0:1789431567.445774:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14617:x1876351933570432:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431567.446566:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14617:x1876351933570432:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 790us (1357us total) trans 4295121107 rc 0/0
00000100:00100000:1.0:1789431567.446576:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12525
00000100:00100000:3.0:1789431567.450747:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431567.452107:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933570560
00000100:00100000:0.0:1789431567.452120:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933570560
00000100:00100000:0.0:1789431567.452186:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296219
00000100:00100000:0.0:1789431567.452197:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14616:x1876351933570560:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431567.452221:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431567.452253:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb6352762d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9169 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.452502:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527634 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.452517:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527634 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.452528:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527634 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.452541:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352763b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.452548:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352763b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.452555:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352763b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.452650:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527642 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.452659:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.452667:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431567.452709:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:0.0:1789431567.453553:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431567.453588:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.453608:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.453616:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527634 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.453623:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527634 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.453630:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527634 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.453636:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431567.453640:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527634 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.453646:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527634 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.453658:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431567.453661:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.453666:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527634 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.453671:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527634 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.453685:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352763b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.453691:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352763b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.453707:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352763b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.453712:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431567.453723:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352763b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.453729:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352763b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.453736:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce07190b00)
00010000:00010000:0.0:1789431567.453739:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.453742:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352763b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.453748:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352763b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.453784:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb6352762d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9169 expref: 225 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.453799:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527642 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9169 expref: 224 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.453807:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:0.0:1789431567.453809:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431567.453812:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3c00, rc 0)
00000100:00100000:0.0:1789431567.453887:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14616:x1876351933570560:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1692us (3149us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431567.453897:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296219
00000100:00100000:0.0:1789431567.456607:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.456685:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933570816
00000100:00100000:1.0:1789431567.456695:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933570816
00000100:00100000:1.0:1789431567.456764:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12526
00000100:00100000:1.0:1789431567.456774:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14617:x1876351933570816:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431567.456998:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14617:x1876351933570816:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 224us (398us total) trans 4295121108 rc 0/0
00000100:00100000:1.0:1789431567.457005:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12526
00000100:00100000:3.0:1789431567.463883:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.464504:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933570944
00000100:00100000:1.0:1789431567.464514:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933570944
00000100:00100000:1.0:1789431567.464587:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14370
00000100:00100000:1.0:1789431567.464597:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:2350:x1876351933570944:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431567.464616:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431567.464641:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527642 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9169 expref: 225 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.465959:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:1.0:1789431567.465968:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431567.466034:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:2350:x1876351933570944:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1436us (2156us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.466044:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14370
00000100:00100000:3.0:1789431567.479200:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.479254:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.479411:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933571456
00000100:00100000:1.0:1789431567.479431:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933571456
00000100:00100000:1.0:1789431567.479482:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933571200
00000100:00100000:1.0:1789431567.479486:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933571200
00000100:00100000:1.0:1789431567.479511:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296220
00000100:00100000:1.0:1789431567.479521:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14617:x1876351933571456:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431567.479577:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431567.479605:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527618 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c915b expref: 225 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.479624:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aae:0x0].0x0 (ffff90ce07190600)
00010000:00010000:1.0:1789431567.479636:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431567.479670:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527649 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.479685:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527649 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.479706:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527649 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.479866:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296221
00000100:00100000:2.0:1789431567.479878:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14616:x1876351933571200:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431567.479888:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.479893:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527650 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.479901:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527657 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9170 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.479904:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.479921:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.479987:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352765e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.480001:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb635274c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90f9 expref: 225 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.480010:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352765e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.480030:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527665 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.480040:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527665 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.480080:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb635274c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90f9 expref: 225 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.480093:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527665 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.480105:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb635274c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90f9 expref: 225 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.480120:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894249984:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431567.480232:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead780 going to sleep for 11 seconds
00000040:00080000:1.0:1789431567.481216:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1248, 64 off88064
00000004:00080000:1.0:1789431567.481227:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3025512177488ns, next at 3026512175318ns, rc = 0
00010000:00010000:1.0:1789431567.483750:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352766c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483774:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352766c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483786:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352766c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483800:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352766c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483806:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352766c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483812:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352766c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483837:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431567.483862:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527665 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aae:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483868:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527665 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aae:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483874:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527665 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aae:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483880:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.483884:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527665 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aae:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483891:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527665 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aae:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483901:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aae:0x0].0x0 (ffff90ce03149800)
00010000:00010000:1.0:1789431567.483903:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431567.483908:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527665 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aae:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483916:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527665 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aae:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483936:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527649 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483941:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527649 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483946:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527649 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483950:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.483953:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527649 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483959:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527649 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483966:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431567.483968:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.483971:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527649 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.483977:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527649 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431567.483987:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006b67a297 reply state 00000000da872403 transno 4295121109 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.483995:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:2.0:1789431567.484177:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431567.484184:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352766c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aae:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.484191:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431567.484195:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352766c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aae:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.484201:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352766c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aae:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.484211:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aae:0x0].0x0 (ffff90ce03149800)
00010000:00010000:2.0:1789431567.484214:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431567.484217:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352766c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10aae:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.484224:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352766c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aae:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.484238:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431567.484240:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431567.484242:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431567.485991:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:14617:x1876351933571456:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 6461us (6792us total) trans 4295121109 rc 0/0
00000100:00100000:1.0:1789431567.486005:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296220
00000100:00100000:2.0:1789431567.486791:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431567.486864:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933571584
00000100:00100000:0.0:1789431567.486872:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933571584
00010000:00010000:0.0:1789431567.486908:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb635274c1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90f9 expref: 227 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.486940:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16667
00000100:00100000:0.0:1789431567.486948:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:2348:x1876351933571584:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431567.486961:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431567.486966:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb635274c1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90f9 expref: 227 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.486979:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb635274c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90f9 expref: 227 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.486999:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:0.0:1789431567.487004:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352765e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.487012:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352765e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.487020:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352765e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.487037:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431567.487175:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:2348:x1876351933571584:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 227us (387us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431567.487182:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16667
00010000:00010000:3.0:1789431567.487459:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb635274c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c90f9 expref: 226 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.487477:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894249984:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431567.487499:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352765e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.487506:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352765e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.487510:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352765e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431567.487529:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00010000:00010000:3.0:1789431567.487856:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527657 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9170 expref: 227 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.487871:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352765e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9170 expref: 226 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.487879:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:3.0:1789431567.487881:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431567.487886:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522c00, rc 0)
00000100:00100000:3.0:1789431567.487973:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+226:14616:x1876351933571200:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8098us (8718us total) trans 4295121110 rc 0/0
00000100:00100000:3.0:1789431567.487980:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296221
00010000:00010000:3.0:1789431567.490344:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.490362:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527650 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.490369:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527650 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.490375:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.490379:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527650 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.490387:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527650 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.490406:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xbb97fc59 (ffff90ce03149000)
00010000:00010000:3.0:1789431567.490409:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.490413:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527650 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.490419:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527650 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.496158:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.496193:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933571712
00000100:00100000:3.0:1789431567.496203:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933571712
00000100:00100000:0.0:1789431567.496292:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296222
00000100:00100000:0.0:1789431567.496315:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14617:x1876351933571712:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431567.496338:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431567.496357:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352767a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9177 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.496432:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527681 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.496447:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527681 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.496458:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527681 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.496473:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527688 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.496706:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.496716:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497128:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352768f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497139:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352768f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497148:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352768f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431567.497185:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:0.0:1789431567.497189:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431567.497208:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352768f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497219:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352768f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497227:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527681 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497233:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527681 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497240:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527681 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497245:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431567.497250:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527681 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497257:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527681 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497269:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431567.497272:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.497276:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527681 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497287:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527681 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497299:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497600:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527688 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497611:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527688 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497617:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431567.497620:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527688 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497626:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527688 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497634:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce07190b00)
00010000:00010000:0.0:1789431567.497637:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.497641:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527688 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497647:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527688 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497686:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352767a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9177 expref: 227 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497714:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352768f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9177 expref: 226 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.497722:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:0.0:1789431567.497724:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431567.497727:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2000, rc 0)
00000100:00100000:0.0:1789431567.497847:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+226:14617:x1876351933571712:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1544us (1696us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431567.497854:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296222
00000100:00100000:3.0:1789431567.502956:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.503192:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933571840
00000100:00100000:1.0:1789431567.503202:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933571840
00000100:00100000:1.0:1789431567.503254:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296223
00000100:00100000:1.0:1789431567.503265:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+226:14616:x1876351933571840:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.503292:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.503311:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527696 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c917e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.503397:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352769d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.503412:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352765e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9170 expref: 227 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.503421:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352769d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.503453:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352765e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9170 expref: 227 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.503468:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352765e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9170 expref: 227 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.503480:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b9d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894250112:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431567.503558:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1e8c9600 going to sleep for 11 seconds
00000100:00100000:1.0:1789431567.509128:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b9d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894250112:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431567.509159:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352769d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.515089:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.515181:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933571968
00000100:00100000:2.0:1789431567.515192:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933571968
00010000:00010000:2.0:1789431567.515230:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352765e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9170 expref: 228 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.515278:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16668
00000100:00100000:2.0:1789431567.515288:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:2348:x1876351933571968:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431567.515303:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431567.515310:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352765e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9170 expref: 228 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.515322:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352765e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9170 expref: 228 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.515342:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352765e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9170 expref: 228 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.515359:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431567.515363:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352769d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.515372:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352769d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.515381:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352769d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.515414:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431567.515461:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:2348:x1876351933571968:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 174us (419us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.515468:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16668
00010000:00010000:3.0:1789431567.516149:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352769d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.516160:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352769d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431567.516204:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:3.0:1789431567.516208:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431567.516237:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352769d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.516273:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527696 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c917e expref: 227 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.516292:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352769d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c917e expref: 226 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.516299:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:3.0:1789431567.516302:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431567.516315:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309200, rc 0)
00000100:00100000:3.0:1789431567.516348:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+226:14616:x1876351933571840:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 13086us (13402us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431567.516355:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296223
00000100:00100000:2.0:1789431567.528815:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.528860:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431567.528950:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933572224
00000100:00100000:0.0:1789431567.528959:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933572224
00000100:00100000:0.0:1789431567.529026:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12527
00000100:00100000:0.0:1789431567.529037:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+226:14616:x1876351933572224:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431567.529323:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:14616:x1876351933572224:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 287us (461us total) trans 4295121111 rc 0/0
00000100:00100000:0.0:1789431567.529330:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12527
00000100:00100000:1.0:1789431567.530242:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933572480
00000100:00100000:1.0:1789431567.530250:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933572480
00000100:00100000:1.0:1789431567.530295:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296224
00000100:00100000:1.0:1789431567.530303:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:14617:x1876351933572480:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.530327:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.530346:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635276a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9185 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.530432:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635276ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.530448:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352768f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9177 expref: 228 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.530458:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635276ab lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.530502:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352768f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9177 expref: 228 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.530516:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352768f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9177 expref: 228 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.530530:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b9d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894250240:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431567.530827:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1e8c9600 going to sleep for 11 seconds
00000100:00100000:2.0:1789431567.538388:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431567.538754:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933572608
00000100:00100000:0.0:1789431567.538764:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933572608
00000100:00100000:0.0:1789431567.538831:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296225
00000100:00100000:0.0:1789431567.538844:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14616:x1876351933572608:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431567.538868:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431567.538889:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635276b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c918c expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.538953:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635276b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.538971:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635276b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.538983:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635276b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.538995:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.539002:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.539008:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.539145:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635276c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.539154:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635276c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.539162:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635276c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431567.539192:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:0.0:1789431567.539196:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431567.539213:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635276c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.539223:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635276c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.539235:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635276b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.539241:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635276b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.539249:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635276b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.539255:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431567.539259:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635276b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.539267:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635276b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.539277:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431567.539281:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.539285:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635276b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.539292:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635276b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.540037:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.540818:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.540828:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.540835:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431567.540840:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.540847:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.540860:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce07190b00)
00010000:00010000:0.0:1789431567.540863:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.540867:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.540873:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.540929:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635276b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c918c expref: 231 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.540942:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635276c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c918c expref: 230 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.540950:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:0.0:1789431567.540952:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431567.540955:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3e00, rc 0)
00000100:00100000:0.0:1789431567.541020:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14616:x1876351933572608:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2179us (2641us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431567.541029:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296225
00000100:00100000:1.0:1789431567.541556:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b9d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894250240:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431567.541579:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635276ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.547755:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.549763:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933572736
00000100:00100000:3.0:1789431567.549777:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933572736
00010000:00010000:3.0:1789431567.549819:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352768f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9177 expref: 230 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.549866:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16669
00000100:00100000:3.0:1789431567.549876:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb07450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:2347:x1876351933572736:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431567.549889:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431567.549896:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352768f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9177 expref: 230 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.549910:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352768f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9177 expref: 230 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.549933:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352768f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9177 expref: 230 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.549951:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431567.549956:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635276ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.549966:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635276ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.549978:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635276ab lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.550000:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431567.550046:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb07450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:2347:x1876351933572736:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 172us (2300us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431567.550082:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16669
00010000:00010000:1.0:1789431567.550236:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635276ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.550245:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635276ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431567.550263:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00010000:00010000:1.0:1789431567.550401:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635276a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9185 expref: 230 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.550416:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635276ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9185 expref: 229 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.550435:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:1.0:1789431567.550438:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431567.550440:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309000, rc 0)
00000100:00100000:1.0:1789431567.550463:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14617:x1876351933572480:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 20161us (21658us total) trans 4295121112 rc 0/0
00000100:00100000:1.0:1789431567.550470:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296224
00000100:00100000:2.0:1789431567.551193:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.552763:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933572864
00000100:00100000:1.0:1789431567.552776:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933572864
00000100:00100000:1.0:1789431567.552846:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14371
00000100:00100000:1.0:1789431567.552856:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:2348:x1876351933572864:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431567.552870:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431567.552893:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635276c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c918c expref: 229 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.552910:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:1.0:1789431567.552915:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431567.552960:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:2348:x1876351933572864:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 107us (1769us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.552966:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14371
00000100:00100000:2.0:1789431567.553815:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.553886:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933573120
00000100:00100000:3.0:1789431567.553893:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933573120
00000100:00100000:3.0:1789431567.553935:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296226
00000100:00100000:3.0:1789431567.553943:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14616:x1876351933573120:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431567.553962:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431567.553980:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635276d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9193 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.554102:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635276dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.554116:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352769d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c917e expref: 229 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.554124:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635276dc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.554154:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352769d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c917e expref: 229 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.554167:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352769d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c917e expref: 229 pid: 5848 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.554180:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894250368:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431567.554250:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf18a0bb40 going to sleep for 11 seconds
00000100:00100000:2.0:1789431567.561043:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.561201:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933573248
00000100:00100000:3.0:1789431567.561261:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933573248
00000100:00100000:3.0:1789431567.561316:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296227
00000100:00100000:3.0:1789431567.561326:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14617:x1876351933573248:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431567.561349:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00000100:00100000:0.0:1789431567.561353:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894250368:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431567.561368:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635276e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c919a expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.561376:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635276dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.561458:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635276ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.561473:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635276ab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9185 expref: 231 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.561482:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635276ea lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.561520:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635276ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9185 expref: 231 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.561543:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635276ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9185 expref: 231 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.561557:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894250496:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431567.561633:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf18a0bb40 going to sleep for 11 seconds
00000100:00100000:0.0:1789431567.561943:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.562123:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933573376
00000100:00100000:1.0:1789431567.562128:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933573376
00010000:00010000:1.0:1789431567.562151:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352769d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c917e expref: 232 pid: 5848 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.562178:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16670
00000100:00100000:1.0:1789431567.562185:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c157100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:2347:x1876351933573376:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431567.562194:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431567.562200:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352769d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c917e expref: 232 pid: 5848 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.562211:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352769d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c917e expref: 232 pid: 5848 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.562229:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352769d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c917e expref: 232 pid: 5848 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.562244:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:1.0:1789431567.562250:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635276dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.562258:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635276dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.562266:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635276dc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.562291:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431567.562321:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c157100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:2347:x1876351933573376:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 136us (378us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.562328:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16670
00010000:00010000:0.0:1789431567.562378:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635276dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.562385:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635276dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431567.562402:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00010000:00010000:0.0:1789431567.562561:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635276d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9193 expref: 232 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.562577:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635276dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9193 expref: 231 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.562583:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:0.0:1789431567.562585:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431567.562587:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad000, rc 0)
00000100:00100000:0.0:1789431567.562611:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14616:x1876351933573120:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8670us (8799us total) trans 4295121113 rc 0/0
00000100:00100000:0.0:1789431567.562618:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296226
00000100:00100000:3.0:1789431567.567418:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894250496:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431567.567456:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635276ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.576764:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431567.576814:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.578865:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933573632
00000100:00100000:1.0:1789431567.578879:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933573632
00010000:00010000:1.0:1789431567.578929:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635276ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9185 expref: 231 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.578977:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16671
00000100:00100000:1.0:1789431567.578987:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c157480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:2349:x1876351933573632:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431567.579002:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431567.579010:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635276ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9185 expref: 231 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.579023:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635276ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9185 expref: 231 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.579043:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635276ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9185 expref: 231 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.579107:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:1.0:1789431567.579113:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635276ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.579122:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635276ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.579130:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635276ea lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.579159:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431567.579219:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c157480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:2349:x1876351933573632:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 232us (2403us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.579227:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16671
00010000:00010000:0.0:1789431567.579294:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635276ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.579306:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635276ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431567.579352:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:0.0:1789431567.579357:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431567.579378:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635276ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.579410:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635276e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c919a expref: 230 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.579431:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635276ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c919a expref: 229 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.579439:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:0.0:1789431567.579443:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431567.579446:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ac600, rc 0)
00000100:00100000:0.0:1789431567.579473:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14617:x1876351933573248:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 18150us (18439us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431567.579481:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296227
00000100:00100000:0.0:1789431567.579497:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933573504
00000100:00100000:0.0:1789431567.579501:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933573504
00000100:00100000:0.0:1789431567.579535:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296228
00000100:00100000:0.0:1789431567.579543:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14616:x1876351933573504:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431567.579560:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431567.579575:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635276f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c91a1 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.579633:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.579646:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635276dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9193 expref: 230 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.579668:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276ff lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.581912:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635276dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9193 expref: 230 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.581937:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635276dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9193 expref: 230 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.581956:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3c157800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894250624:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431567.583415:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba39600 going to sleep for 11 seconds
00000100:00100000:1.0:1789431567.594444:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3c157800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894250624:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431567.594446:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431567.594475:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.594546:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933573760
00000100:00100000:2.0:1789431567.594554:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933573760
00010000:00010000:2.0:1789431567.594588:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635276dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9193 expref: 231 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.594623:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16672
00000100:00100000:2.0:1789431567.594631:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a045500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:2348:x1876351933573760:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431567.594651:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431567.594658:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635276dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9193 expref: 231 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.594670:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635276dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9193 expref: 231 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.594691:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635276dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9193 expref: 231 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.594715:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431567.594720:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.594728:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.594735:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276ff lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.594919:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431567.595013:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.595021:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431567.595105:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:1.0:1789431567.595110:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431567.595130:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.595161:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635276f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91a1 expref: 231 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.595176:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91a1 expref: 230 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.595184:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:1.0:1789431567.595186:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431567.595189:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2800, rc 0)
00000100:00100000:2.0:1789431567.595453:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a045500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:2348:x1876351933573760:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 821us (1015us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.595462:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16672
00000100:00100000:1.0:1789431567.596334:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14616:x1876351933573504:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 16788us (19577us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.596344:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296228
00000100:00100000:2.0:1789431567.596880:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.597225:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933574016
00000100:00100000:1.0:1789431567.597244:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933574016
00000100:00100000:1.0:1789431567.597290:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12528
00000100:00100000:1.0:1789431567.597299:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14617:x1876351933574016:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431567.597667:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14617:x1876351933574016:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 367us (787us total) trans 4295121114 rc 0/0
00000100:00100000:1.0:1789431567.597675:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12528
00000100:00100000:0.0:1789431567.606622:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.606720:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933574144
00000100:00100000:1.0:1789431567.606730:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933574144
00000100:00100000:1.0:1789431567.606790:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296229
00000100:00100000:1.0:1789431567.606802:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14617:x1876351933574144:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.606825:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.606846:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527706 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c91a8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.606910:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352770d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.606925:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352770d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.606938:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352770d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.606952:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527714 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.606959:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.606965:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.607103:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352771b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.607113:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352771b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.607121:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352771b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431567.607154:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:1.0:1789431567.607159:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431567.607178:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352771b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.607194:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352771b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.607203:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352770d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.607210:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352770d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.607216:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352770d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.607222:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.607226:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352770d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.608201:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352770d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.608215:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431567.608218:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.608224:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352770d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.609145:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352770d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.609165:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.609173:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527714 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.609181:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.609187:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.609191:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.609198:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527714 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.609209:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce03149300)
00010000:00010000:1.0:1789431567.609212:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.609215:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527714 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.609221:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527714 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.609395:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527706 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91a8 expref: 232 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.609412:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352771b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91a8 expref: 231 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.609420:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:1.0:1789431567.609423:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431567.609426:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308600, rc 0)
00000100:00100000:1.0:1789431567.609543:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14617:x1876351933574144:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2742us (2930us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.609556:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296229
00000100:00100000:2.0:1789431567.612818:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.612990:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.613797:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933574528
00000100:00100000:1.0:1789431567.613809:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933574528
00000100:00100000:1.0:1789431567.613920:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1308
00000100:00100000:1.0:1789431567.613932:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2ad6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fbca16f1-ddd0-4a1e-a69e-4d5ed8005437+10:2348:x1876351933574528:12345-192.168.203.4@tcp:400:kworker.0
00000100:00100000:1.0:1789431567.614002:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2ad6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fbca16f1-ddd0-4a1e-a69e-4d5ed8005437+10:2348:x1876351933574528:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (1011us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.614009:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1308
00000100:00100000:0.0:1789431567.617373:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933574400
00000100:00100000:0.0:1789431567.617387:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933574400
00000100:00100000:0.0:1789431567.617511:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12529
00000100:00100000:0.0:1789431567.617522:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14616:x1876351933574400:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431567.619263:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14616:x1876351933574400:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 1735us (6445us total) trans 4295121115 rc 0/0
00000100:00100000:0.0:1789431567.619275:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12529
00000100:00100000:2.0:1789431567.621665:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.621724:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.621909:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933574656
00000100:00100000:1.0:1789431567.621919:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933574656
00000100:00100000:1.0:1789431567.621981:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14372
00000100:00100000:1.0:1789431567.621992:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:2350:x1876351933574656:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431567.622007:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431567.622032:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb6352771b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91a8 expref: 232 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622071:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:1.0:1789431567.622076:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431567.622124:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:2350:x1876351933574656:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 134us (478us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.622132:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14372
00000100:00100000:1.0:1789431567.622169:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933574784
00000100:00100000:1.0:1789431567.622173:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933574784
00000100:00100000:1.0:1789431567.622197:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296230
00000100:00100000:1.0:1789431567.622204:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14617:x1876351933574784:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.622223:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.622252:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527722 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c91af expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622318:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527729 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622331:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527729 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622341:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527729 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622355:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527730 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622362:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622369:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622421:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527729 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622429:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527729 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622436:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527729 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622442:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.622446:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527729 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622453:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527729 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622461:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431567.622464:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.622468:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527729 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622473:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527729 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622481:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622486:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527730 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622492:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527730 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622497:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.622499:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527730 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622505:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527730 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622511:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xbb97fc59 (ffff90ce03149300)
00010000:00010000:1.0:1789431567.622514:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.622516:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527730 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622521:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527730 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622548:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527722 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91af expref: 232 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622557:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431567.622559:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.622562:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527722 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91af expref: 232 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.622570:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309000, rc 0)
00000100:00100000:1.0:1789431567.622594:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14617:x1876351933574784:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 391us (870us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431567.622601:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296230
00000100:00100000:2.0:1789431567.625241:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.625360:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933574912
00000100:00100000:1.0:1789431567.625371:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933574912
00000100:00100000:1.0:1789431567.625430:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296231
00000100:00100000:1.0:1789431567.625439:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14616:x1876351933574912:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.625462:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.625483:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527737 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c91b6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.625545:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352773e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.625564:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352773e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.625575:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352773e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.625587:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527745 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.625593:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.625599:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.625828:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352774c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.625839:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352774c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.625847:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352774c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431567.625889:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:1.0:1789431567.625894:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431567.625913:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352774c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.625924:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352774c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.625936:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352773e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.625942:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352773e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.625948:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352773e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.625953:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.625958:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352773e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.625965:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352773e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.625975:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431567.625978:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.625982:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352773e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.625989:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352773e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.626002:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.626008:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527745 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.626015:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527745 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.626021:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.626024:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527745 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.626031:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527745 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.626038:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce03149200)
00010000:00010000:1.0:1789431567.626040:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.626042:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527745 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.626085:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527745 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.626114:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527737 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91b6 expref: 233 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.626127:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352774c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91b6 expref: 232 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.626135:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:1.0:1789431567.626137:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431567.626140:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:1.0:1789431567.626188:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14616:x1876351933574912:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 751us (967us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.626194:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296231
00000100:00100000:3.0:1789431567.628296:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.628511:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933575040
00000100:00100000:1.0:1789431567.628521:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933575040
00000100:00100000:1.0:1789431567.628578:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296232
00000100:00100000:1.0:1789431567.628588:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14617:x1876351933575040:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.628606:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.628624:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527753 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c91bd expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.628693:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352775a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.628819:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352775a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.628834:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352775a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431567.628915:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008c:0x0]: returning size 16384
00000004:00200000:1.0:1789431567.628920:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431567.628940:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352775a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.628967:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527753 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91bd expref: 234 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.628985:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352775a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91bd expref: 233 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.628993:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431567.628995:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431567.628999:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309c00, rc 0)
00000100:00100000:1.0:1789431567.629041:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14617:x1876351933575040:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 456us (755us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.629072:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296232
00000100:00100000:2.0:1789431567.635105:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.635208:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.635244:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933575552
00000100:00100000:2.0:1789431567.635254:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933575552
00000100:00100000:2.0:1789431567.635312:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14373
00000100:00100000:2.0:1789431567.635323:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:2347:x1876351933575552:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431567.635338:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431567.635363:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352774c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91b6 expref: 233 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.635388:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431567.635392:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431567.635438:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:2347:x1876351933575552:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 118us (230us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.635445:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14373
00000100:00100000:1.0:1789431567.635573:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933575168
00000100:00100000:1.0:1789431567.635579:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933575168
00000100:00100000:1.0:1789431567.635616:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12530
00000100:00100000:1.0:1789431567.635623:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14617:x1876351933575168:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:2.0:1789431567.639501:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.639586:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933575424
00000100:00100000:1.0:1789431567.639597:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933575424
00000100:00100000:1.0:1789431567.639733:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296233
00000100:00100000:1.0:1789431567.639744:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14616:x1876351933575424:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.639766:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.639787:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63527761 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c91c4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.639887:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63527768 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.639902:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91a1 expref: 235 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.639911:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63527768 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.639944:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91a1 expref: 235 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.639964:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91a1 expref: 235 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.639977:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b9d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894250752:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431567.640089:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1e8c9840 going to sleep for 11 seconds
00000100:00100000:0.0:1789431567.643130:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14617:x1876351933575168:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 7497us (8023us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431567.643143:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12530
00000100:00100000:1.0:1789431567.646934:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b9d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894250752:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431567.646964:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63527768 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.647019:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431567.647131:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933575680
00000100:00100000:0.0:1789431567.647139:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933575680
00010000:00010000:0.0:1789431567.647177:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91a1 expref: 234 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.647211:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16673
00000100:00100000:0.0:1789431567.647220:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb06050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:2348:x1876351933575680:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431567.647242:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431567.647250:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91a1 expref: 234 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.647261:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91a1 expref: 234 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.647284:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635276ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91a1 expref: 234 pid: 12775 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.647299:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:0.0:1789431567.647303:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63527768 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.647313:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63527768 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.647320:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63527768 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.647348:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431567.647390:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb06050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:2348:x1876351933575680:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 171us (371us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431567.647398:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16673
00010000:00010000:2.0:1789431567.647557:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63527768 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.647565:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63527768 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431567.647582:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00010000:00010000:2.0:1789431567.647801:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00030e00/0xd8e438fb63527761 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91c4 expref: 234 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.647817:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63527768 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91c4 expref: 233 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.647824:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431567.647827:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431567.647829:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf00031400, rc 0)
00000100:00100000:2.0:1789431567.647855:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14616:x1876351933575424:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8114us (8363us total) trans 4295121116 rc 0/0
00000100:00100000:2.0:1789431567.647862:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296233
00000100:00100000:3.0:1789431567.653613:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.653840:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933575808
00000100:00100000:1.0:1789431567.653851:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933575808
00000100:00100000:1.0:1789431567.653947:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296234
00000100:00100000:1.0:1789431567.653958:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14616:x1876351933575808:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.653981:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.654002:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527776 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c91cb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.654120:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352777d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.654135:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63527768 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91c4 expref: 234 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.654143:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352777d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.654178:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63527768 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91c4 expref: 234 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.654190:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63527768 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91c4 expref: 234 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.654203:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b9d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894250880:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431567.654293:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1e8c9840 going to sleep for 11 seconds
00000100:00100000:2.0:1789431567.657885:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.657947:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933575936
00000100:00100000:3.0:1789431567.657958:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933575936
00010000:00010000:3.0:1789431567.657998:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63527768 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91c4 expref: 235 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.658041:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16674
00000100:00100000:3.0:1789431567.658083:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:2347:x1876351933575936:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431567.658098:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431567.658106:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63527768 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91c4 expref: 235 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.658120:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63527768 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91c4 expref: 235 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.658141:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:3.0:1789431567.658146:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352777d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.658156:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352777d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.658168:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352777d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.658187:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431567.658242:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:2347:x1876351933575936:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 193us (364us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431567.658249:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16674
00010000:00010000:1.0:1789431567.658821:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf00031400/0xd8e438fb63527768 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91c4 expref: 234 pid: 5847 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.658839:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b9d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894250880:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431567.658861:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352777d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.658871:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352777d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.658877:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352777d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431567.658922:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:1.0:1789431567.658927:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431567.658947:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352777d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.658979:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527776 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91cb expref: 234 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.659000:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352777d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91cb expref: 233 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.659008:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:1.0:1789431567.659011:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431567.659014:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309e00, rc 0)
00000100:00100000:1.0:1789431567.659144:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14616:x1876351933575808:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 5188us (5540us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.659152:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296234
00000100:00100000:2.0:1789431567.663940:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.664087:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933576064
00000100:00100000:1.0:1789431567.664096:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933576064
00000100:00100000:1.0:1789431567.664146:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296235
00000100:00100000:1.0:1789431567.664157:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14617:x1876351933576064:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.664175:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.664195:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527784 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c91d2 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664257:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352778b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664270:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352778b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664281:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352778b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664294:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527792 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664500:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664508:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664565:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352778b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664572:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352778b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664579:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352778b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664584:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.664588:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352778b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664596:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352778b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664607:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431567.664610:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.664615:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352778b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664621:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352778b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664633:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664639:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527792 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664645:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527792 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664649:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.664652:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527792 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664659:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527792 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664666:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xbb97fc59 (ffff90ce03149200)
00010000:00010000:1.0:1789431567.664669:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.664672:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527792 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664677:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527792 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664718:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527784 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91d2 expref: 234 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664728:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431567.664730:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.664734:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527784 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91d2 expref: 234 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.664748:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308c00, rc 0)
00000100:00100000:1.0:1789431567.664883:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14617:x1876351933576064:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 726us (950us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431567.664890:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296235
00010000:00010000:1.0:1789431567.665223:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431567.676926:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.677036:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933576192
00000100:00100000:1.0:1789431567.677075:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933576192
00000100:00100000:1.0:1789431567.677133:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296236
00000100:00100000:1.0:1789431567.677143:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14616:x1876351933576192:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.677162:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.677182:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527799 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c91d9 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677252:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635277a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677267:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635277a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677279:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635277a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677306:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635277a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677314:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635277a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677326:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635277a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677425:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635277ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677434:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635277ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677442:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635277ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431567.677475:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:1.0:1789431567.677479:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431567.677495:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635277ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677504:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635277ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677512:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635277a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677518:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635277a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677523:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635277a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677529:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.677545:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635277a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677559:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635277a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677570:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431567.677573:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.677578:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635277a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677584:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb635277a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677598:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635277a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677604:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635277a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677610:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635277a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677615:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.677618:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635277a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677624:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635277a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677631:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce03149300)
00010000:00010000:1.0:1789431567.677634:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.677638:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635277a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677653:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb635277a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677686:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527799 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91d9 expref: 235 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677711:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635277ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91d9 expref: 234 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.677728:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:1.0:1789431567.677730:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431567.677733:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:1.0:1789431567.677791:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14616:x1876351933576192:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 650us (876us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.677798:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296236
00000100:00100000:3.0:1789431567.685597:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.685693:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933576448
00000100:00100000:2.0:1789431567.685711:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933576448
00000100:00100000:2.0:1789431567.685774:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 522
00000100:00100000:2.0:1789431567.685783:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14617:x1876351933576448:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431567.685833:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431567.685861:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635276ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c919a expref: 234 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.685883:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:2.0:1789431567.685910:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352775a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91bd expref: 233 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.685921:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431567.685925:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431567.685953:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635277b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.685966:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635277b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.685976:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635277b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.685992:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb635277bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.685999:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb635277bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.686005:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb635277bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.686017:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635277c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.686024:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635277c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.686031:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635277c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.686198:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635277ca lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.686207:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635277ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.686215:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635277ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431567.686932:0:5861:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000eb20e9b1 reply state 000000006f843704 transno 4295121117 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635277ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.686943:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000004:00010000:2.0:1789431567.686949:0:5861:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000eb20e9b1 reply state 000000006f843704 transno 4295121117 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635277c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.686954:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 1
00010000:00010000:2.0:1789431567.686958:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635277b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.686967:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635277b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.686974:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635277b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.686980:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431567.686985:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635277b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.686994:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635277b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.687006:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431567.687009:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431567.687013:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635277b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.687019:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635277b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431567.687029:0:5861:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000eb20e9b1 reply state 000000006f843704 transno 4295121117 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb635277bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.687034:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 2
00000100:00100000:2.0:1789431567.687520:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14617:x1876351933576448:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1732us (1927us total) trans 4295121117 rc 0/0
00000100:00100000:2.0:1789431567.687529:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 522
00000100:00100000:3.0:1789431567.688490:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431567.690677:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb635277bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690694:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb635277bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690720:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb635277bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690727:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.690732:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb635277bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690739:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb635277bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690756:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90cf13195d00)
00010000:00010000:3.0:1789431567.690759:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.690764:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb635277bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690775:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522000/0xd8e438fb635277bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690795:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635277c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690801:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635277c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690807:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635277c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690812:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.690815:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635277c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690821:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635277c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690828:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xbb97fc59 (ffff90cf13195b00)
00010000:00010000:3.0:1789431567.690831:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.690834:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635277c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690840:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635277c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690853:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635277ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690858:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635277ca lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690864:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635277ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690870:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.690873:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635277ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690878:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635277ca lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690885:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431567.690888:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:3.0:1789431567.690891:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635277ca lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.690896:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635277ca lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.692817:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.694194:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933576704
00000100:00100000:1.0:1789431567.694209:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933576704
00000100:00100000:1.0:1789431567.694270:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933576832
00000100:00100000:1.0:1789431567.694274:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933576832
00000100:00100000:1.0:1789431567.694306:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296237
00000100:00100000:1.0:1789431567.694316:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14616:x1876351933576704:12345-192.168.203.4@tcp:36:dbench.0
00000100:00100000:3.0:1789431567.694343:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296238
00000100:00100000:3.0:1789431567.694356:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14617:x1876351933576832:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.694374:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:3.0:1789431567.694374:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431567.694397:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635277d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c91e0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.694404:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635277ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91d9 expref: 234 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.694428:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352777d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91cb expref: 234 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.694440:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:1.0:1789431567.694446:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431567.694455:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635277d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.694469:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635277d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.694481:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635277d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.694484:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635277df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.694497:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635277df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.694500:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635277e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.694509:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635277df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.694513:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635277e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.694524:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635277e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431567.694654:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000073f0c3f1 reply state 00000000e7bfb907 transno 4295121118 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635277df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.694665:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431567.694766:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14616:x1876351933576704:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 452us (6281us total) trans 4295121118 rc 0/0
00000100:00100000:1.0:1789431567.694774:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296237
00010000:00010000:3.0:1789431567.694822:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635277d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.694831:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635277d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.694908:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635277d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.694914:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.694919:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635277d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.694927:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635277d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.694936:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431567.694940:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.694944:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635277d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.694959:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb635277d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.694973:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635277e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.694979:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635277e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.694985:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635277e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.694989:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ace00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.695317:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635277e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.695326:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635277e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.695335:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431567.695337:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.695395:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635277e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.695403:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635277e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.695441:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635277d1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91e0 expref: 234 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.695455:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431567.695458:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.695461:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad000/0xd8e438fb635277d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91e0 expref: 234 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.695469:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad000, rc 0)
00000100:00100000:3.0:1789431567.695518:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14617:x1876351933576832:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1165us (2710us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431567.695527:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296238
00010000:00010000:2.0:1789431567.699119:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635277df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.699140:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635277df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.699146:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635277df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.699152:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431567.699157:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635277df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.699164:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635277df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.699180:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431567.699183:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431567.699188:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635277df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.699193:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb635277df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.704121:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.704152:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.704227:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933577088
00000100:00100000:1.0:1789431567.704237:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933577088
00000100:00100000:1.0:1789431567.704295:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296239
00000100:00100000:1.0:1789431567.704313:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14617:x1876351933577088:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.704336:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.704355:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635277ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c91e7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.704414:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635277f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.704428:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635277f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.704439:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635277f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431567.704472:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008c:0x0]: returning size 16384
00000004:00200000:1.0:1789431567.704476:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431567.704493:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635277f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.704517:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635277ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91e7 expref: 234 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.704534:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635277f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91e7 expref: 233 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.704541:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431567.704544:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431567.704547:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:1.0:1789431567.704604:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14617:x1876351933577088:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 292us (449us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.704611:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296239
00000100:00100000:0.0:1789431567.704891:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933576960
00000100:00100000:0.0:1789431567.704896:0:14490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933576960
00000100:00100000:0.0:1789431567.704936:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8387
00000100:00100000:0.0:1789431567.704944:0:14490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2349:x1876351933576960:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:0.0:1789431567.705137:0:14490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x518:0x0] updating lvb size from disk: 83190 -> 83190
00002000:00010000:0.0:1789431567.705142:0:14490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x518:0x0] updating lvb mtime from disk: 1789431554 -> 1789431542
00002000:00010000:0.0:1789431567.705145:0:14490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x518:0x0] updating lvb atime from disk: 1789431545 -> 1789431557
00002000:00010000:0.0:1789431567.705147:0:14490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x518:0x0] updating lvb ctime from disk: 1789431566 -> 1789431567
00002000:00010000:0.0:1789431567.705149:0:14490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x518:0x0] updating lvb blocks from disk: 259 -> 259
00000100:00100000:0.0:1789431567.705183:0:14490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2349:x1876351933576960:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 239us (1071us total) trans 4294970063 rc 0/0
00000100:00100000:0.0:1789431567.705190:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8387
00000100:00100000:2.0:1789431567.719730:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.719783:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.719868:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933577344
00000100:00100000:3.0:1789431567.719878:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933577344
00000100:00100000:3.0:1789431567.719945:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12531
00000100:00100000:3.0:1789431567.719957:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14617:x1876351933577344:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431567.721315:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933577216
00000100:00100000:0.0:1789431567.721327:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933577216
00000100:00100000:0.0:1789431567.721392:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296240
00000100:00100000:0.0:1789431567.721402:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14616:x1876351933577216:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431567.721418:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431567.721440:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635277fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c91ee expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721501:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527802 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721516:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527802 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721533:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527802 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721548:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527809 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721556:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721563:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721619:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527802 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721627:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527802 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721634:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527802 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721640:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431567.721644:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527802 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721651:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527802 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721663:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431567.721665:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.721671:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527802 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721677:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527802 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721689:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721705:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527809 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721711:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721716:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431567.721719:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721724:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527809 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721731:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xbb97fc59 (ffff90ce07190b00)
00010000:00010000:0.0:1789431567.721733:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.721736:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527809 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721741:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527809 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721772:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635277fb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91ee expref: 235 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721787:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431567.721789:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.721793:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb635277fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91ee expref: 235 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.721802:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2800, rc 0)
00000100:00100000:0.0:1789431567.721865:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14616:x1876351933577216:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 465us (2144us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431567.721872:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296240
00000100:00100000:3.0:1789431567.726722:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.726811:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933577472
00000100:00100000:1.0:1789431567.726821:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933577472
00000100:00100000:1.0:1789431567.726883:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296241
00000100:00100000:1.0:1789431567.726903:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14616:x1876351933577472:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.726926:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.726950:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527810 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c91f5 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.727027:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527817 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.727042:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.727089:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431567.727127:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008d:0x0]: returning size 16384
00000004:00200000:1.0:1789431567.727131:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431567.727150:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.727176:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527810 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91f5 expref: 236 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.727194:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91f5 expref: 235 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.727202:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431567.727205:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431567.727210:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308600, rc 0)
00000100:00100000:1.0:1789431567.727726:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14616:x1876351933577472:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 831us (1010us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.727738:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296241
00000100:00100000:2.0:1789431567.736297:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14617:x1876351933577344:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 16334us (16505us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.736310:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12531
00000100:00100000:3.0:1789431567.740524:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431567.740654:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933577600
00000100:00100000:0.0:1789431567.740664:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933577600
00000100:00100000:0.0:1789431567.740735:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12532
00000100:00100000:0.0:1789431567.740750:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14616:x1876351933577600:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:2.0:1789431567.751436:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14616:x1876351933577600:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 10678us (10912us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.751448:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12532
00000100:00100000:3.0:1789431567.758963:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.759008:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.760521:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933577856
00000100:00100000:1.0:1789431567.760534:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933577856
00000100:00100000:1.0:1789431567.760594:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933578112
00000100:00100000:1.0:1789431567.760598:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933578112
00000100:00100000:1.0:1789431567.760642:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296242
00000100:00100000:1.0:1789431567.760653:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14617:x1876351933577856:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.760675:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.760779:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352781e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c91fc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.760852:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527825 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.760866:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527825 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.760878:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527825 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.760903:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352782c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.760910:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352782c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.760917:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352782c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.760968:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527825 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.760975:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527825 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.760982:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527825 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.760987:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.760992:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527825 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.761000:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527825 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.761011:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431567.761013:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.761019:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527825 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.761025:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527825 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.761038:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352782c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.761043:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352782c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.761090:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352782c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.761095:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.761097:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352782c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.761103:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352782c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.761109:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce03149300)
00010000:00010000:1.0:1789431567.761111:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.761114:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352782c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.761118:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352782c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.761148:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352781e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91fc expref: 236 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.761157:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431567.761159:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:1.0:1789431567.761163:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb6352781e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91fc expref: 236 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.761171:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309e00, rc 0)
00000100:00100000:1.0:1789431567.761244:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14617:x1876351933577856:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 593us (2291us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431567.761251:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296242
00000100:00100000:1.0:1789431567.761270:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296243
00000100:00100000:1.0:1789431567.761278:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14616:x1876351933578112:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.761285:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.761288:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:1.0:1789431567.762180:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527817 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91f5 expref: 234 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.762201:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431567.762204:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431567.762219:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527833 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9203 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.763012:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352783a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.763028:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352783a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.763038:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352783a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.763213:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527841 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.763223:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527841 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.763230:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527841 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:1.0:1789431567.767325:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x519:0x0], index 1: 0
00010000:00010000:1.0:1789431567.767514:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527848 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.767531:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.767547:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.767584:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352783a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.767591:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352783a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.767599:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352783a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.767605:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.767609:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352783a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.767616:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352783a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.767627:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431567.767630:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.767635:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352783a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.767641:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352783a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431567.767655:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008ac23e3c reply state 00000000b577f61d transno 4295121119 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527841 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.767663:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431567.767708:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527833 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9203 expref: 236 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.767724:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9203 expref: 235 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.767732:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aaf:0x0].0x0 (ffff90ce03149a00)
00010000:00010000:1.0:1789431567.767735:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431567.767737:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309200, rc 0)
00000100:00100000:1.0:1789431567.768448:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14616:x1876351933578112:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7166us (9435us total) trans 4295121119 rc 0/0
00000100:00100000:1.0:1789431567.768458:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296243
00000100:00100000:3.0:1789431567.773725:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.773813:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933578368
00000100:00100000:1.0:1789431567.773823:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933578368
00000100:00100000:1.0:1789431567.773880:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296244
00000100:00100000:1.0:1789431567.773889:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14617:x1876351933578368:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.773920:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.773923:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:1.0:1789431567.773947:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635277f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c91e7 expref: 236 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.773966:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431567.773973:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431567.773984:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527856 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c920a expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.774125:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352785d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.774143:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352785d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.774152:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352785d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.774167:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858a00/0xd8e438fb63527864 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.774174:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858a00/0xd8e438fb63527864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.774181:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858a00/0xd8e438fb63527864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:1.0:1789431567.774653:0:6797:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x51a:0x0], index 0: 0
00010000:00010000:1.0:1789431567.774818:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb6352786b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.774828:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb6352786b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.774836:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb6352786b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.774868:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352785d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.774875:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352785d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.774882:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352785d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.774888:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.774893:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352785d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.774900:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352785d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.774910:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431567.774913:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.774917:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352785d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.774924:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352785d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431567.774936:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002dcdd682 reply state 000000008484c3fb transno 4295121120 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858a00/0xd8e438fb63527864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.774945:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431567.774972:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527856 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c920a expref: 238 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.774986:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb6352786b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c920a expref: 237 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.774994:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90ce03149700)
00010000:00010000:1.0:1789431567.774996:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431567.774998:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce19858800, rc 0)
00000100:00100000:1.0:1789431567.775087:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+238:14617:x1876351933578368:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1198us (1370us total) trans 4295121120 rc 0/0
00000100:00100000:1.0:1789431567.775096:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296244
00010000:00010000:3.0:1789431567.775988:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527841 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.776001:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527841 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.776006:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527841 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.776016:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.776019:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527841 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.776026:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527841 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.776038:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xbb97fc59 (ffff90ce03149200)
00010000:00010000:3.0:1789431567.776041:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.776044:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527841 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.776083:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527841 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.777984:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858a00/0xd8e438fb63527864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.778000:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858a00/0xd8e438fb63527864 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.778008:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858a00/0xd8e438fb63527864 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.778013:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce19858a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431567.778017:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858a00/0xd8e438fb63527864 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.778026:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858a00/0xd8e438fb63527864 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.778042:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce03149c00)
00010000:00010000:2.0:1789431567.778045:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431567.778088:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858a00/0xd8e438fb63527864 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.778093:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858a00/0xd8e438fb63527864 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.785043:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.785195:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933578496
00000100:00100000:2.0:1789431567.785206:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933578496
00000100:00100000:2.0:1789431567.785270:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8388
00000100:00100000:2.0:1789431567.785280:0:14500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2348:x1876351933578496:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431567.785298:0:14500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431567.785319:0:14500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026047ea6/0xd8e438fb63527879 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9211 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789431567.785348:0:14500:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x519:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:2.0:1789431567.785369:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x519:0x0].0x0 since=3025s v=(0 0)
00010000:00010000:2.0:1789431567.785374:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x519:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431567.785383:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026047ea6/0xd8e438fb63527879 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9211 expref: 70 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.785401:0:14500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000026047ea6/0xd8e438fb63527879 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9211 expref: 70 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.785415:0:14500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522400, rc 0)
00000100:00100000:2.0:1789431567.785467:0:14500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2348:x1876351933578496:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 188us (435us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.785474:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8388
00000100:00100000:3.0:1789431567.789036:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.789167:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933578624
00000100:00100000:1.0:1789431567.789176:0:14472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933578624
00000100:00100000:1.0:1789431567.789245:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8389
00000100:00100000:1.0:1789431567.789255:0:14472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2347:x1876351933578624:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.789274:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.789295:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb63527880 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x51a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9218 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789431567.789324:0:14472:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x51a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:1.0:1789431567.789344:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51a:0x0].0x0 since=3025s v=(0 0)
00010000:00010000:1.0:1789431567.789349:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51a:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431567.789358:0:14472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb63527880 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9218 expref: 69 pid: 14472 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.789376:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb63527880 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9218 expref: 69 pid: 14472 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.789389:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce19859200, rc 0)
00000100:00100000:1.0:1789431567.789438:0:14472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2347:x1876351933578624:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 185us (412us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.789445:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8389
00000100:00100000:0.0:1789431567.794434:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431567.794476:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.794557:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933579008
00000100:00100000:2.0:1789431567.794567:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933579008
00000100:00100000:2.0:1789431567.794624:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12533
00000100:00100000:2.0:1789431567.794635:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14616:x1876351933579008:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431567.794994:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+237:14616:x1876351933579008:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 360us (516us total) trans 4295121121 rc 0/0
00000100:00100000:2.0:1789431567.795002:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12533
00000100:00100000:3.0:1789431567.795837:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933578752
00000100:00100000:3.0:1789431567.795845:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933578752
00000100:00100000:3.0:1789431567.795901:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8390
00000100:00100000:3.0:1789431567.795911:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:14617:x1876351933578752:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431567.795925:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431567.795941:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1bf7dc6/0xd8e438fb63527887 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x51a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c921f expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.795973:0:14497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb63527880 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x51a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9218 expref: 70 pid: 14472 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.795982:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51a:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431567.795987:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51a:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431567.795993:0:14497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1bf7dc6/0xd8e438fb63527887 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x51a:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c921f expref: 70 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.796024:0:14497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb63527880 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9218 expref: 70 pid: 14472 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.796038:0:14497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb63527880 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x51a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9218 expref: 70 pid: 14472 timeout: 3125 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.796174:0:14497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14497:1876351894251008:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431567.796349:0:14497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf18a0bb40 going to sleep for 11 seconds
00000100:00100000:0.0:1789431567.803563:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.803755:0:14497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14497:1876351894251008:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431567.803789:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1bf7dc6/0xd8e438fb63527887 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x51a:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c921f expref: 70 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.803810:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad000, rc 0)
00000100:00100000:3.0:1789431567.803871:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:14617:x1876351933578752:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7961us (9448us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431567.803880:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8390
00000100:00100000:1.0:1789431567.804594:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933579264
00000100:00100000:1.0:1789431567.804602:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933579264
00000100:00100000:1.0:1789431567.804655:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12534
00000100:00100000:1.0:1789431567.804665:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+237:14616:x1876351933579264:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431567.804903:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+238:14616:x1876351933579264:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 239us (1349us total) trans 4295121122 rc 0/0
00000100:00100000:1.0:1789431567.804910:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12534
00000100:00100000:0.0:1789431567.806137:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.806270:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933579392
00000100:00100000:2.0:1789431567.806278:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933579392
00010000:00010000:2.0:1789431567.806313:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb63527880 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x51a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9218 expref: 70 pid: 14472 timeout: 3125 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.806359:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16675
00000100:00100000:2.0:1789431567.806367:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2348:x1876351933579392:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431567.806381:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431567.806404:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb63527880 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x51a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9218 expref: 70 pid: 14472 timeout: 3125 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.806418:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb63527880 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9218 expref: 70 pid: 14472 timeout: 3125 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.806440:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d26bf503/0xd8e438fb63527880 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x51a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9218 expref: 70 pid: 14472 timeout: 3125 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.806457:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51a:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431567.806461:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51a:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431567.806468:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1bf7dc6/0xd8e438fb63527887 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c921f expref: 69 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.806479:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1bf7dc6/0xd8e438fb63527887 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x51a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c921f expref: 69 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.806515:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d1bf7dc6/0xd8e438fb63527887 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x51a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c921f expref: 69 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.806529:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3babc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5834:1876351894251136:192.168.203.4@tcp:105:
00000100:00100000:2.0:1789431567.806603:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead240 going to sleep for 11 seconds
00000100:00100000:2.0:1789431567.809706:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3babc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5834:1876351894251136:192.168.203.4@tcp:105:
00010000:00010000:2.0:1789431567.809739:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431567.809834:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2348:x1876351933579392:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 3466us (3702us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.809845:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16675
00000100:00100000:0.0:1789431567.818377:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.820518:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933579648
00000100:00100000:3.0:1789431567.820531:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933579648
00000100:00100000:3.0:1789431567.820596:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296245
00000100:00100000:3.0:1789431567.820605:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+238:14616:x1876351933579648:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431567.820658:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431567.820683:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527848 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aaf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9203 expref: 238 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.820712:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aaf:0x0].0x0 (ffff90ce03149a00)
00010000:00010000:3.0:1789431567.820731:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431567.820753:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352788e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.820767:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352788e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.820776:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352788e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.820789:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527895 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.820795:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.820801:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.820911:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352789c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.820919:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352789c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aaf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.820926:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352789c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aaf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431567.821556:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1248, 64 off88128
00010000:00010000:3.0:1789431567.821613:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635278a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aaf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821623:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635278a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aaf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821631:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635278a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aaf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821639:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635278a3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aaf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821645:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635278a3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aaf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821652:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635278a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aaf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821814:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1789431567.821834:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352789c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aaf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821841:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352789c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aaf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821848:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352789c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aaf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821854:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.821858:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352789c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aaf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821865:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352789c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aaf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821876:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aaf:0x0].0x0 (ffff90cf18b78100)
00010000:00010000:3.0:1789431567.821879:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431567.821883:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352789c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aaf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821889:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352789c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aaf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821906:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352788e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821914:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352788e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821919:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352788e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821924:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ace00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.821927:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352788e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821933:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352788e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821940:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431567.821942:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.821945:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352788e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.821951:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352788e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431567.821964:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f03cc97c reply state 00000000430735e5 transno 4295121123 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.821972:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431567.822066:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+239:14616:x1876351933579648:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1441us (3677us total) trans 4295121123 rc 0/0
00000100:00100000:3.0:1789431567.822075:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296245
00010000:00010000:2.0:1789431567.824790:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431567.824804:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635278a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aaf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.824815:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431567.824819:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635278a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aaf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.824829:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635278a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aaf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.824846:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aaf:0x0].0x0 (ffff90cf18b78100)
00010000:00010000:2.0:1789431567.824849:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431567.824854:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635278a3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10aaf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.824860:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635278a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aaf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.824880:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431567.824882:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431567.824884:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431567.825440:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.825450:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527895 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.825456:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527895 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.825462:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.825466:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527895 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.825472:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527895 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.825482:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xbb97fc59 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431567.825485:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.825488:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527895 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.825494:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527895 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.831562:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.831860:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933579776
00000100:00100000:2.0:1789431567.831871:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933579776
00000100:00100000:2.0:1789431567.831943:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296246
00000100:00100000:2.0:1789431567.831953:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+238:14616:x1876351933579776:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431567.831976:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431567.831997:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635278aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9226 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832252:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635278b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832269:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635278b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832280:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635278b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832294:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832301:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832307:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832393:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635278bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832400:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635278bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832407:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635278bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431567.832440:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:2.0:1789431567.832444:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431567.832460:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635278bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832472:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635278bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832480:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635278b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832487:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635278b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832494:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635278b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832500:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431567.832503:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635278b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832511:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635278b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832521:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431567.832524:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431567.832529:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635278b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832535:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635278b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832552:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832559:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832565:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832569:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431567.832572:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832577:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832583:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf13195b00)
00010000:00010000:2.0:1789431567.832585:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431567.832587:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832592:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832621:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635278aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9226 expref: 240 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832634:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635278bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9226 expref: 239 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.832647:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431567.832649:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431567.832652:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522200, rc 0)
00000100:00100000:2.0:1789431567.832779:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+239:14616:x1876351933579776:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 763us (1161us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.832786:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296246
00000100:00100000:1.0:1789431567.845673:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.845796:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933580032
00000100:00100000:2.0:1789431567.845808:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933580032
00000100:00100000:2.0:1789431567.845866:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296247
00000100:00100000:2.0:1789431567.845877:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+239:14616:x1876351933580032:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431567.845905:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431567.845927:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635278c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c922d expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.846030:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.846045:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635278bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9226 expref: 240 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.846098:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278cd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.846132:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635278bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9226 expref: 240 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.846146:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635278bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9226 expref: 240 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.846160:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3babc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894251264:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431567.846242:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead240 going to sleep for 11 seconds
00000100:00100000:0.0:1789431567.850501:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.850777:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933580288
00000100:00100000:2.0:1789431567.850788:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933580288
00000100:00100000:2.0:1789431567.850849:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12535
00000100:00100000:2.0:1789431567.850861:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+241:14617:x1876351933580288:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431567.852246:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+242:14617:x1876351933580288:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 1380us (1746us total) trans 4295121124 rc 0/0
00000100:00100000:2.0:1789431567.852257:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12535
00000100:00100000:2.0:1789431567.855290:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3babc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894251264:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431567.855323:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.858669:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.858908:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933580416
00000100:00100000:2.0:1789431567.858918:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933580416
00010000:00010000:2.0:1789431567.858957:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635278bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9226 expref: 242 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.858997:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16676
00000100:00100000:2.0:1789431567.859006:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+242:2347:x1876351933580416:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431567.859021:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431567.859027:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635278bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9226 expref: 242 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.859045:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635278bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9226 expref: 242 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.859106:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635278bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9226 expref: 242 pid: 12181 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.859120:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431567.859125:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.859134:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.859143:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278cd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.859167:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431567.859220:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+241:2347:x1876351933580416:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 215us (560us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431567.859236:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16676
00000100:00100000:0.0:1789431567.860162:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.860239:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933580672
00000100:00100000:3.0:1789431567.860246:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933580672
00000100:00100000:3.0:1789431567.860290:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296248
00000100:00100000:3.0:1789431567.860299:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+241:14617:x1876351933580672:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431567.860316:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431567.860333:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635278d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9234 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.860426:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635278db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.860441:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb6352786b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c920a expref: 242 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.860449:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635278db lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.860480:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb6352786b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c920a expref: 242 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.860493:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb6352786b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c920a expref: 242 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.860506:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e73100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894251392:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431567.860575:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf377c6f00 going to sleep for 11 seconds
00010000:00010000:1.0:1789431567.861665:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.861677:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431567.861702:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00010000:00010000:1.0:1789431567.861846:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb635278c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c922d expref: 244 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.861867:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c922d expref: 243 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.861875:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:1.0:1789431567.861877:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431567.861881:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522600, rc 0)
00000100:00100000:1.0:1789431567.861944:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+243:14616:x1876351933580032:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 16070us (16280us total) trans 4295121125 rc 0/0
00000100:00100000:1.0:1789431567.861952:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296247
00000100:00100000:0.0:1789431567.868538:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.868604:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933580800
00000100:00100000:1.0:1789431567.868614:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933580800
00010000:00010000:1.0:1789431567.868654:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb6352786b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c920a expref: 243 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.868711:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16677
00000100:00100000:1.0:1789431567.868721:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+243:2348:x1876351933580800:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431567.868735:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431567.868742:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb6352786b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c920a expref: 243 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.868754:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb6352786b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c920a expref: 243 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.868774:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90ce03149700)
00010000:00010000:1.0:1789431567.868781:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635278db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.868789:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635278db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.868797:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635278db lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.868816:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431567.868872:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+243:2348:x1876351933580800:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 152us (343us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.868879:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16677
00010000:00010000:3.0:1789431567.869226:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb6352786b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c920a expref: 242 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.869247:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e73100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894251392:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431567.869266:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635278db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.869274:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635278db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.869280:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635278db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431567.869298:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab0:0x0]: returning size 85026
00010000:00010000:3.0:1789431567.869437:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635278d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9234 expref: 243 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.869452:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635278db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9234 expref: 242 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.869458:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90ce03149700)
00010000:00010000:3.0:1789431567.869461:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431567.869463:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7acc00, rc 0)
00000100:00100000:3.0:1789431567.869493:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+242:14617:x1876351933580672:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9196us (9335us total) trans 4295121126 rc 0/0
00000100:00100000:3.0:1789431567.869500:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296248
00000100:00100000:0.0:1789431567.878270:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.878406:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933581056
00000100:00100000:1.0:1789431567.878416:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933581056
00000100:00100000:1.0:1789431567.878473:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296249
00000100:00100000:1.0:1789431567.878484:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+242:14617:x1876351933581056:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.878509:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.878530:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858a00/0xd8e438fb635278f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9242 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.878613:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb635278f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.878628:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635278db lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9234 expref: 243 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.878637:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb635278f7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.878670:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635278db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9234 expref: 243 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.878684:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635278db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9234 expref: 243 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431567.878708:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b9d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894251520:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431567.878789:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf22256e40 going to sleep for 11 seconds
00000100:00100000:1.0:1789431567.879015:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.879259:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933580928
00000100:00100000:3.0:1789431567.879266:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933580928
00000100:00100000:3.0:1789431567.879311:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296250
00000100:00100000:3.0:1789431567.879319:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b9d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14616:x1876351933580928:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431567.879331:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431567.879344:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635278fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c923b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.879391:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527905 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.879403:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278cd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c922d expref: 245 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.879410:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527905 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.879476:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c922d expref: 245 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.879486:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c922d expref: 245 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.879496:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e73100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894251648:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431567.879543:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf377c6780 going to sleep for 11 seconds
00000100:00100000:3.0:1789431567.886345:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e73100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894251648:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431567.886376:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527905 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.886462:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b9d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894251520:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431567.886478:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb635278f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431567.887368:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.887393:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431567.887535:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933581184
00000100:00100000:0.0:1789431567.887542:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933581184
00010000:00010000:0.0:1789431567.887577:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635278db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9234 expref: 246 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.887612:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933581312
00000100:00100000:0.0:1789431567.887615:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933581312
00010000:00010000:0.0:1789431567.887627:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c922d expref: 247 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.887656:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16678
00000100:00100000:0.0:1789431567.887666:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+247:2347:x1876351933581184:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431567.887679:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431567.887686:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635278db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9234 expref: 247 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.887707:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635278db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9234 expref: 247 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.887735:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635278db lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9234 expref: 247 pid: 5849 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.887752:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90ce03149700)
00010000:00010000:0.0:1789431567.887757:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb635278f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.887766:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb635278f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.887777:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb635278f7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.887802:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431567.887854:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+246:2347:x1876351933581184:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 189us (489us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431567.887860:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16678
00000100:00100000:0.0:1789431567.887880:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16679
00000100:00100000:0.0:1789431567.887900:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:2347:x1876351933581312:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431567.887908:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431567.887913:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c922d expref: 245 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.887922:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c922d expref: 245 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.887933:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635278cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c922d expref: 245 pid: 6797 timeout: 3125 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.887943:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:0.0:1789431567.887947:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527905 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.887955:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.887961:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527905 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.887974:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431567.887992:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:2347:x1876351933581312:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 94us (598us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431567.887999:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16679
00010000:00010000:0.0:1789431567.888107:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb635278f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.888114:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb635278f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431567.888155:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab0:0x0]: returning size 85026
00000004:00200000:0.0:1789431567.888159:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431567.888177:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb635278f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.888205:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858a00/0xd8e438fb635278f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9242 expref: 244 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.888218:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb635278f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9242 expref: 243 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.888224:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90ce03149700)
00010000:00010000:0.0:1789431567.888568:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431567.888575:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce19858800, rc 0)
00000100:00100000:0.0:1789431567.888605:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+243:14617:x1876351933581056:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10123us (10343us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431567.888612:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296249
00010000:00010000:3.0:1789431567.889110:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.889122:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431567.889156:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:3.0:1789431567.889160:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431567.889173:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.889198:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635278fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c923b expref: 243 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.889213:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c923b expref: 242 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.889220:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:3.0:1789431567.889223:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431567.889235:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad400, rc 0)
00000100:00100000:3.0:1789431567.889273:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b9d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+242:14616:x1876351933580928:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9955us (10259us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431567.889280:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296250
00000100:00100000:2.0:1789431567.900616:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.900739:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933581568
00000100:00100000:1.0:1789431567.900750:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933581568
00000100:00100000:1.0:1789431567.900807:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12536
00000100:00100000:1.0:1789431567.900817:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+242:14616:x1876351933581568:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431567.901082:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+243:14616:x1876351933581568:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 230us (439us total) trans 4295121127 rc 0/0
00000100:00100000:1.0:1789431567.901091:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12536
00000100:00100000:0.0:1789431567.911104:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.911192:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933581696
00000100:00100000:3.0:1789431567.911202:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933581696
00002000:00100000:3.0:1789431567.911259:0:14449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x51a:0x0] (0->85025)  req@ffff90cf3afcc700 x1876351933581696/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:38/0 lens 488/0 e 0 to 0 dl 1789431578 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431567.911271:0:14449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3afcc700 with x1876351933581696 ext(0->85025)
00002000:00010000:3.0:1789431567.911278:0:14449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3afcc700
00000100:00100000:3.0:1789431567.911300:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1565
00000100:00100000:3.0:1789431567.911309:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2347:x1876351933581696:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:0.0:1789431567.914124:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.914196:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933581824
00000100:00100000:1.0:1789431567.914206:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933581824
00000100:00100000:1.0:1789431567.914257:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296251
00000100:00100000:1.0:1789431567.914266:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+243:14616:x1876351933581824:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.914288:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.914307:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858a00/0xd8e438fb6352790c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9249 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914365:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63527913 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914378:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63527913 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914388:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63527913 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914403:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352791a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914410:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352791a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914417:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352791a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914514:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527921 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914528:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914535:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431567.914568:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:1.0:1789431567.914573:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431567.914591:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914603:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914611:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63527913 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914617:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63527913 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914623:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63527913 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914629:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce19859200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.914633:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63527913 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914640:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63527913 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914651:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431567.914655:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.914660:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63527913 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914666:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19859200/0xd8e438fb63527913 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914679:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352791a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914684:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352791a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914690:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352791a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914706:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431567.914708:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352791a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914714:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352791a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914721:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce03149900)
00010000:00010000:1.0:1789431567.914724:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431567.914727:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352791a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914733:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb6352791a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914762:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858a00/0xd8e438fb6352790c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9249 expref: 245 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914775:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9249 expref: 244 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.914782:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:1.0:1789431567.914785:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431567.914787:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309600, rc 0)
00000100:00100000:1.0:1789431567.914848:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14616:x1876351933581824:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 583us (732us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.914856:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296251
00000100:00100000:3.0:1789431567.922722:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2347:x1876351933581696:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 11404us (11617us total) trans 4294969667 rc 0/0
00000100:00100000:3.0:1789431567.922736:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1565
00002000:00100000:3.0:1789431567.922749:0:14449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x51a:0x0] (0->85025)  req@ffff90cf3afcc700 x1876351933581696/t4294969667(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:38/0 lens 488/448 e 0 to 0 dl 1789431578 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431567.922759:0:14449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3afcc700 with x1876351933581696 ext(0->85025)
00002000:00010000:3.0:1789431567.922765:0:14449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3afcc700
00000100:00100000:2.0:1789431567.931028:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.931186:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431567.931209:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.931326:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933581952
00000100:00100000:3.0:1789431567.931336:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933581952
00000100:00100000:3.0:1789431567.931381:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933582208
00000100:00100000:3.0:1789431567.931384:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933582208
00000100:00100000:3.0:1789431567.931404:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296252
00000100:00100000:3.0:1789431567.931412:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14616:x1876351933581952:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431567.931433:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00000100:00100000:1.0:1789431567.931434:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296253
00000100:00100000:1.0:1789431567.931448:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14617:x1876351933582208:12345-192.168.203.4@tcp:44:dbench.0
00010000:00010000:3.0:1789431567.931455:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63527928 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9250 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.931517:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352792f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.931531:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352792f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.931543:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352792f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.931557:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527936 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.931564:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.931571:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.931596:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933582080
00000100:00100000:0.0:1789431567.931602:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933582080
00010000:00010000:3.0:1789431567.931625:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352792f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.931634:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352792f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.931642:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352792f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.931649:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14374
00010000:00010000:3.0:1789431567.931651:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.931658:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352792f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.931660:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb05450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+247:2348:x1876351933582080:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431567.931672:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352792f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.931676:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431567.931689:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431567.931693:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.931706:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527921 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9249 expref: 247 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.931717:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352792f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.931725:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:3.0:1789431567.931726:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352792f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.931734:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431567.931742:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.931750:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527936 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.931756:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.931761:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.931764:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.931770:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527936 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.931778:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xbb97fc59 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431567.931781:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00000100:00100000:0.0:1789431567.931784:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb05450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+246:2348:x1876351933582080:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 126us (596us total) trans 0 rc 0/0
00010000:00010000:3.0:1789431567.931786:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527936 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.931799:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14374
00010000:00010000:3.0:1789431567.931799:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527936 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.931837:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63527928 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9250 expref: 245 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.931847:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431567.931850:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.931854:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63527928 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9250 expref: 245 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.932107:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ace00, rc 0)
00000100:00100000:3.0:1789431567.932182:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14616:x1876351933581952:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 771us (1164us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431567.932189:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296252
00000100:00100000:3.0:1789431567.940724:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431567.941769:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933582336
00000100:00100000:1.0:1789431567.941782:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933582336
00000100:00100000:1.0:1789431567.941843:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296254
00000100:00100000:1.0:1789431567.941854:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14616:x1876351933582336:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431567.941875:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431567.941985:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352793d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9257 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.942077:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527944 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.942092:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.942105:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431567.942140:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008d:0x0]: returning size 16384
00000004:00200000:1.0:1789431567.942143:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431567.942161:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.942185:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352793d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9257 expref: 246 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.942202:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527944 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9257 expref: 245 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431567.942210:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431567.942213:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431567.942216:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:1.0:1789431567.942281:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14616:x1876351933582336:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 429us (1584us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.942288:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296254
00000100:00100000:0.0:1789431567.949732:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431567.950197:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933582464
00000100:00100000:3.0:1789431567.950208:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933582464
00000100:00100000:3.0:1789431567.950266:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12537
00000100:00100000:3.0:1789431567.950277:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14616:x1876351933582464:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431567.961902:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14616:x1876351933582464:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 11615us (12169us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.961916:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12537
00000100:00100000:3.0:1789431567.967336:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431567.967441:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933582592
00000100:00100000:0.0:1789431567.967451:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933582592
00000100:00100000:0.0:1789431567.968977:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296255
00000100:00100000:0.0:1789431567.968995:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14616:x1876351933582592:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431567.969015:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431567.969037:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352794b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c925e expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969124:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527952 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969140:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527952 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969153:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527952 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969168:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527959 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969174:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969180:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969344:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527952 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969352:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527952 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969360:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527952 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969365:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431567.969369:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527952 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969376:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527952 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969388:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431567.969392:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.969397:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527952 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969404:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527952 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969415:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969421:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527959 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969426:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969431:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431567.969434:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969440:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527959 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969447:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xbb97fc59 (ffff90ce07190b00)
00010000:00010000:0.0:1789431567.969450:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.969452:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527959 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969458:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527959 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969490:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352794b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c925e expref: 246 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969504:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431567.969506:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.969510:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352794b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c925e expref: 246 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.969518:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2e00, rc 0)
00000100:00100000:0.0:1789431567.969587:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14616:x1876351933582592:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 598us (2259us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431567.969595:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296255
00000100:00100000:0.0:1789431567.980144:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431567.980178:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933582848
00000100:00100000:0.0:1789431567.980187:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933582848
00000100:00100000:0.0:1789431567.980483:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 523
00000100:00100000:0.0:1789431567.980496:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14616:x1876351933582848:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431567.980544:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:0.0:1789431567.980573:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527905 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c923b expref: 245 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.980591:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:0.0:1789431567.980600:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527944 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9257 expref: 244 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.980609:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431567.980612:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431567.980634:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527960 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.980648:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527960 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.980657:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527960 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.980670:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527967 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.980676:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527967 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.980683:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527967 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.980952:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352796e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.980963:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352796e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.980971:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352796e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.981451:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527975 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.981461:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527975 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.981469:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527975 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431567.982175:0:5862:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000675d7588 reply state 000000008f1decf3 transno 4295121128 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527975 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.982185:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000004:00010000:0.0:1789431567.982191:0:5862:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000675d7588 reply state 000000008f1decf3 transno 4295121128 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352796e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.982195:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 1
00010000:00010000:0.0:1789431567.982199:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527960 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.982204:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527960 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.982210:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527960 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.982216:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431567.982219:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527960 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.982226:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527960 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.982236:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431567.982238:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431567.982243:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527960 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.982248:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527960 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431567.982262:0:5862:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000675d7588 reply state 000000008f1decf3 transno 4295121128 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527967 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.982267:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 2
00000100:00100000:0.0:1789431567.982353:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14616:x1876351933582848:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1858us (2217us total) trans 4295121128 rc 0/0
00000100:00100000:0.0:1789431567.982362:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 523
00000100:00100000:0.0:1789431567.990321:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431567.990461:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527967 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990475:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527967 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990484:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527967 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990492:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431567.990498:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527967 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990508:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527967 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990527:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce07190300)
00010000:00010000:2.0:1789431567.990532:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431567.990537:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527967 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990544:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527967 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990565:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352796e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990572:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352796e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990584:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352796e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990590:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431567.990593:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352796e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990600:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352796e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990608:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xbb97fc59 (ffff90ce07190c00)
00010000:00010000:2.0:1789431567.990611:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431567.990614:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352796e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990620:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352796e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990634:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527975 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990641:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527975 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990647:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527975 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990653:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431567.990656:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527975 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990665:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527975 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990674:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431567.990677:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:2.0:1789431567.990681:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527975 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431567.990687:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527975 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431567.990707:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933582976
00000100:00100000:3.0:1789431567.990719:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933582976
00000100:00100000:3.0:1789431567.990774:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296256
00000100:00100000:3.0:1789431567.990786:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14616:x1876351933582976:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431567.990803:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431567.990820:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352797c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9265 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.990879:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527983 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.990892:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527983 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.990902:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527983 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.990918:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352798a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.990924:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352798a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.990930:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352798a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.990976:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527983 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.990982:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527983 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.990987:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527983 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.990993:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.990996:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527983 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.991001:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527983 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.991009:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431567.991012:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.991015:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527983 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.991021:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527983 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.991030:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352798a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.991037:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352798a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.991043:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352798a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.991069:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431567.991073:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352798a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.991078:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352798a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.991086:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431567.991088:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.991091:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352798a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.991096:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb6352798a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.991124:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352797c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9265 expref: 245 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.991134:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431567.991137:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431567.991141:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb6352797c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9265 expref: 245 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431567.991149:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ace00, rc 0)
00000100:00100000:3.0:1789431567.991209:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14616:x1876351933582976:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 427us (907us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431567.991216:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296256
00000001:00080000:2.0:1789431567.994097:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121115 is committed
00000004:00080000:2.0:1789431567.994126:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 369 committed
00000001:00080000:2.0:1789431567.994151:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121127 is committed
00000004:00080000:2.0:1789431567.994166:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 371 committed
00000100:00100000:2.0:1789431567.994398:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894251776:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431567.994469:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431567.994533:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3afce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894252032:0@lo:6:osp-syn-1-0.0
00000100:00100000:2.0:1789431567.994534:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1789431567.994543:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894251904:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431567.994576:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431567.994639:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894251776
00000100:00100000:0.0:1789431567.994646:0:14501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894251776
00000100:00100000:0.0:1789431567.994708:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894252032
00000100:00100000:0.0:1789431567.994712:0:14501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894252032
00000100:00100000:0.0:1789431567.994735:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8391
00000100:00100000:0.0:1789431567.994743:0:14501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3311:x1876351894251776:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431567.994768:0:14501:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1303 count 1
00010000:00010000:0.0:1789431567.994792:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d7fe798/0xd8e438fb63527991 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x517:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.994814:0:14501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d27ff86/0xd8e438fb63526dd6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x517:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ef3 expref: 70 pid: 14505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.994823:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x517:0x0].0x0 since=3s v=(0 0)
00010000:00010000:0.0:1789431567.994827:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x517:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431567.994832:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d7fe798/0xd8e438fb63527991 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x517:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.994859:0:14501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d27ff86/0xd8e438fb63526dd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x517:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ef3 expref: 70 pid: 14505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.994873:0:14501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d27ff86/0xd8e438fb63526dd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x517:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ef3 expref: 70 pid: 14505 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.994885:0:14501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3afcc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:14501:1876351894252160:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431567.994947:0:14501:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba393c0 going to sleep for 11 seconds
00000100:00080000:0.0:1789431567.994959:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1789431567.994973:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8392
00000100:00100000:0.0:1789431567.994981:0:14505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3313:x1876351894252032:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:0.0:1789431567.994994:0:14505:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1301 count 1
00010000:00010000:0.0:1789431567.995008:0:14505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f183fb0/0xd8e438fb63527998 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.995020:0:14505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ced543ee/0xd8e438fb635267cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d8e expref: 69 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.995027:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x515:0x0].0x0 since=4s v=(0 0)
00010000:00010000:0.0:1789431567.995030:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x515:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431567.995033:0:14505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f183fb0/0xd8e438fb63527998 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.995144:0:14505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ced543ee/0xd8e438fb635267cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d8e expref: 69 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.995156:0:14505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ced543ee/0xd8e438fb635267cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d8e expref: 69 pid: 14500 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.995167:0:14505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3afcca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:14505:1876351894252288:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431567.995192:0:14505:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba39b40 going to sleep for 11 seconds
00000100:00100000:2.0:1789431567.995351:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431567.995581:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894251904
00000100:00100000:0.0:1789431567.995587:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894251904
00000100:00100000:0.0:1789431567.995628:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8393
00000100:00100000:0.0:1789431567.995636:0:14482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3311:x1876351894251904:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431567.995651:0:14482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1305 count 1
00010000:00010000:0.0:1789431567.995667:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6352799f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x519:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.995681:0:14482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63527626 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x519:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9162 expref: 70 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.995689:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x519:0x0].0x0 since=1s v=(0 0)
00010000:00010000:0.0:1789431567.995692:0:14482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x519:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431567.995708:0:14482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6352799f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x519:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.995728:0:14482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63527626 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x519:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9162 expref: 70 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431567.995738:0:14482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63527626 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x519:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9162 expref: 70 pid: 6700 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431567.995750:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3afcf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14482:1876351894252416:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431567.995787:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba39d80 going to sleep for 11 seconds
00000100:00100000:1.0:1789431567.996524:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+192:14617:x1876351933582208:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 65076us (65309us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431567.996534:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296253
00000100:00100000:3.0:1789431568.004420:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3afcf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14482:1876351894252416:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431568.004448:0:14482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6352799f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x519:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.004809:0:14505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3afcca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:14505:1876351894252288:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431568.004824:0:14505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007f183fb0/0xd8e438fb63527998 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.005475:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.005570:0:14501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3afcc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:14501:1876351894252160:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431568.005587:0:14501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d7fe798/0xd8e438fb63527991 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x517:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.005680:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933583488
00000100:00100000:2.0:1789431568.005690:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933583488
00000100:00100000:2.0:1789431568.005771:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296257
00000100:00100000:2.0:1789431568.005782:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+192:14616:x1876351933583488:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431568.005801:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431568.005822:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635279a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c926c expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.005895:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb635279ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.005910:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb635279ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.005920:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb635279ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431568.005954:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008d:0x0]: returning size 16384
00000004:00200000:2.0:1789431568.005958:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431568.005978:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb635279ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.006000:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635279a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c926c expref: 194 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.006016:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb635279ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c926c expref: 193 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.006024:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431568.006027:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:2.0:1789431568.006031:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522e00, rc 0)
00000100:00100000:2.0:1789431568.006129:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14616:x1876351933583488:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 347us (656us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.006137:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296257
00000100:00100000:2.0:1789431568.006541:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.006573:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.006602:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.006625:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933583104
00000100:00100000:2.0:1789431568.006631:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933583104
00010000:00010000:2.0:1789431568.006654:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d27ff86/0xd8e438fb63526dd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x517:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ef3 expref: 71 pid: 14505 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.006678:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933583360
00000100:00100000:2.0:1789431568.006681:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933583360
00010000:00010000:2.0:1789431568.006702:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63527626 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x519:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9162 expref: 72 pid: 6700 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.006721:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933583232
00000100:00100000:2.0:1789431568.006724:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933583232
00010000:00010000:2.0:1789431568.006740:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ced543ee/0xd8e438fb635267cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d8e expref: 70 pid: 14500 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.006760:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16680
00000100:00100000:2.0:1789431568.006768:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d985180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2347:x1876351933583104:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431568.006778:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431568.006784:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d27ff86/0xd8e438fb63526dd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x517:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ef3 expref: 72 pid: 14505 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.006795:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d27ff86/0xd8e438fb63526dd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x517:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ef3 expref: 72 pid: 14505 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.006814:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d27ff86/0xd8e438fb63526dd6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x517:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8ef3 expref: 72 pid: 14505 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.006834:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x517:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431568.006838:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x517:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431568.006843:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d7fe798/0xd8e438fb63527991 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x517:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.006852:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d7fe798/0xd8e438fb63527991 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x517:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.006876:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431568.006903:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d985180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2347:x1876351933583104:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 135us (362us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.006910:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16680
00000100:00100000:2.0:1789431568.006924:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16681
00000100:00100000:2.0:1789431568.006931:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d985f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2347:x1876351933583360:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431568.006938:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431568.006943:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63527626 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x519:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9162 expref: 70 pid: 6700 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.006952:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63527626 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x519:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9162 expref: 70 pid: 6700 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.006965:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ca7c869/0xd8e438fb63527626 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x519:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9162 expref: 70 pid: 6700 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.006979:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x519:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431568.006982:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x519:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431568.006987:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6352799f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x519:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.006994:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6352799f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x519:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.007012:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431568.007032:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d985f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2347:x1876351933583360:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 101us (458us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.007038:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16681
00000100:00100000:2.0:1789431568.007078:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16682
00000100:00100000:2.0:1789431568.007084:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d986a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2347:x1876351933583232:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431568.007092:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431568.007097:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ced543ee/0xd8e438fb635267cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x515:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d8e expref: 70 pid: 14500 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.007108:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ced543ee/0xd8e438fb635267cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x515:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d8e expref: 70 pid: 14500 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:0.0:1789431568.007121:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1789431568.007126:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ced543ee/0xd8e438fb635267cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x515:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8d8e expref: 70 pid: 14500 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:0.0:1789431568.007127:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00010000:00010000:2.0:1789431568.007145:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x515:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431568.007148:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x515:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431568.007153:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007f183fb0/0xd8e438fb63527998 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.007160:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f183fb0/0xd8e438fb63527998 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x515:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.007186:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431568.007204:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d986a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2347:x1876351933583232:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 120us (601us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.007212:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16682
00010000:00010000:0.0:1789431568.007223:0:14505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007f183fb0/0xd8e438fb63527998 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.007244:0:14505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f183fb0/0xd8e438fb63527998 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.007246:0:14482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6352799f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.007266:0:14505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f183fb0/0xd8e438fb63527998 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.007266:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6352799f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.007285:0:14505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f183fb0/0xd8e438fb63527998 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.007302:0:14505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431568.007740:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3313:x1876351894252032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12759us (13162us total) trans 4294970064 rc 0/0
00000100:00100000:0.0:1789431568.007748:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8392
00010000:00010000:0.0:1789431568.007771:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431568.007777:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f183fb0/0xd8e438fb63527998 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.007787:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2800 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431568.007791:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f183fb0/0xd8e438fb63527998 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.007801:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f183fb0/0xd8e438fb63527998 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.007814:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f183fb0/0xd8e438fb63527998 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.007821:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f183fb0/0xd8e438fb63527998 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.007837:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431568.007839:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431568.007841:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431568.008465:0:14501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d7fe798/0xd8e438fb63527991 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.008477:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d7fe798/0xd8e438fb63527991 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.008487:0:14501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d7fe798/0xd8e438fb63527991 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.008496:0:14501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d7fe798/0xd8e438fb63527991 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.008517:0:14501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1789431568.008823:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+7:3311:x1876351894251776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14078us (14351us total) trans 4294969668 rc 0/0
00000100:00100000:0.0:1789431568.008830:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8391
00010000:00010000:1.0:1789431568.008888:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431568.008894:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d7fe798/0xd8e438fb63527991 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.008903:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3c00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431568.008907:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d7fe798/0xd8e438fb63527991 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.008915:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d7fe798/0xd8e438fb63527991 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.008929:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d7fe798/0xd8e438fb63527991 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.008936:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d7fe798/0xd8e438fb63527991 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.008952:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431568.008953:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431568.008955:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:3.0:1789431568.009639:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3afce300/2, rc 0, transno 4294970064
00000100:00100000:3.0:1789431568.009655:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3afce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894252032:0@lo:6:osp-syn-1-0.0
00010000:00010000:2.0:1789431568.009874:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6352799f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.009885:0:14482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6352799f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.009900:0:14482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:3.0:1789431568.010122:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969658 gen 2
00000004:00080000:3.0:1789431568.010128:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba1a300, transno 4294969618
00000004:00080000:3.0:1789431568.010139:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce35e45180, transno 4294969619
00000004:00080000:3.0:1789431568.010141:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce35e44000, transno 4294969620
00000004:00080000:3.0:1789431568.010144:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba1aa00, transno 4294969621
00000004:00080000:3.0:1789431568.010146:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba18000, transno 4294969622
00000004:00080000:3.0:1789431568.010148:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba19880, transno 4294969623
00000004:00080000:3.0:1789431568.010151:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba19c00, transno 4294969624
00000004:00080000:3.0:1789431568.010153:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce35e44a80, transno 4294969625
00000004:00080000:3.0:1789431568.010156:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce20fd4700, transno 4294969626
00000004:00080000:3.0:1789431568.010158:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce20fd7480, transno 4294969627
00000004:00080000:3.0:1789431568.010161:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce20fd5f80, transno 4294969628
00000004:00080000:3.0:1789431568.010163:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce20fd5500, transno 4294969629
00000004:00080000:3.0:1789431568.010165:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce20fd5c00, transno 4294969630
00000004:00080000:3.0:1789431568.010168:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce20fd5180, transno 4294969631
00000004:00080000:3.0:1789431568.010170:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2a7eb100, transno 4294969632
00000004:00080000:3.0:1789431568.010173:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3c154700, transno 4294969633
00000004:00080000:3.0:1789431568.010175:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2a7e9c00, transno 4294969634
00000004:00080000:3.0:1789431568.010178:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2a7e8a80, transno 4294969635
00000004:00080000:3.0:1789431568.010180:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce36218e00, transno 4294969636
00000004:00080000:3.0:1789431568.010183:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3c155c00, transno 4294969637
00000004:00080000:3.0:1789431568.010185:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3c155180, transno 4294969638
00000004:00080000:3.0:1789431568.010188:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce36219880, transno 4294969639
00000004:00080000:3.0:1789431568.010190:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce36219500, transno 4294969640
00000004:00080000:3.0:1789431568.010193:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1ac77480, transno 4294969641
00000004:00080000:3.0:1789431568.010195:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1ac75c00, transno 4294969642
00000004:00080000:3.0:1789431568.010198:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1ac74000, transno 4294969643
00000004:00080000:3.0:1789431568.010200:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2a7ebb80, transno 4294969644
00000004:00080000:3.0:1789431568.010203:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2d50ad80, transno 4294969645
00000004:00080000:3.0:1789431568.010205:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2d50b480, transno 4294969646
00000004:00080000:3.0:1789431568.010207:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce0e617b80, transno 4294969647
00000004:00080000:3.0:1789431568.010209:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce0e614e00, transno 4294969648
00000004:00080000:3.0:1789431568.010211:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce0e616d80, transno 4294969649
00000004:00080000:3.0:1789431568.010214:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba1b100, transno 4294969653
00000004:00080000:3.0:1789431568.010217:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba19500, transno 4294969654
00000004:00080000:3.0:1789431568.010219:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba18e00, transno 4294969655
00000004:00080000:3.0:1789431568.010221:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba1ad80, transno 4294969656
00000004:00080000:3.0:1789431568.010224:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce20fd7100, transno 4294969657
00000004:00080000:3.0:1789431568.010226:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ba18a80, transno 4294969658
00000100:00100000:3.0:1789431568.010233:0:3311:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search  req@ffff90cf37e70380 x1876351894251776/t4294969668(4294969668) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789431583 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295
00000004:00080000:3.0:1789431568.010242:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf37e70380/2, rc 0, transno 4294969668
00000100:00100000:3.0:1789431568.010245:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894251776:0@lo:6:osp-syn-0-0.0
00000004:00080000:3.0:1789431568.010501:0:6793:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 2 in progress, 1 in flight, 38 done
00010000:00010000:1.0:1789431568.012862:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431568.012876:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6352799f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.012897:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431568.012902:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6352799f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.012913:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6352799f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.012935:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6352799f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.012943:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aabdca1d/0xd8e438fb6352799f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.012970:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431568.012971:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431568.012973:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431568.013753:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.013824:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933583616
00000100:00100000:3.0:1789431568.013836:0:14499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933583616
00000100:00100000:3.0:1789431568.013891:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8394
00000100:00100000:3.0:1789431568.013902:0:14499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2350:x1876351933583616:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:2.0:1789431568.019562:0:14482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3311:x1876351894251904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23921us (24206us total) trans 4294969669 rc 0/0
00000100:00100000:2.0:1789431568.019575:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8393
00000004:00080000:2.0:1789431568.019635:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf37e71c00/2, rc 0, transno 4294969669
00000100:00100000:2.0:1789431568.019642:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894251904:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431568.020811:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.021656:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933583744
00000100:00100000:1.0:1789431568.021666:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933583744
00000100:00100000:1.0:1789431568.021971:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12538
00000100:00100000:1.0:1789431568.021981:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14616:x1876351933583744:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431568.031591:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14616:x1876351933583744:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 9601us (10774us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431568.031604:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12538
00000100:00100000:1.0:1789431568.037044:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.037112:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933584000
00000100:00100000:1.0:1789431568.037121:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933584000
00000100:00100000:1.0:1789431568.037180:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296258
00000100:00100000:1.0:1789431568.037191:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14616:x1876351933584000:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431568.037211:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431568.037234:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635279b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9273 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037622:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635279bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037639:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635279bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037651:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635279bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037667:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635279c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037674:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635279c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037681:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635279c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037743:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635279bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037751:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635279bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037758:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635279bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037763:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431568.037768:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635279bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037775:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635279bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037786:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431568.037789:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431568.037794:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635279bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037799:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635279bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037810:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635279c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037815:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635279c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037820:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635279c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037825:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431568.037828:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635279c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037833:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635279c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037839:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce03149500)
00010000:00010000:1.0:1789431568.037841:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431568.037844:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635279c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037850:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635279c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037881:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635279b4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9273 expref: 194 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037890:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431568.037893:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:1.0:1789431568.037896:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb635279b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9273 expref: 194 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.037905:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309e00, rc 0)
00000100:00100000:1.0:1789431568.037960:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14616:x1876351933584000:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 772us (924us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431568.037968:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296258
00000100:00100000:2.0:1789431568.045942:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.046022:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933584256
00000100:00100000:3.0:1789431568.046032:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933584256
00000100:00100000:3.0:1789431568.046111:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296259
00000100:00100000:3.0:1789431568.046121:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14616:x1876351933584256:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431568.046141:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431568.046145:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431568.046170:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb635279ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c926c expref: 193 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.046190:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431568.046196:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431568.046210:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635279c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c927a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.046492:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635279d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.046508:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635279d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.046519:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635279d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.046537:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635279d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.046544:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635279d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.046550:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635279d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:3.0:1789431568.047177:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x51a:0x0], index 1: 0
00010000:00010000:3.0:1789431568.048464:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635279de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.048483:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635279de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.048496:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635279de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.048535:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635279d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.048542:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635279d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.048549:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635279d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.048555:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431568.048559:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635279d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.048571:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635279d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.048581:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431568.048584:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431568.048588:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635279d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.048594:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb635279d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431568.048608:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000836752f1 reply state 0000000063861e40 transno 4295121129 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635279d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431568.048617:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431568.048652:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb635279c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c927a expref: 195 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.048668:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635279de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c927a expref: 194 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.048675:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90cf18b78400)
00010000:00010000:3.0:1789431568.048678:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431568.048680:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ac600, rc 0)
00000100:00100000:3.0:1789431568.049149:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14616:x1876351933584256:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3028us (3215us total) trans 4295121129 rc 0/0
00000100:00100000:3.0:1789431568.049159:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296259
00010000:00010000:3.0:1789431568.055876:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635279d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.055894:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635279d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.055902:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635279d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.055909:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431568.055914:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635279d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.055921:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635279d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.055938:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431568.055941:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431568.055946:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635279d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.055952:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb635279d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431568.058977:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.059146:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933584384
00000100:00100000:0.0:1789431568.059156:0:14502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933584384
00000100:00100000:0.0:1789431568.059211:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8395
00000100:00100000:0.0:1789431568.059229:0:14502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2348:x1876351933584384:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431568.059247:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431568.059269:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000755738c5/0xd8e438fb635279ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x51a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9281 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789431568.059299:0:14502:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x51a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431568.059317:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51a:0x0].0x0 since=3026s v=(0 0)
00010000:00010000:0.0:1789431568.059322:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51a:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431568.059331:0:14502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000755738c5/0xd8e438fb635279ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9281 expref: 70 pid: 14502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.059561:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000755738c5/0xd8e438fb635279ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9281 expref: 70 pid: 14502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.059573:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3a00, rc 0)
00000100:00100000:0.0:1789431568.059671:0:14502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2348:x1876351933584384:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 451us (702us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431568.059679:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8395
00000001:00080000:3.0:1789431568.065626:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969668 is committed
00000001:00080000:3.0:1789431568.065644:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969667 is committed
00000100:00100000:2.0:1789431568.067008:0:14499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2350:x1876351933583616:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 53100us (53252us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.067021:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8394
00000100:00100000:3.0:1789431568.084418:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.084484:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933584512
00000100:00100000:0.0:1789431568.084495:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933584512
00002000:00100000:0.0:1789431568.084549:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x51a:0x0] (0->4095)  req@ffff90cf37e70700 x1876351933584512/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/0 e 0 to 0 dl 1789431579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431568.084560:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e70700 with x1876351933584512 ext(0->4095)
00002000:00010000:0.0:1789431568.084567:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf37e70700
00000100:00100000:0.0:1789431568.084603:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1566
00000100:00100000:0.0:1789431568.084613:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2348:x1876351933584512:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:0.0:1789431568.085491:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2348:x1876351933584512:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 876us (1079us total) trans 4294969670 rc 0/0
00000100:00100000:0.0:1789431568.085500:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1566
00002000:00100000:0.0:1789431568.085508:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x51a:0x0] (0->4095)  req@ffff90cf37e70700 x1876351933584512/t4294969670(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/448 e 0 to 0 dl 1789431579 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431568.085518:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e70700 with x1876351933584512 ext(0->4095)
00002000:00010000:0.0:1789431568.085522:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf37e70700
00000100:00100000:0.0:1789431568.090374:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.090433:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.090551:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933584640
00000100:00100000:2.0:1789431568.090561:0:14490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933584640
00000100:00100000:2.0:1789431568.090637:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933584768
00000100:00100000:2.0:1789431568.090641:0:14490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933584768
00000100:00100000:2.0:1789431568.090741:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8396
00000100:00100000:2.0:1789431568.090761:0:14490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:14616:x1876351933584640:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431568.090880:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431568.090907:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eec127f0/0xd8e438fb635279f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x51a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9288 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.090948:0:14490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000755738c5/0xd8e438fb635279ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x51a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9281 expref: 71 pid: 14502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.090963:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51a:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431568.090968:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51a:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431568.090974:0:14490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eec127f0/0xd8e438fb635279f3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x51a:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9288 expref: 71 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.091014:0:14490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000755738c5/0xd8e438fb635279ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9281 expref: 71 pid: 14502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.091027:0:14490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000755738c5/0xd8e438fb635279ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x51a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9281 expref: 71 pid: 14502 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.091042:0:14490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d985880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14490:1876351894252544:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431568.091151:0:14490:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1e8c93c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431568.091545:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8397
00000100:00100000:0.0:1789431568.091559:0:14500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2347:x1876351933584768:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:2.0:1789431568.100192:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.100268:0:14490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d985880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14490:1876351894252544:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431568.100312:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eec127f0/0xd8e438fb635279f3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x51a:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9288 expref: 71 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.100339:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522000, rc 0)
00000100:00100000:2.0:1789431568.100388:0:14490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:14616:x1876351933584640:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9629us (10101us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.100397:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8396
00000100:00100000:2.0:1789431568.100439:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933584896
00000100:00100000:2.0:1789431568.100446:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933584896
00010000:00010000:2.0:1789431568.100473:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000755738c5/0xd8e438fb635279ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x51a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9281 expref: 71 pid: 14502 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.100499:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16683
00000100:00100000:2.0:1789431568.100508:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d987100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2347:x1876351933584896:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431568.100533:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431568.100562:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000755738c5/0xd8e438fb635279ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x51a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9281 expref: 71 pid: 14502 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.100574:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000755738c5/0xd8e438fb635279ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9281 expref: 71 pid: 14502 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.100603:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000755738c5/0xd8e438fb635279ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x51a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9281 expref: 71 pid: 14502 timeout: 3126 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.100618:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51a:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431568.100622:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51a:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431568.100635:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eec127f0/0xd8e438fb635279f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9288 expref: 70 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.100646:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eec127f0/0xd8e438fb635279f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x51a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9288 expref: 70 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.100681:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000eec127f0/0xd8e438fb635279f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x51a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9288 expref: 70 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.100712:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d985880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5833:1876351894252672:192.168.203.4@tcp:105:
00000100:00100000:2.0:1789431568.102578:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf1e8c93c0 going to sleep for 11 seconds
00000100:00100000:1.0:1789431568.121938:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d985880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5833:1876351894252672:192.168.203.4@tcp:105:
00010000:00010000:1.0:1789431568.121964:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431568.122024:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d987100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2347:x1876351933584896:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 21515us (21847us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431568.122036:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16683
00000100:00100000:3.0:1789431568.135264:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.135582:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933585152
00000100:00100000:0.0:1789431568.135592:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933585152
00000100:00100000:0.0:1789431568.135654:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12539
00000100:00100000:0.0:1789431568.135665:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+194:14616:x1876351933585152:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431568.136035:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14616:x1876351933585152:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 371us (778us total) trans 4295121130 rc 0/0
00000100:00100000:0.0:1789431568.136043:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12539
00000100:00100000:0.0:1789431568.141035:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.144208:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933585408
00000100:00100000:1.0:1789431568.144232:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933585408
00000100:00100000:0.0:1789431568.144490:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296260
00000100:00100000:0.0:1789431568.144501:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14616:x1876351933585408:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431568.144525:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431568.144545:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635279fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c928f expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.144641:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527a01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.144656:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635279de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c927a expref: 196 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.144665:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527a01 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.144715:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635279de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c927a expref: 196 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.144730:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635279de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c927a expref: 196 pid: 5849 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431568.144821:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3afcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894252800:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431568.144903:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba393c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431568.152017:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.152139:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933585536
00000100:00100000:1.0:1789431568.152150:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933585536
00010000:00010000:1.0:1789431568.152189:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635279de lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c927a expref: 197 pid: 5849 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.152248:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16684
00000100:00100000:1.0:1789431568.152259:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:2347:x1876351933585536:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431568.152285:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431568.152452:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635279de lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c927a expref: 197 pid: 5849 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.152470:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635279de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c927a expref: 197 pid: 5849 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.152493:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90cf18b78400)
00010000:00010000:1.0:1789431568.152499:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527a01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.152509:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527a01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.152518:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527a01 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.152538:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431568.152589:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:2347:x1876351933585536:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 332us (580us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431568.152597:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16684
00010000:00010000:2.0:1789431568.154868:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb635279de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c927a expref: 196 pid: 5849 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.154900:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3afcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894252800:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431568.154927:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527a01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.154949:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527a01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.154956:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527a01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431568.154978:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab1:0x0]: returning size 85026
00010000:00010000:2.0:1789431568.155162:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635279fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c928f expref: 197 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.155178:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527a01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c928f expref: 196 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.155187:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90cf18b78400)
00010000:00010000:2.0:1789431568.155189:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431568.155193:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3e00, rc 0)
00000100:00100000:2.0:1789431568.155254:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933585408:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10755us (14228us total) trans 4295121131 rc 0/0
00000100:00100000:2.0:1789431568.155263:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296260
00000100:00100000:3.0:1789431568.159510:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.159587:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933585664
00000100:00100000:1.0:1789431568.159596:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933585664
00000100:00100000:1.0:1789431568.159655:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296261
00000100:00100000:1.0:1789431568.159665:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933585664:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431568.159689:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431568.159804:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527a0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9296 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.159889:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527a16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.159904:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527a01 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c928f expref: 197 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.159912:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527a16 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.159942:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527a01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c928f expref: 197 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.159955:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527a01 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c928f expref: 197 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.159969:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b9d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894252928:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431568.160041:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf37387f00 going to sleep for 11 seconds
00000100:00100000:1.0:1789431568.164128:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b9d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894252928:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431568.164164:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527a16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431568.164423:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.164679:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933585792
00000100:00100000:2.0:1789431568.164687:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933585792
00010000:00010000:2.0:1789431568.164804:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527a01 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c928f expref: 198 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.164883:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16685
00000100:00100000:2.0:1789431568.164893:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:2347:x1876351933585792:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431568.164908:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431568.164915:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527a01 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c928f expref: 198 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.164927:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527a01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c928f expref: 198 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.164949:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527a01 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c928f expref: 198 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.164964:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90cf18b78400)
00010000:00010000:2.0:1789431568.164970:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527a16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.164980:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527a16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.164988:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527a16 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.165072:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431568.165125:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:2347:x1876351933585792:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 234us (703us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.165132:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16685
00010000:00010000:1.0:1789431568.166438:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527a16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.166457:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527a16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431568.166506:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab1:0x0]: returning size 85026
00000004:00200000:1.0:1789431568.166511:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431568.166533:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527a16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.166571:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527a0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9296 expref: 197 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.166591:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527a16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9296 expref: 196 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.166599:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90cf18b78400)
00010000:00010000:1.0:1789431568.166602:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431568.166605:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308200, rc 0)
00000100:00100000:1.0:1789431568.166669:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933585664:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7006us (7169us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431568.166677:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296261
00000100:00100000:0.0:1789431568.178639:0:14500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2347:x1876351933584768:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 87077us (88196us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431568.178652:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8397
00000001:00080000:3.0:1789431568.181566:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969670 is committed
00000001:00080000:3.0:1789431568.181587:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969669 is committed
00000100:00100000:0.0:1789431568.183427:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.183508:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933585920
00000100:00100000:3.0:1789431568.183518:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933585920
00002000:00100000:3.0:1789431568.183570:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x51a:0x0] (0->85025)  req@ffff90cf3afcd180 x1876351933585920/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 488/0 e 0 to 0 dl 1789431579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431568.183582:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3afcd180 with x1876351933585920 ext(0->85025)
00002000:00010000:3.0:1789431568.183587:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3afcd180
00000100:00100000:3.0:1789431568.183619:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1567
00000100:00100000:3.0:1789431568.183628:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2349:x1876351933585920:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:1.0:1789431568.197029:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2349:x1876351933585920:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 13392us (13599us total) trans 4294970065 rc 0/0
00000100:00100000:1.0:1789431568.197042:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1567
00002000:00100000:1.0:1789431568.197094:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x51a:0x0] (0->85025)  req@ffff90cf3afcd180 x1876351933585920/t4294970065(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 488/448 e 0 to 0 dl 1789431579 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431568.197105:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3afcd180 with x1876351933585920 ext(0->85025)
00002000:00010000:1.0:1789431568.197112:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3afcd180
00000100:00100000:0.0:1789431568.199497:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.199739:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933586048
00000100:00100000:1.0:1789431568.199748:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933586048
00002000:00100000:1.0:1789431568.199794:0:14435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x51a:0x0] (0->4095)  req@ffff90cf3afcd880 x1876351933586048/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/0 e 0 to 0 dl 1789431579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431568.199804:0:14435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3afcd880 with x1876351933586048 ext(0->4095)
00002000:00010000:1.0:1789431568.199810:0:14435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3afcd880
00000100:00100000:1.0:1789431568.199841:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1568
00000100:00100000:1.0:1789431568.199852:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2348:x1876351933586048:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:1.0:1789431568.200337:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2348:x1876351933586048:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 484us (847us total) trans 4294969671 rc 0/0
00000100:00100000:1.0:1789431568.200346:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1568
00002000:00100000:1.0:1789431568.200353:0:14435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x51a:0x0] (0->4095)  req@ffff90cf3afcd880 x1876351933586048/t4294969671(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/448 e 0 to 0 dl 1789431579 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431568.200363:0:14435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3afcd880 with x1876351933586048 ext(0->4095)
00002000:00010000:1.0:1789431568.200367:0:14435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3afcd880
00000100:00100000:3.0:1789431568.207360:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.207406:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.207596:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933586304
00000100:00100000:2.0:1789431568.207606:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933586304
00000100:00100000:2.0:1789431568.207664:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296262
00000100:00100000:2.0:1789431568.207674:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933586304:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:1.0:1789431568.208665:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933586176
00000100:00100000:1.0:1789431568.208674:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933586176
00000100:00100000:1.0:1789431568.208730:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8398
00000100:00100000:1.0:1789431568.208739:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2350:x1876351933586176:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:1.0:1789431568.248091:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933586304:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 40408us (40673us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431568.248104:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296262
00000001:00080000:2.0:1789431568.250328:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121130 is committed
00000001:00080000:2.0:1789431568.250351:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121131 is committed
00000100:00100000:1.0:1789431568.254156:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2350:x1876351933586176:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 45408us (46795us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431568.254174:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8398
00000001:00080000:1.0:1789431568.254209:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969671 is committed
00000100:00100000:0.0:1789431568.258425:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.260387:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933586432
00000100:00100000:3.0:1789431568.260402:0:14491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933586432
00000100:00100000:3.0:1789431568.260466:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8399
00000100:00100000:3.0:1789431568.260475:0:14491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2348:x1876351933586432:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:1.0:1789431568.263768:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.264894:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933586560
00000100:00100000:0.0:1789431568.264908:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933586560
00002000:00100000:1.0:1789431568.265136:0:14440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x51a:0x0] (0->4095)  req@ffff90cf3b9d5c00 x1876351933586560/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/0 e 0 to 0 dl 1789431579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431568.265148:0:14440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3b9d5c00 with x1876351933586560 ext(0->4095)
00002000:00010000:1.0:1789431568.265154:0:14440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3b9d5c00
00000100:00100000:1.0:1789431568.265220:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1569
00000100:00100000:1.0:1789431568.265240:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2348:x1876351933586560:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:1.0:1789431568.265663:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2348:x1876351933586560:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 434us (1905us total) trans 4294969672 rc 0/0
00000100:00100000:1.0:1789431568.265671:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1569
00002000:00100000:1.0:1789431568.265678:0:14440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x51a:0x0] (0->4095)  req@ffff90cf3b9d5c00 x1876351933586560/t4294969672(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/448 e 0 to 0 dl 1789431579 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431568.265686:0:14440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3b9d5c00 with x1876351933586560 ext(0->4095)
00002000:00010000:1.0:1789431568.265690:0:14440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3b9d5c00
00000100:00100000:1.0:1789431568.275451:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.275525:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933586688
00000100:00100000:3.0:1789431568.275535:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933586688
00000100:00100000:3.0:1789431568.275592:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8400
00000100:00100000:3.0:1789431568.275603:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2347:x1876351933586688:12345-192.168.203.4@tcp:16:dbench.0
00000001:00080000:0.0:1789431568.298200:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970064 is committed
00000001:00080000:0.0:1789431568.298217:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970063 is committed
00000001:00080000:0.0:1789431568.298232:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970065 is committed
00000100:00100000:2.0:1789431568.298503:0:14491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2348:x1876351933586432:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 37821us (39878us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.298515:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8399
00000001:00080000:1.0:1789431568.304486:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969672 is committed
00000100:00100000:0.0:1789431568.304675:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2347:x1876351933586688:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 29068us (29228us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431568.304687:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8400
00000100:00100000:1.0:1789431568.308315:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.308419:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933586816
00000100:00100000:3.0:1789431568.308429:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933586816
00002000:00100000:3.0:1789431568.308477:0:14484:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x51a:0x0] (0->4095)  req@ffff90cf3b9d4700 x1876351933586816/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/0 e 0 to 0 dl 1789431579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431568.308489:0:14484:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3b9d4700 with x1876351933586816 ext(0->4095)
00002000:00010000:3.0:1789431568.308495:0:14484:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3b9d4700
00000100:00100000:3.0:1789431568.308560:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1570
00000100:00100000:3.0:1789431568.308572:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2348:x1876351933586816:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:3.0:1789431568.309027:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2348:x1876351933586816:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 455us (720us total) trans 4294970066 rc 0/0
00000100:00100000:3.0:1789431568.309035:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1570
00002000:00100000:3.0:1789431568.309043:0:14484:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x51a:0x0] (0->4095)  req@ffff90cf3b9d4700 x1876351933586816/t4294970066(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/448 e 0 to 0 dl 1789431579 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431568.309091:0:14484:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3b9d4700 with x1876351933586816 ext(0->4095)
00002000:00010000:3.0:1789431568.309095:0:14484:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3b9d4700
00000100:00100000:1.0:1789431568.312042:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.312617:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933586944
00000100:00100000:2.0:1789431568.312629:0:14532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933586944
00002000:00100000:2.0:1789431568.312688:0:14532:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x51a:0x0] (0->4095)  req@ffff90cf3b9d4a80 x1876351933586944/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/0 e 0 to 0 dl 1789431579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431568.312715:0:14532:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3b9d4a80 with x1876351933586944 ext(0->4095)
00002000:00010000:2.0:1789431568.312721:0:14532:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3b9d4a80
00000100:00100000:2.0:1789431568.312754:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1571
00000100:00100000:2.0:1789431568.312764:0:14532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2350:x1876351933586944:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:2.0:1789431568.313208:0:14532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2350:x1876351933586944:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 443us (1172us total) trans 4294969673 rc 0/0
00000100:00100000:2.0:1789431568.313216:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1571
00002000:00100000:2.0:1789431568.313233:0:14532:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x51a:0x0] (0->4095)  req@ffff90cf3b9d4a80 x1876351933586944/t4294969673(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/448 e 0 to 0 dl 1789431579 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431568.313242:0:14532:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3b9d4a80 with x1876351933586944 ext(0->4095)
00002000:00010000:2.0:1789431568.313246:0:14532:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3b9d4a80
00000100:00100000:2.0:1789431568.315637:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.316410:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933587072
00000100:00100000:3.0:1789431568.316419:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933587072
00000100:00100000:2.0:1789431568.316578:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8401
00000100:00100000:2.0:1789431568.316589:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2347:x1876351933587072:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:1.0:1789431568.316590:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.317025:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933587200
00000100:00100000:0.0:1789431568.317031:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933587200
00000100:00100000:0.0:1789431568.317298:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8402
00000100:00100000:0.0:1789431568.317307:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b9d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2347:x1876351933587200:12345-192.168.203.4@tcp:16:dbench.0
00000001:00080000:1.0:1789431568.347557:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969673 is committed
00000100:00100000:0.0:1789431568.347919:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b9d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2347:x1876351933587200:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 30607us (31321us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431568.347931:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8402
00000001:00080000:0.0:1789431568.348168:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970066 is committed
00000100:00100000:2.0:1789431568.348268:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2347:x1876351933587072:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 31680us (32638us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.348278:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8401
00000100:00100000:2.0:1789431568.360023:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.360107:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933587328
00000100:00100000:3.0:1789431568.360116:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933587328
00002000:00100000:3.0:1789431568.360162:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x51a:0x0] (0->4095)  req@ffff90ce2d985500 x1876351933587328/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/0 e 0 to 0 dl 1789431579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431568.360173:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce2d985500 with x1876351933587328 ext(0->4095)
00002000:00010000:3.0:1789431568.360179:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce2d985500
00000100:00100000:3.0:1789431568.360212:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1572
00000100:00100000:3.0:1789431568.360220:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2350:x1876351933587328:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:2.0:1789431568.360391:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.360789:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933587456
00000100:00100000:1.0:1789431568.360794:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933587456
00000100:00100000:3.0:1789431568.360823:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2350:x1876351933587328:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 603us (808us total) trans 4294970067 rc 0/0
00000100:00100000:1.0:1789431568.360830:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296263
00000100:00100000:3.0:1789431568.360831:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1572
00000100:00100000:1.0:1789431568.360837:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+192:14617:x1876351933587456:12345-192.168.203.4@tcp:101:dbench.0
00002000:00100000:3.0:1789431568.360838:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x51a:0x0] (0->4095)  req@ffff90ce2d985500 x1876351933587328/t4294970067(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/448 e 0 to 0 dl 1789431579 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431568.360847:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce2d985500 with x1876351933587328 ext(0->4095)
00010000:00010000:1.0:1789431568.360848:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00002000:00010000:3.0:1789431568.360852:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce2d985500
00010000:00010000:1.0:1789431568.360866:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527a1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c929d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.360924:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527a24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.360937:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527a24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.360949:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527a24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.360962:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527a2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.360969:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.360975:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361177:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527a32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361184:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361189:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431568.361214:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab0:0x0]: returning size 85026
00000004:00200000:1.0:1789431568.361217:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431568.361229:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361236:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361241:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527a24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361245:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527a24 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361249:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527a24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361253:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431568.361255:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527a24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361260:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527a24 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361269:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431568.361271:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431568.361274:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527a24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361278:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527a24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361289:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361294:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527a2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361299:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527a2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361304:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431568.361307:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527a2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361312:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527a2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361318:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce03149500)
00010000:00010000:1.0:1789431568.361320:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431568.361323:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527a2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361329:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527a2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361356:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527a1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c929d expref: 194 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361367:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527a32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c929d expref: 193 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.361375:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90ce03149700)
00010000:00010000:1.0:1789431568.361377:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431568.361379:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:1.0:1789431568.361399:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933587456:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 564us (1009us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431568.361403:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296263
00000100:00100000:2.0:1789431568.371565:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.371746:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933587712
00000100:00100000:0.0:1789431568.371757:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933587712
00000100:00100000:0.0:1789431568.371818:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296264
00000100:00100000:0.0:1789431568.371827:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933587712:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431568.371873:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:0.0:1789431568.371894:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527a32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c929d expref: 193 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.371911:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce19858800/0xd8e438fb635278f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9242 expref: 192 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.371918:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90ce03149700)
00010000:00010000:0.0:1789431568.371927:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431568.371964:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527a39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.371972:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527a39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.371979:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527a39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431568.372331:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a3d6bfdd reply state 000000008ee9611d transno 4295121132 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527a39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431568.372341:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431568.372424:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933587712:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 597us (869us total) trans 4295121132 rc 0/0
00000100:00100000:3.0:1789431568.372431:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296264
00000100:00100000:1.0:1789431568.372854:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.372963:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933587840
00000100:00100000:3.0:1789431568.372968:0:14464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933587840
00000100:00100000:3.0:1789431568.373006:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8403
00000100:00100000:3.0:1789431568.373014:0:14464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2347:x1876351933587840:12345-192.168.203.4@tcp:16:dbench.0
00010000:00010000:0.0:1789431568.376184:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527a39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.376202:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527a39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.376210:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527a39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.376222:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431568.376226:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527a39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.376234:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527a39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.376252:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:0.0:1789431568.376255:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431568.376260:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527a39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.376266:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527a39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.387274:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.389876:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933587968
00000100:00100000:3.0:1789431568.389890:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933587968
00000100:00100000:3.0:1789431568.389965:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296265
00000100:00100000:3.0:1789431568.389975:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+192:14617:x1876351933587968:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431568.389999:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431568.390022:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63527a40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c92a4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.390113:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63527a40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92a4 expref: 193 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.390128:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ace00/0xd8e438fb63527a40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92a4 expref: 193 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.390145:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90cf18b78c00)
00010000:00010000:3.0:1789431568.390148:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00010000:3.0:1789431568.390151:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ace00, rc 0)
00000100:00100000:3.0:1789431568.390212:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933587968:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 238us (2949us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431568.390218:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296265
00000100:00100000:3.0:1789431568.399313:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.399364:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933588096
00000100:00100000:3.0:1789431568.399374:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933588096
00000100:00100000:3.0:1789431568.399426:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8404
00000100:00100000:3.0:1789431568.399437:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2348:x1876351933588096:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:3.0:1789431568.399685:0:14471:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x51a:0x0] updating lvb size from disk: 0 -> 85026
00002000:00010000:3.0:1789431568.399689:0:14471:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x51a:0x0] updating lvb mtime from disk: 0 -> 1789431555
00002000:00010000:3.0:1789431568.399704:0:14471:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x51a:0x0] updating lvb atime from disk: 0 -> 1789431557
00002000:00010000:3.0:1789431568.399706:0:14471:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x51a:0x0] updating lvb ctime from disk: 0 -> 1789431567
00002000:00010000:3.0:1789431568.399709:0:14471:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x51a:0x0] updating lvb blocks from disk: 1 -> 259
00000100:00100000:3.0:1789431568.399766:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+66:2348:x1876351933588096:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 330us (462us total) trans 4294969674 rc 0/0
00000100:00100000:3.0:1789431568.399774:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8404
00000100:00100000:3.0:1789431568.406816:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.406851:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933588352
00000100:00100000:3.0:1789431568.406862:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933588352
00000100:00100000:3.0:1789431568.406912:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296266
00000100:00100000:3.0:1789431568.406923:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933588352:12345-192.168.203.4@tcp:55:dbench.0
00010000:00010000:3.0:1789431568.406989:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527a47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.407007:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527a47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.407021:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527a47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.407046:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527a47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.407082:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527a47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.407090:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527a47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.407096:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ad800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431568.407101:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527a47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.407109:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527a47 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.407122:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90cf18b78c00)
00010000:00010000:3.0:1789431568.407125:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:3.0:1789431568.407131:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527a47 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.407136:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527a47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431568.407210:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933588352:12345-192.168.203.4@tcp:55:dbench.0 Request processed in 288us (404us total) trans 0 rc -22/-22
00000100:00100000:3.0:1789431568.407218:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296266
00000100:00100000:3.0:1789431568.418163:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.418364:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933588480
00000100:00100000:0.0:1789431568.418374:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933588480
00002000:00100000:0.0:1789431568.418424:0:14435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x51a:0x0] (0->4095)  req@ffff90ce35e44000 x1876351933588480/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/0 e 0 to 0 dl 1789431579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431568.418436:0:14435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce35e44000 with x1876351933588480 ext(0->4095)
00002000:00010000:0.0:1789431568.418442:0:14435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce35e44000
00000100:00100000:0.0:1789431568.418478:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1573
00000100:00100000:0.0:1789431568.418489:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+66:2347:x1876351933588480:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:0.0:1789431568.418906:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2347:x1876351933588480:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 416us (750us total) trans 4294969675 rc 0/0
00000100:00100000:0.0:1789431568.418915:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1573
00002000:00100000:0.0:1789431568.418923:0:14435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x51a:0x0] (0->4095)  req@ffff90ce35e44000 x1876351933588480/t4294969675(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/448 e 0 to 0 dl 1789431579 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431568.418934:0:14435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce35e44000 with x1876351933588480 ext(0->4095)
00002000:00010000:0.0:1789431568.418939:0:14435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce35e44000
00000001:00080000:1.0:1789431568.421897:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970067 is committed
00000100:00100000:3.0:1789431568.422076:0:14464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2347:x1876351933587840:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 49057us (49217us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431568.422089:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8403
00000100:00100000:3.0:1789431568.423272:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.423325:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933588608
00000100:00100000:1.0:1789431568.423333:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933588608
00000100:00100000:1.0:1789431568.423393:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296267
00000100:00100000:1.0:1789431568.423403:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce35e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933588608:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:1.0:1789431568.423517:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce35e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933588608:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 115us (292us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431568.423524:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296267
00000100:00100000:3.0:1789431568.427660:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.427664:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.427743:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933588864
00000100:00100000:2.0:1789431568.427753:0:14499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933588864
00000100:00100000:2.0:1789431568.427807:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8405
00000100:00100000:2.0:1789431568.427816:0:14499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2347:x1876351933588864:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:1.0:1789431568.428537:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933588736
00000100:00100000:1.0:1789431568.428544:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933588736
00002000:00100000:1.0:1789431568.428587:0:14439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x51a:0x0] (0->4095)  req@ffff90cf3afcca80 x1876351933588736/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/0 e 0 to 0 dl 1789431579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431568.428598:0:14439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3afcca80 with x1876351933588736 ext(0->4095)
00002000:00010000:1.0:1789431568.428604:0:14439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3afcca80
00000100:00100000:1.0:1789431568.428632:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1574
00000100:00100000:1.0:1789431568.428642:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2349:x1876351933588736:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:1.0:1789431568.429956:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2349:x1876351933588736:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 1308us (2282us total) trans 4294970068 rc 0/0
00000100:00100000:1.0:1789431568.429966:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1574
00002000:00100000:1.0:1789431568.429977:0:14439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x51a:0x0] (0->4095)  req@ffff90cf3afcca80 x1876351933588736/t4294970068(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/448 e 0 to 0 dl 1789431579 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431568.429986:0:14439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3afcca80 with x1876351933588736 ext(0->4095)
00002000:00010000:1.0:1789431568.429991:0:14439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3afcca80
00000100:00100000:0.0:1789431568.437593:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.437658:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933588992
00000100:00100000:2.0:1789431568.437670:0:14490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933588992
00000100:00100000:2.0:1789431568.437735:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8406
00000100:00100000:2.0:1789431568.437745:0:14490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2348:x1876351933588992:12345-192.168.203.4@tcp:16:dbench.0
00000001:00080000:0.0:1789431568.484726:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969675 is committed
00000100:00100000:2.0:1789431568.484912:0:14499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2347:x1876351933588864:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 57091us (57256us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.484924:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8405
00000100:00100000:2.0:1789431568.493186:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.493441:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933589248
00000100:00100000:0.0:1789431568.493452:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933589248
00000100:00100000:0.0:1789431568.493513:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12540
00000100:00100000:0.0:1789431568.493522:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+193:14617:x1876351933589248:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431568.493886:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+194:14617:x1876351933589248:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 364us (707us total) trans 4295121133 rc 0/0
00000100:00100000:0.0:1789431568.493894:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12540
00000100:00100000:3.0:1789431568.497395:0:14490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2348:x1876351933588992:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 59640us (59798us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431568.497410:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8406
00000001:00080000:0.0:1789431568.497871:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970068 is committed
00000100:00100000:2.0:1789431568.503323:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.503407:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933589376
00000100:00100000:3.0:1789431568.503417:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933589376
00000100:00100000:3.0:1789431568.503479:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296268
00000100:00100000:3.0:1789431568.503488:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+194:14617:x1876351933589376:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431568.503514:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431568.503536:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527a4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c92ab expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.503596:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63527a55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.503611:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63527a55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.503622:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63527a55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.503638:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63527a5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.503649:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63527a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.503655:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63527a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.503921:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527a63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.503930:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.503938:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431568.503971:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab0:0x0]: returning size 85026
00000004:00200000:3.0:1789431568.503976:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431568.503995:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.504006:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.504015:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63527a55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.504021:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63527a55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.504028:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63527a55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.504037:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7acc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431568.504042:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63527a55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.504088:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63527a55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.504100:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431568.504103:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431568.504108:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63527a55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.504115:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7acc00/0xd8e438fb63527a55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.504127:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63527a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.504133:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63527a5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.504139:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63527a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.504143:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b7ac600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431568.504146:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63527a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.504152:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63527a5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.504164:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431568.504166:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431568.504169:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63527a5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.504174:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ac600/0xd8e438fb63527a5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.504203:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad800/0xd8e438fb63527a4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ab expref: 196 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.504217:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ab expref: 195 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.504311:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90cf18b78c00)
00010000:00010000:3.0:1789431568.504314:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431568.504317:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b7ad400, rc 0)
00000100:00100000:2.0:1789431568.505133:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14617:x1876351933589376:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1640us (1814us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.505143:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296268
00000100:00100000:1.0:1789431568.513565:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.513649:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933589632
00000100:00100000:3.0:1789431568.513661:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933589632
00000100:00100000:3.0:1789431568.513741:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296269
00000100:00100000:3.0:1789431568.513752:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b9d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14617:x1876351933589632:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431568.513774:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431568.513798:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527a6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c92b2 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.513895:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527a71 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.513914:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527a63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ab expref: 196 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.513923:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527a71 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.513956:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ab expref: 196 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.513969:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527a63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ab expref: 196 pid: 5849 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431568.513982:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce36219880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894253056:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431568.514107:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf107bad80 going to sleep for 11 seconds
00000100:00100000:3.0:1789431568.518883:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce36219880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894253056:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431568.518916:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527a71 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.520578:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.520741:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933589760
00000100:00100000:2.0:1789431568.520753:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933589760
00010000:00010000:2.0:1789431568.520795:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527a63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ab expref: 197 pid: 5849 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.520861:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16686
00000100:00100000:2.0:1789431568.520872:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb04850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:2348:x1876351933589760:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431568.520887:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431568.520894:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527a63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ab expref: 197 pid: 5849 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.520908:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ab expref: 197 pid: 5849 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.520930:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b7ad400/0xd8e438fb63527a63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ab expref: 197 pid: 5849 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.520957:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90cf18b78c00)
00010000:00010000:2.0:1789431568.520963:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527a71 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.520972:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527a71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.520980:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527a71 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.521010:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431568.521037:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527a71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.521045:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527a71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431568.521095:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab0:0x0]: returning size 85026
00000100:00100000:2.0:1789431568.521096:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb04850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:2348:x1876351933589760:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 226us (527us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.521106:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16686
00010000:00010000:3.0:1789431568.521248:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527a6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92b2 expref: 197 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.521268:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527a71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92b2 expref: 196 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.521275:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90cf18b78c00)
00010000:00010000:3.0:1789431568.521278:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431568.521290:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b600, rc 0)
00000100:00100000:3.0:1789431568.521705:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b9d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14617:x1876351933589632:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7953us (8147us total) trans 4295121134 rc 0/0
00000100:00100000:3.0:1789431568.521770:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296269
00000100:00100000:1.0:1789431568.522704:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.522770:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933589888
00000100:00100000:3.0:1789431568.522777:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933589888
00002000:00100000:3.0:1789431568.522817:0:14449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x51a:0x0] (0->4095)  req@ffff90cf3b9d5500 x1876351933589888/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/0 e 0 to 0 dl 1789431579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431568.522829:0:14449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3b9d5500 with x1876351933589888 ext(0->4095)
00002000:00010000:3.0:1789431568.522833:0:14449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3b9d5500
00000100:00100000:3.0:1789431568.522899:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1575
00000100:00100000:3.0:1789431568.522909:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2350:x1876351933589888:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:2.0:1789431568.523602:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2350:x1876351933589888:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 692us (913us total) trans 4294970069 rc 0/0
00000100:00100000:2.0:1789431568.523612:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1575
00002000:00100000:2.0:1789431568.523619:0:14449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x51a:0x0] (0->4095)  req@ffff90cf3b9d5500 x1876351933589888/t4294970069(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/448 e 0 to 0 dl 1789431579 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431568.523628:0:14449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3b9d5500 with x1876351933589888 ext(0->4095)
00002000:00010000:2.0:1789431568.523631:0:14449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3b9d5500
00000100:00100000:0.0:1789431568.527869:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.527993:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933590016
00000100:00100000:2.0:1789431568.528004:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933590016
00000100:00100000:2.0:1789431568.528157:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8407
00000100:00100000:2.0:1789431568.528170:0:14500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2349:x1876351933590016:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:3.0:1789431568.528407:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.528598:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933590144
00000100:00100000:2.0:1789431568.528603:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933590144
00000100:00100000:2.0:1789431568.528644:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296270
00000100:00100000:2.0:1789431568.528652:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14617:x1876351933590144:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431568.528668:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431568.528700:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527a7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c92b9 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.528775:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527a86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.528790:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527a71 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92b2 expref: 197 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.528804:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527a86 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.528837:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527a71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92b2 expref: 197 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.528850:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527a71 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92b2 expref: 197 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.528862:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d985180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894253184:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431568.528932:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf048d6cc0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431568.533282:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.533714:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933590272
00000100:00100000:1.0:1789431568.533723:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933590272
00010000:00010000:1.0:1789431568.533761:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527a71 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92b2 expref: 198 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.533798:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16687
00000100:00100000:1.0:1789431568.533808:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:2348:x1876351933590272:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431568.533821:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431568.533828:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527a71 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92b2 expref: 198 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.533841:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527a71 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92b2 expref: 198 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.533870:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90cf18b78c00)
00010000:00010000:1.0:1789431568.533876:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527a86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.533886:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527a86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.533895:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527a86 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.533915:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431568.533965:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:2348:x1876351933590272:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 160us (691us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431568.533972:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16687
00010000:00010000:2.0:1789431568.534776:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527a71 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92b2 expref: 197 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.534794:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d985180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894253184:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431568.534815:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527a86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.534823:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527a86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.534829:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527a86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431568.534874:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab0:0x0]: returning size 85026
00000004:00200000:2.0:1789431568.534878:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431568.534900:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527a86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.534932:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527a7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92b9 expref: 197 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.534946:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527a86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92b9 expref: 196 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.534954:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90cf18b78c00)
00010000:00010000:2.0:1789431568.534957:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431568.534959:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522200, rc 0)
00000100:00100000:2.0:1789431568.535150:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14617:x1876351933590144:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6497us (6743us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.535158:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296270
00000100:00100000:3.0:1789431568.554213:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.555587:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933590400
00000100:00100000:1.0:1789431568.555602:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933590400
00000100:00100000:1.0:1789431568.555654:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296271
00000100:00100000:1.0:1789431568.555665:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14617:x1876351933590400:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431568.555684:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431568.555869:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527a8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c92c0 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.555936:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527a94 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.555951:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527a94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.555963:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527a94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.555977:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527a9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.555988:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.555994:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556371:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527aa2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556381:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556389:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431568.556424:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab0:0x0]: returning size 85026
00000004:00200000:1.0:1789431568.556428:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431568.556448:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556459:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556467:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527a94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556473:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527a94 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556480:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527a94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556490:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431568.556495:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527a94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556503:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527a94 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556514:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431568.556517:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431568.556522:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527a94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556528:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527a94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556540:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556547:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527a9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556552:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527a9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556557:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431568.556559:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527a9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556565:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527a9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556575:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90ce03149400)
00010000:00010000:1.0:1789431568.556578:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431568.556581:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527a9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556586:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527a9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556615:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527a8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92c0 expref: 198 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556628:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92c0 expref: 197 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.556635:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90cf18b78c00)
00010000:00010000:1.0:1789431568.556638:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431568.556640:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:1.0:1789431568.558146:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14617:x1876351933590400:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2475us (3934us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431568.558157:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296271
00000100:00100000:3.0:1789431568.563134:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.563209:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933590656
00000100:00100000:0.0:1789431568.563227:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933590656
00000100:00100000:0.0:1789431568.563278:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296272
00000100:00100000:0.0:1789431568.563287:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14617:x1876351933590656:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431568.563343:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:0.0:1789431568.563368:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527aa2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92c0 expref: 197 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.563390:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527a86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92b9 expref: 196 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.563405:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90cf18b78c00)
00010000:00010000:0.0:1789431568.563410:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431568.563449:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527aa9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.563463:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.563472:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431568.563598:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e09138cf reply state 000000008c007491 transno 4295121135 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431568.563607:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431568.563705:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14617:x1876351933590656:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 418us (578us total) trans 4295121135 rc 0/0
00000100:00100000:0.0:1789431568.563718:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296272
00000001:00080000:2.0:1789431568.565255:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970069 is committed
00000100:00100000:1.0:1789431568.565466:0:14500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2349:x1876351933590016:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 37296us (37602us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431568.565477:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8407
00010000:00010000:0.0:1789431568.569389:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.569409:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527aa9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.569417:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527aa9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.569423:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431568.569427:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527aa9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.569436:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527aa9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.569454:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90cf18b78c00)
00010000:00010000:0.0:1789431568.569457:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431568.569462:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527aa9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.569469:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527aa9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.571501:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.572209:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933590784
00000100:00100000:3.0:1789431568.572220:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933590784
00000100:00100000:3.0:1789431568.572586:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296273
00000100:00100000:3.0:1789431568.572598:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933590784:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431568.572621:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431568.572641:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527ab0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c92c7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.572716:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ab7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.572731:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.572742:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.572757:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527abe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.572764:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.572770:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573036:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527ac5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573046:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573205:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431568.573254:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab1:0x0]: returning size 85026
00000004:00200000:3.0:1789431568.573259:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431568.573289:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573301:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573539:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573547:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ab7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573554:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573560:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431568.573564:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573572:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ab7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573584:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431568.573587:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431568.573592:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ab7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573598:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ab7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573611:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573621:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527abe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573626:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527abe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573631:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431568.573634:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527abe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573640:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527abe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573646:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431568.573648:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431568.573651:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527abe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573656:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527abe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573702:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527ab0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92c7 expref: 198 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573717:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92c7 expref: 197 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.573724:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90cf18b78400)
00010000:00010000:3.0:1789431568.573727:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431568.573730:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a000, rc 0)
00000100:00100000:3.0:1789431568.573841:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14616:x1876351933590784:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1246us (2349us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431568.573849:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296273
00000100:00100000:3.0:1789431568.577953:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.578683:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.579037:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933591040
00000100:00100000:2.0:1789431568.579081:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933591040
00000100:00100000:2.0:1789431568.579143:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14375
00000100:00100000:2.0:1789431568.579154:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:2349:x1876351933591040:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431568.579169:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431568.579192:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527ac5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92c7 expref: 197 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.579211:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90cf18b78400)
00010000:00010000:2.0:1789431568.579218:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431568.579289:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:2349:x1876351933591040:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 131us (602us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.579300:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14375
00000100:00100000:0.0:1789431568.580628:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.580723:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933591296
00000100:00100000:2.0:1789431568.580731:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933591296
00000100:00100000:2.0:1789431568.580779:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296274
00000100:00100000:2.0:1789431568.580789:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3afcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933591296:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431568.580839:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431568.580862:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527a16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9296 expref: 196 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.580878:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90cf18b78400)
00010000:00010000:2.0:1789431568.580889:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431568.580935:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527acc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.580948:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.580958:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431568.581147:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fa3b36a6 reply state 000000003603d69c transno 4295121136 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.581156:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431568.581249:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3afcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14616:x1876351933591296:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 461us (625us total) trans 4295121136 rc 0/0
00000100:00100000:2.0:1789431568.581256:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296274
00000100:00100000:1.0:1789431568.582502:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933590912
00000100:00100000:1.0:1789431568.582514:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933590912
00000100:00100000:1.0:1789431568.582606:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8408
00000100:00100000:1.0:1789431568.582616:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+65:2350:x1876351933590912:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:1.0:1789431568.582851:0:14468:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x51a:0x0] updating lvb size from disk: 85026 -> 85026
00002000:00010000:1.0:1789431568.582855:0:14468:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x51a:0x0] updating lvb mtime from disk: 1789431555 -> 1789431555
00002000:00010000:1.0:1789431568.582858:0:14468:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x51a:0x0] updating lvb atime from disk: 1789431557 -> 1789431547
00002000:00010000:1.0:1789431568.582860:0:14468:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x51a:0x0] updating lvb ctime from disk: 1789431567 -> 1789431568
00002000:00010000:1.0:1789431568.582862:0:14468:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x51a:0x0] updating lvb blocks from disk: 259 -> 259
00000100:00100000:1.0:1789431568.582924:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+66:2350:x1876351933590912:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 309us (4980us total) trans 4294969676 rc 0/0
00000100:00100000:1.0:1789431568.582931:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8408
00010000:00010000:2.0:1789431568.586425:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.586442:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527acc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.586451:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527acc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.586457:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431568.586463:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527acc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.586470:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527acc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.586487:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90cf13195300)
00010000:00010000:2.0:1789431568.586490:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431568.586495:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527acc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.586501:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527acc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.589803:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.589846:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.590177:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933591424
00000100:00100000:0.0:1789431568.590187:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933591424
00000100:00100000:0.0:1789431568.590255:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296275
00000100:00100000:0.0:1789431568.590265:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933591424:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431568.590289:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431568.590319:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527ad3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c92ce expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.590391:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ce expref: 197 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.590406:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3600/0xd8e438fb63527ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ce expref: 197 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.590426:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:0.0:1789431568.590430:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00010000:0.0:1789431568.590435:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3600, rc 0)
00000100:00100000:0.0:1789431568.590491:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14616:x1876351933591424:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 228us (699us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431568.590498:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296275
00000100:00100000:1.0:1789431568.590673:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933591680
00000100:00100000:1.0:1789431568.590679:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933591680
00000100:00100000:1.0:1789431568.590738:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12541
00000100:00100000:1.0:1789431568.590747:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14617:x1876351933591680:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431568.590942:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933591680:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 196us (1094us total) trans 4295121137 rc 0/0
00000100:00100000:1.0:1789431568.590949:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12541
00000100:00100000:0.0:1789431568.596858:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.596902:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.597023:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933591808
00000100:00100000:2.0:1789431568.597035:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933591808
00000100:00100000:2.0:1789431568.597123:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296276
00000100:00100000:2.0:1789431568.597133:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933591808:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431568.597157:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431568.597179:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527ada lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c92d5 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.597262:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527ae1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.597277:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.597299:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.597344:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933591936
00000100:00100000:1.0:1789431568.597349:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933591936
00000100:00100000:1.0:1789431568.597500:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8409
00010000:00010000:2.0:1789431568.597500:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527ae8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.597508:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2347:x1876351933591936:12345-192.168.203.4@tcp:2:dbench.0
00010000:00010000:2.0:1789431568.597510:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.597517:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789431568.597733:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x51a:0x0] updating lvb size from disk: 0 -> 85026
00002000:00010000:1.0:1789431568.597737:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x51a:0x0] updating lvb mtime from disk: 0 -> 1789431556
00002000:00010000:1.0:1789431568.597739:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x51a:0x0] updating lvb atime from disk: 0 -> 1789431557
00002000:00010000:1.0:1789431568.597742:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x51a:0x0] updating lvb ctime from disk: 0 -> 1789431568
00002000:00010000:1.0:1789431568.597744:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x51a:0x0] updating lvb blocks from disk: 1 -> 259
00000100:00100000:1.0:1789431568.597806:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2347:x1876351933591936:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 298us (902us total) trans 4294970070 rc 0/0
00000100:00100000:1.0:1789431568.597814:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8409
00010000:00010000:2.0:1789431568.598028:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527aef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598038:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598045:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431568.598186:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab0:0x0]: returning size 85026
00000004:00200000:2.0:1789431568.598191:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431568.598206:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598219:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598227:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598232:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527ae1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598238:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598244:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431568.598248:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598255:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527ae1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598266:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431568.598269:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431568.598273:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527ae1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598278:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527ae1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598288:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598294:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527ae8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598300:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598306:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431568.598308:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598314:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527ae8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598321:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xa36e7a4 (ffff90cf13195b00)
00010000:00010000:2.0:1789431568.598323:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431568.598326:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527ae8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598332:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527ae8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598361:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527ada lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92d5 expref: 200 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598910:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92d5 expref: 199 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.598921:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90cf18b78c00)
00010000:00010000:2.0:1789431568.598924:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431568.598927:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522200, rc 0)
00000100:00100000:2.0:1789431568.599194:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933591808:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2061us (2343us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.599203:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296276
00000100:00100000:0.0:1789431568.600427:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.600497:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933592192
00000100:00100000:3.0:1789431568.600507:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933592192
00000100:00100000:3.0:1789431568.600565:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296277
00000100:00100000:3.0:1789431568.600575:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14616:x1876351933592192:12345-192.168.203.4@tcp:55:dbench.0
00010000:00010000:3.0:1789431568.600634:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527af6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.600650:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527af6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.600662:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527af6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.600687:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527af6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.600855:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527af6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.600865:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527af6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.600872:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431568.600876:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527af6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.600884:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527af6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.600896:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:3.0:1789431568.600899:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:3.0:1789431568.600903:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527af6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.600909:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527af6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431568.601009:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14616:x1876351933592192:12345-192.168.203.4@tcp:55:dbench.0 Request processed in 434us (586us total) trans 0 rc -22/-22
00000100:00100000:3.0:1789431568.601017:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296277
00000100:00100000:0.0:1789431568.607362:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.607504:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933592576
00000100:00100000:2.0:1789431568.607514:0:14532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933592576
00002000:00100000:2.0:1789431568.607561:0:14532:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x51a:0x0] (0->4095)  req@ffff90ce029f4700 x1876351933592576/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/0 e 0 to 0 dl 1789431579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431568.607572:0:14532:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce029f4700 with x1876351933592576 ext(0->4095)
00002000:00010000:2.0:1789431568.607578:0:14532:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce029f4700
00000100:00100000:2.0:1789431568.607600:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1576
00000100:00100000:2.0:1789431568.607607:0:14532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2350:x1876351933592576:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:0.0:1789431568.609002:0:14532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2350:x1876351933592576:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 1386us (1645us total) trans 4294970071 rc 0/0
00000100:00100000:0.0:1789431568.609014:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1576
00002000:00100000:0.0:1789431568.609025:0:14532:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x51a:0x0] (0->4095)  req@ffff90ce029f4700 x1876351933592576/t4294970071(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:39/0 lens 4584/448 e 0 to 0 dl 1789431579 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431568.609035:0:14532:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce029f4700 with x1876351933592576 ext(0->4095)
00002000:00010000:0.0:1789431568.609039:0:14532:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce029f4700
00000100:00100000:2.0:1789431568.609256:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.609317:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933592448
00000100:00100000:1.0:1789431568.609324:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933592448
00000100:00100000:1.0:1789431568.609359:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296278
00000100:00100000:1.0:1789431568.609365:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933592448:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431568.609387:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431568.609406:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527afd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c92dc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.609498:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.609513:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527aef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92d5 expref: 200 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.609522:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b04 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.609558:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92d5 expref: 200 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.609573:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527aef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92d5 expref: 200 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.609585:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3c154700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894253312:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431568.609645:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f36c0 going to sleep for 11 seconds
00000100:00100000:1.0:1789431568.613156:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3c154700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894253312:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431568.613186:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.614516:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.614559:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.614918:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933592704
00000100:00100000:1.0:1789431568.614929:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933592704
00010000:00010000:1.0:1789431568.614971:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527aef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92d5 expref: 201 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.615015:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16688
00000100:00100000:1.0:1789431568.615025:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d986300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:2347:x1876351933592704:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431568.615039:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431568.615045:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527aef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92d5 expref: 201 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.615095:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92d5 expref: 201 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.615117:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527aef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92d5 expref: 201 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.615133:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90cf18b78c00)
00010000:00010000:1.0:1789431568.615139:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.615148:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.615157:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b04 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.615179:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431568.615231:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d986300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:2347:x1876351933592704:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 207us (722us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431568.615239:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16688
00010000:00010000:0.0:1789431568.615607:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.615616:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431568.615637:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab0:0x0]: returning size 85026
00010000:00010000:0.0:1789431568.615815:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527afd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92dc expref: 201 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.615834:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92dc expref: 200 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.616157:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90cf18b78c00)
00010000:00010000:0.0:1789431568.616160:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431568.616164:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308c00, rc 0)
00000100:00100000:0.0:1789431568.616216:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14617:x1876351933592448:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6849us (6959us total) trans 4295121138 rc 0/0
00000100:00100000:0.0:1789431568.616224:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296278
00000100:00100000:0.0:1789431568.616245:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933592832
00000100:00100000:0.0:1789431568.616250:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933592832
00000100:00100000:0.0:1789431568.616285:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296279
00000100:00100000:0.0:1789431568.616293:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14616:x1876351933592832:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:0.0:1789431568.616473:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14616:x1876351933592832:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 180us (1913us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431568.616480:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296279
00000100:00100000:2.0:1789431568.619662:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.619804:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933592960
00000100:00100000:0.0:1789431568.619814:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933592960
00000100:00100000:0.0:1789431568.619924:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8410
00000100:00100000:0.0:1789431568.619935:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2347:x1876351933592960:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:1.0:1789431568.625201:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.625246:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933593088
00000100:00100000:1.0:1789431568.625256:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933593088
00000100:00100000:1.0:1789431568.625307:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296280
00000100:00100000:1.0:1789431568.625317:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14617:x1876351933593088:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431568.625341:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431568.625363:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527b12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c92e3 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.625450:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527b19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.625465:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b04 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92dc expref: 201 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.625474:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527b19 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.625509:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92dc expref: 201 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.625522:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92dc expref: 201 pid: 5848 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.625539:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3c155c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894253440:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431568.625614:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3840 going to sleep for 11 seconds
00000100:00100000:0.0:1789431568.630939:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.631003:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933593216
00000100:00100000:2.0:1789431568.631013:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933593216
00010000:00010000:2.0:1789431568.631084:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b04 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92dc expref: 202 pid: 5848 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.631116:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16689
00000100:00100000:2.0:1789431568.631126:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:2347:x1876351933593216:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431568.631141:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431568.631147:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b04 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92dc expref: 202 pid: 5848 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.631159:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92dc expref: 202 pid: 5848 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.631182:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90cf18b78c00)
00010000:00010000:2.0:1789431568.631188:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527b19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.631197:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.631206:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527b19 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.631235:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431568.631301:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:2347:x1876351933593216:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 176us (371us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.631309:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16689
00010000:00010000:1.0:1789431568.631426:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92dc expref: 201 pid: 5848 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.631443:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3c155c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894253440:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431568.631465:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.631475:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.631481:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431568.631529:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab0:0x0]: returning size 85026
00000004:00200000:1.0:1789431568.631534:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431568.631556:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.631591:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527b12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92e3 expref: 201 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.631609:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308600/0xd8e438fb63527b19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92e3 expref: 200 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.631618:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab0:0x0].0x0 (ffff90cf18b78c00)
00010000:00010000:1.0:1789431568.631621:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431568.631624:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308600, rc 0)
00000100:00100000:1.0:1789431568.631650:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14617:x1876351933593088:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6335us (6458us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431568.631658:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296280
00000100:00100000:2.0:1789431568.637775:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.638030:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933593344
00000100:00100000:2.0:1789431568.638040:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933593344
00000100:00100000:2.0:1789431568.638740:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296281
00000100:00100000:2.0:1789431568.638751:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14617:x1876351933593344:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431568.638772:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431568.638793:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527b20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c92ea expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.639134:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527b27 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.639150:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527b27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.639167:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527b27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.639181:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527b2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.639189:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.639196:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640090:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527b35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640103:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640111:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431568.640146:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:2.0:1789431568.640150:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431568.640170:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640182:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640191:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527b27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640202:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527b27 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640210:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527b27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640215:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431568.640219:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527b27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640236:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527b27 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640247:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431568.640249:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431568.640254:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527b27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640259:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527b27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640272:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640278:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527b2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640441:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527b2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640447:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431568.640450:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527b2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640456:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527b2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640464:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xbb97fc59 (ffff90cf13195b00)
00010000:00010000:2.0:1789431568.640467:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431568.640470:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527b2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640475:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527b2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640511:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527b20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ea expref: 202 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640525:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527b35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ea expref: 201 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.640533:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:2.0:1789431568.640535:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431568.640538:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523c00, rc 0)
00000100:00100000:2.0:1789431568.640593:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:14617:x1876351933593344:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1844us (2828us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.640600:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296281
00000100:00100000:1.0:1789431568.653231:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.653768:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933593600
00000100:00100000:2.0:1789431568.653780:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933593600
00000100:00100000:2.0:1789431568.653838:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296282
00000100:00100000:2.0:1789431568.653849:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:14617:x1876351933593600:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431568.653869:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431568.653890:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527b3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c92f1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.654006:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527b43 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.654022:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527b35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ea expref: 202 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.654032:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527b43 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.654293:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527b35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ea expref: 202 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.654308:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527b35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ea expref: 202 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.654323:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d985c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894253568:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431568.654405:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf11f8b780 going to sleep for 11 seconds
00000100:00100000:2.0:1789431568.663030:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.663591:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d985c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894253568:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431568.663615:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527b43 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.664524:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933593728
00000100:00100000:1.0:1789431568.664534:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933593728
00010000:00010000:1.0:1789431568.664572:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527b35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ea expref: 203 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.664612:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16690
00000100:00100000:1.0:1789431568.664621:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d986d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:2348:x1876351933593728:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431568.664634:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431568.664642:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527b35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ea expref: 203 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.664655:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527b35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ea expref: 203 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.664679:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527b35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ea expref: 203 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.664702:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:1.0:1789431568.664714:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527b43 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.664725:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527b43 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.664734:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527b43 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.664763:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431568.664817:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d986d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:2348:x1876351933593728:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 196us (1796us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431568.664825:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16690
00010000:00010000:1.0:1789431568.666032:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527b43 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.666046:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527b43 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431568.666154:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00010000:00010000:1.0:1789431568.666495:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527b3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92f1 expref: 203 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.666516:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527b43 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92f1 expref: 202 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.666526:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:1.0:1789431568.666528:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431568.666532:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522600, rc 0)
00000100:00100000:1.0:1789431568.666589:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:14617:x1876351933593600:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12742us (13376us total) trans 4295121139 rc 0/0
00000100:00100000:1.0:1789431568.666598:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296282
00000100:00100000:1.0:1789431568.673561:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.673599:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933593856
00000100:00100000:1.0:1789431568.673609:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933593856
00000100:00100000:1.0:1789431568.673656:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296283
00000100:00100000:1.0:1789431568.673666:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:14617:x1876351933593856:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431568.673701:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431568.673728:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527b51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c92f8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.673812:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527b58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.673827:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527b43 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92f1 expref: 203 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.673835:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527b58 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.673866:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527b43 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92f1 expref: 203 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.673880:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527b43 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92f1 expref: 203 pid: 5848 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.673893:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3c157100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894253696:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431568.673976:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3840 going to sleep for 11 seconds
00000001:00080000:2.0:1789431568.682080:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970070 is committed
00000001:00080000:2.0:1789431568.682100:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970071 is committed
00000100:00100000:0.0:1789431568.683873:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2347:x1876351933592960:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 63927us (64206us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431568.683888:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8410
00000100:00100000:3.0:1789431568.688043:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3c157100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894253696:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431568.688165:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431568.688902:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431568.689450:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527b58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431568.689569:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933593984
00000100:00100000:0.0:1789431568.689578:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933593984
00010000:00010000:1.0:1789431568.689770:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527b43 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92f1 expref: 204 pid: 5848 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.689850:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16691
00000100:00100000:1.0:1789431568.689861:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c157480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:2348:x1876351933593984:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431568.689878:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431568.689885:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527b43 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92f1 expref: 204 pid: 5848 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.689896:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527b43 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92f1 expref: 204 pid: 5848 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.689991:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527b43 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aac:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92f1 expref: 204 pid: 5848 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.690007:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:1.0:1789431568.690012:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527b58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.690021:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.690030:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527b58 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.690157:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527b58 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.690165:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527b58 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431568.690214:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:3.0:1789431568.690602:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431568.690632:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527b58 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.690666:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527b51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92f8 expref: 204 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.690683:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527b58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92f8 expref: 203 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.690702:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431568.690712:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431568.690715:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:3.0:1789431568.690770:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14617:x1876351933593856:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 17105us (17218us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431568.690779:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296283
00010000:00010000:1.0:1789431568.691615:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431568.691655:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c157480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:2348:x1876351933593984:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1794us (2753us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431568.691664:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16691
00000100:00100000:2.0:1789431568.703526:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.703567:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.704325:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933594240
00000100:00100000:0.0:1789431568.704337:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933594240
00000100:00100000:0.0:1789431568.704391:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933594496
00000100:00100000:0.0:1789431568.704395:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933594496
00000100:00100000:0.0:1789431568.704420:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12542
00000100:00100000:0.0:1789431568.704430:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14616:x1876351933594240:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431568.704763:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:14616:x1876351933594240:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 333us (1248us total) trans 4295121140 rc 0/0
00000100:00100000:0.0:1789431568.704770:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12542
00000100:00100000:0.0:1789431568.704787:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12543
00000100:00100000:0.0:1789431568.704793:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14617:x1876351933594496:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431568.704864:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:14617:x1876351933594496:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 72us (1297us total) trans 4295121141 rc 0/0
00000100:00100000:0.0:1789431568.704870:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12543
00000100:00100000:2.0:1789431568.709985:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.710182:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933594624
00000100:00100000:3.0:1789431568.710192:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933594624
00000100:00100000:3.0:1789431568.710256:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296284
00000100:00100000:3.0:1789431568.710267:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:14617:x1876351933594624:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431568.710287:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431568.710309:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527b5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c92ff expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710371:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527b66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710386:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527b66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710398:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527b66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710413:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527b6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710421:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710427:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710679:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527b74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710697:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710706:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431568.710742:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aac:0x0]: returning size 83190
00000004:00200000:3.0:1789431568.710746:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431568.710765:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710775:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710783:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527b66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710789:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527b66 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710795:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527b66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710804:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431568.710809:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527b66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710817:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527b66 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710828:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431568.710831:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431568.710836:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527b66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710841:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527b66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710852:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710857:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527b6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710862:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710867:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431568.710870:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710876:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527b6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710887:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xbb97fc59 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431568.710890:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431568.710892:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527b6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710898:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527b6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710939:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527b5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ff expref: 206 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710953:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527b74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ff expref: 205 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.710960:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431568.710962:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431568.710965:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7be00, rc 0)
00000100:00100000:3.0:1789431568.711027:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14617:x1876351933594624:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 763us (1051us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431568.711035:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296284
00000100:00100000:0.0:1789431568.720758:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.720798:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.720897:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933594752
00000100:00100000:1.0:1789431568.720907:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933594752
00000100:00100000:1.0:1789431568.720965:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296285
00000100:00100000:1.0:1789431568.720974:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14616:x1876351933594752:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431568.720998:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431568.721019:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527b7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9306 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721328:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527b82 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721343:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527b82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721354:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527b82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721369:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527b89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721375:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721381:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721618:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527b90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721627:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721635:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431568.721667:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab1:0x0]: returning size 85026
00000004:00200000:1.0:1789431568.721672:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431568.721702:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721713:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721721:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527b82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721728:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527b82 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721734:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527b82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721740:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431568.721745:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527b82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721752:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527b82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721763:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431568.721766:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431568.721771:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527b82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721777:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527b82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721790:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721800:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527b89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721806:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527b89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721811:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431568.721814:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527b89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721819:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527b89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721826:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce03149d00)
00010000:00010000:1.0:1789431568.721829:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431568.721832:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527b89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721837:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527b89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721869:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527b7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9306 expref: 207 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721883:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527b90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9306 expref: 206 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.721891:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:1.0:1789431568.721893:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431568.721896:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308200, rc 0)
00000100:00100000:1.0:1789431568.721972:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14616:x1876351933594752:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 998us (1224us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431568.721981:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296285
00000100:00100000:3.0:1789431568.722782:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933594880
00000100:00100000:3.0:1789431568.722792:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933594880
00000100:00100000:3.0:1789431568.722847:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14376
00000100:00100000:3.0:1789431568.722856:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb05850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2349:x1876351933594880:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431568.722869:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431568.722887:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527b74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92ff expref: 206 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.722907:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:3.0:1789431568.722920:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431568.722961:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb05850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:2349:x1876351933594880:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 105us (2161us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431568.722967:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14376
00000100:00100000:0.0:1789431568.732854:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.735162:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933595136
00000100:00100000:1.0:1789431568.735178:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933595136
00000100:00100000:1.0:1789431568.735248:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296286
00000100:00100000:1.0:1789431568.735259:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce029f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14617:x1876351933595136:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431568.735315:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:1.0:1789431568.735439:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527b58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c92f8 expref: 205 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.735461:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527213 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aac:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c902e expref: 204 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.735473:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90cf18b78500)
00010000:00010000:1.0:1789431568.735485:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431568.735507:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.735522:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.735533:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.735551:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527b9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431568.735560:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431568.735563:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527b9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.735572:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527b9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.735837:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933595392
00000100:00100000:2.0:1789431568.735843:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933595392
00000100:00100000:2.0:1789431568.735880:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296287
00000100:00100000:2.0:1789431568.735887:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:14616:x1876351933595392:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431568.735897:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431568.735909:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527ba5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c930d expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.735999:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527bac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.736012:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527b90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9306 expref: 205 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.736019:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527bac lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.736085:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527b90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9306 expref: 205 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.736099:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527b90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9306 expref: 205 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.736113:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e95500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894253824:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431568.736209:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf11f8b780 going to sleep for 11 seconds
00010000:00010000:1.0:1789431568.736240:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bb3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.736250:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.736258:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431568.737419:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1249, 64 off88128
00000004:00080000:1.0:1789431568.737431:0:12181:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3026768381844ns, next at 3027768379047ns, rc = 0
00010000:00010000:1.0:1789431568.737501:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527bba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737514:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527bba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737523:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527bba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737532:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527bba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737538:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527bba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737545:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527bba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737568:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431568.737589:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737596:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bb3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737602:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737607:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431568.737611:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737619:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bb3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737630:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90ce03149500)
00010000:00010000:1.0:1789431568.737633:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431568.737637:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bb3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737643:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bb3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aac:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737660:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737666:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b97 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737675:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737680:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431568.737683:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737699:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737707:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431568.737709:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431568.737712:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b97 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.737717:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527b97 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431568.737726:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000024daf947 reply state 00000000407219f2 transno 4295121142 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527b9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.737734:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431568.737819:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce029f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14617:x1876351933595136:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2559us (4971us total) trans 4295121142 rc 0/0
00000100:00100000:1.0:1789431568.737837:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296286
00010000:00010000:0.0:1789431568.738792:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1789431568.738802:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527bba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.738811:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:0.0:1789431568.738815:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527bba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.738823:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527bba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.738836:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aac:0x0].0x0 (ffff90ce03149500)
00010000:00010000:0.0:1789431568.738838:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:0.0:1789431568.738842:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527bba lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.738848:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527bba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aac:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.738864:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431568.738866:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431568.738868:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431568.741279:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e95500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894253824:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431568.741309:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527bac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431568.743776:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.743955:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933595520
00000100:00100000:2.0:1789431568.743964:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933595520
00010000:00010000:2.0:1789431568.744002:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527b90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9306 expref: 207 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.744043:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16692
00000100:00100000:2.0:1789431568.744090:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:2348:x1876351933595520:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431568.744104:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431568.744111:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527b90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9306 expref: 207 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.744124:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527b90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9306 expref: 207 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.744146:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527b90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9306 expref: 207 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.744160:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:2.0:1789431568.744165:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527bac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.744175:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527bac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.744182:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527bac lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.744202:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431568.744264:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2348:x1876351933595520:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 175us (495us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.744275:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16692
00010000:00010000:3.0:1789431568.744415:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527bac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.744423:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527bac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431568.744443:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab1:0x0]: returning size 85026
00010000:00010000:3.0:1789431568.744588:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527ba5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c930d expref: 207 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.744604:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527bac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c930d expref: 206 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.744611:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:3.0:1789431568.744613:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431568.744616:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522e00, rc 0)
00000100:00100000:3.0:1789431568.744641:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14616:x1876351933595392:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8755us (9087us total) trans 4295121143 rc 0/0
00000100:00100000:3.0:1789431568.744649:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296287
00010000:00010000:0.0:1789431568.748828:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527b9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.748845:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527b9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.748853:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527b9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.748858:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431568.748864:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527b9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.748871:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527b9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.748890:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xbb97fc59 (ffff90ce03149400)
00010000:00010000:0.0:1789431568.748893:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431568.748898:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527b9e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.748905:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527b9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431568.757649:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.757848:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933595648
00000100:00100000:1.0:1789431568.757860:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933595648
00000100:00100000:1.0:1789431568.758041:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296288
00000100:00100000:1.0:1789431568.758106:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14616:x1876351933595648:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431568.758131:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431568.758153:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527bc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9314 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.758238:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.758253:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527bac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c930d expref: 206 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.758262:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bcf lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.758296:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527bac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c930d expref: 206 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.758309:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527bac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c930d expref: 206 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.758332:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3c157800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894253952:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431568.758412:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3900 going to sleep for 11 seconds
00000100:00100000:2.0:1789431568.765817:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.766090:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3c157800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894253952:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431568.766119:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431568.766479:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933595776
00000100:00100000:3.0:1789431568.766487:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933595776
00000100:00100000:3.0:1789431568.766538:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296289
00000100:00100000:3.0:1789431568.766548:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14617:x1876351933595776:12345-192.168.203.4@tcp:41:dbench.0
00000004:00000024:3.0:1789431568.766608:0:5849:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7644119040 avail 7591690240
00000100:00100000:3.0:1789431568.766684:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14617:x1876351933595776:12345-192.168.203.4@tcp:41:dbench.0 Request processed in 138us (877us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431568.766702:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296289
00000100:00100000:0.0:1789431568.768720:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.769184:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933595904
00000100:00100000:2.0:1789431568.769194:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933595904
00010000:00010000:0.0:1789431568.769380:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527bac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c930d expref: 207 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431568.769471:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16693
00000100:00100000:0.0:1789431568.769481:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:2347:x1876351933595904:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431568.769497:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431568.769505:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527bac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c930d expref: 207 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.769518:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527bac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c930d expref: 207 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.769541:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527bac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c930d expref: 207 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.769556:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:0.0:1789431568.769561:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.769591:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.769600:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bcf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.769634:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431568.769704:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2347:x1876351933595904:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 224us (998us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431568.769711:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16693
00010000:00010000:2.0:1789431568.769769:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.769778:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431568.769827:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab1:0x0]: returning size 85026
00000004:00200000:2.0:1789431568.769832:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431568.769853:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.769885:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527bc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9314 expref: 206 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.769899:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9314 expref: 205 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.769906:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:2.0:1789431568.769909:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431568.769911:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309000, rc 0)
00000100:00100000:2.0:1789431568.769959:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14616:x1876351933595648:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11909us (12321us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.769967:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296288
00000100:00100000:0.0:1789431568.774769:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.774861:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933596032
00000100:00100000:1.0:1789431568.774871:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933596032
00000100:00100000:1.0:1789431568.774937:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296290
00000100:00100000:1.0:1789431568.774948:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14617:x1876351933596032:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431568.774969:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431568.774991:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527bd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c931b expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775458:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527bdd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775475:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527bdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775486:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527bdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775504:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527be4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x16ffa7f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775511:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x16ffa7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775517:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x16ffa7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775574:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527bdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775582:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527bdd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775589:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527bdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775599:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431568.775603:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527bdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775611:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527bdd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775622:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431568.775625:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431568.775629:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527bdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775635:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527bdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775647:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x16ffa7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775653:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527be4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x16ffa7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775659:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527be4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x16ffa7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775663:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431568.775665:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527be4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x16ffa7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775671:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527be4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x16ffa7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775680:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x16ffa7f1 (ffff90ce03149d00)
00010000:00010000:1.0:1789431568.775683:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431568.775685:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527be4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x16ffa7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775702:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527be4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x16ffa7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775735:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527bd6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c931b expref: 206 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775746:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431568.775748:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431568.775752:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527bd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c931b expref: 206 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.775761:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:1.0:1789431568.775825:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14617:x1876351933596032:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 878us (1067us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431568.775833:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296290
00000100:00100000:3.0:1789431568.781170:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.785850:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933596160
00000100:00100000:2.0:1789431568.785865:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933596160
00000100:00100000:2.0:1789431568.787578:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296291
00000100:00100000:2.0:1789431568.787602:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14617:x1876351933596160:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431568.787625:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431568.787648:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527beb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9322 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.787738:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527bf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.787752:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.787762:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431568.787799:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008c:0x0]: returning size 16384
00000004:00200000:2.0:1789431568.787803:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431568.787822:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.787846:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527beb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9322 expref: 207 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.787864:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9322 expref: 206 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.787872:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431568.787874:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:2.0:1789431568.787878:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523a00, rc 0)
00000100:00100000:2.0:1789431568.787959:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14617:x1876351933596160:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 370us (6797us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.787966:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296291
00000100:00100000:0.0:1789431568.797039:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.798250:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.798625:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933596416
00000100:00100000:0.0:1789431568.798637:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933596416
00000100:00100000:0.0:1789431568.798714:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296292
00000100:00100000:0.0:1789431568.798726:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14616:x1876351933596416:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431568.798746:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431568.798765:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527bf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9329 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.798830:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c00 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.798846:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.798857:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.798871:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527c07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.798878:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527c07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.798887:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527c07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799176:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527c0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799186:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799194:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431568.799239:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab1:0x0]: returning size 85026
00000004:00200000:0.0:1789431568.799244:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431568.799262:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799273:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799282:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799289:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c00 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799297:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799304:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431568.799309:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799318:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c00 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799330:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431568.799333:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431568.799338:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799345:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799357:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527c07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799364:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527c07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799371:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527c07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799376:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431568.799380:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527c07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799386:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527c07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799393:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90ce07190f00)
00010000:00010000:0.0:1789431568.799395:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431568.799398:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527c07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799404:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527c07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799435:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527bf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9329 expref: 208 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799449:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527c0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9329 expref: 207 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.799456:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:0.0:1789431568.799459:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431568.799461:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2600, rc 0)
00000100:00100000:0.0:1789431568.799518:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14616:x1876351933596416:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 795us (1275us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431568.799526:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296292
00000100:00100000:2.0:1789431568.805337:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933596288
00000100:00100000:2.0:1789431568.805352:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933596288
00000100:00100000:0.0:1789431568.805848:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12544
00000100:00100000:0.0:1789431568.805861:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14617:x1876351933596288:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431568.810422:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.810489:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933596544
00000100:00100000:1.0:1789431568.810500:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933596544
00000100:00100000:1.0:1789431568.810560:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14377
00000100:00100000:1.0:1789431568.810570:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3babd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:2348:x1876351933596544:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431568.810593:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431568.810616:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527c0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9329 expref: 209 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.810642:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:1.0:1789431568.810647:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431568.810721:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:2348:x1876351933596544:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 152us (307us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431568.810728:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14377
00000100:00100000:1.0:1789431568.819385:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.823232:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3babc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14617:x1876351933596288:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 17363us (26193us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431568.823244:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12544
00000100:00100000:3.0:1789431568.824663:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933596800
00000100:00100000:3.0:1789431568.824675:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933596800
00000100:00100000:3.0:1789431568.824758:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296293
00000100:00100000:3.0:1789431568.824769:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14616:x1876351933596800:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431568.824829:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431568.824858:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527bcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9314 expref: 206 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.824877:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:3.0:1789431568.824882:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431568.824933:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63527c15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.824948:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63527c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.824959:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63527c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431568.825142:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000012590fbf reply state 00000000582723a3 transno 4295121144 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63527c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431568.825151:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431568.825233:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14616:x1876351933596800:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 466us (5867us total) trans 4295121144 rc 0/0
00000100:00100000:3.0:1789431568.825240:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296293
00000100:00100000:2.0:1789431568.831829:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431568.831863:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63527c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.831877:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63527c15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.831889:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63527c15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.831896:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431568.831901:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63527c15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.831909:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63527c15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.831926:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:0.0:1789431568.831929:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431568.831934:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63527c15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.831940:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63527c15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431568.832787:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933596928
00000100:00100000:3.0:1789431568.832799:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933596928
00000100:00100000:3.0:1789431568.832860:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296294
00000100:00100000:3.0:1789431568.832871:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14617:x1876351933596928:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431568.832898:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431568.832927:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527c1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9330 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.832989:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527c23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833002:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527c23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833014:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527c23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833028:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527c2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833036:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833043:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833176:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527c31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833186:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833193:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431568.833238:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10094:0x0]: returning size 260096
00000004:00200000:3.0:1789431568.833243:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431568.833260:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833272:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833280:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527c23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833286:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527c23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833292:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527c23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833302:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431568.833306:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527c23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833314:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527c23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833324:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431568.833327:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431568.833331:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527c23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833338:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527c23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833351:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833357:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527c2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833363:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527c2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833369:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431568.833372:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527c2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833378:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527c2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833389:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x469e1765 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431568.833392:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431568.833394:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527c2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833400:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527c2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833431:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527c1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9330 expref: 208 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833444:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527c31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9330 expref: 207 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.833452:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:3.0:1789431568.833454:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431568.833457:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7ba00, rc 0)
00000100:00100000:3.0:1789431568.833928:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14617:x1876351933596928:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1056us (2107us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431568.833937:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296294
00000100:00100000:0.0:1789431568.834173:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.835700:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933597056
00000100:00100000:2.0:1789431568.835824:0:14505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933597056
00000100:00100000:2.0:1789431568.835887:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8411
00000100:00100000:2.0:1789431568.835898:0:14505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2348:x1876351933597056:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:2.0:1789431568.837742:0:14505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x51a:0x0] updating lvb size from disk: 85026 -> 85026
00002000:00010000:2.0:1789431568.837749:0:14505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x51a:0x0] updating lvb mtime from disk: 1789431556 -> 1789431556
00002000:00010000:2.0:1789431568.837752:0:14505:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x51a:0x0] updating lvb atime from disk: 1789431557 -> 1789431547
00002000:00010000:2.0:1789431568.837754:0:14505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x51a:0x0] updating lvb ctime from disk: 1789431568 -> 1789431568
00002000:00010000:2.0:1789431568.837756:0:14505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x51a:0x0] updating lvb blocks from disk: 259 -> 259
00000100:00100000:2.0:1789431568.837835:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2348:x1876351933597056:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 1935us (3659us total) trans 4294970072 rc 0/0
00000100:00100000:2.0:1789431568.837846:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8411
00000100:00100000:3.0:1789431568.839181:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.839273:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933597184
00000100:00100000:0.0:1789431568.839293:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933597184
00000100:00100000:0.0:1789431568.839358:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14378
00000100:00100000:0.0:1789431568.839369:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:2350:x1876351933597184:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431568.839383:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431568.839406:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527c31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9330 expref: 207 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.839424:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:0.0:1789431568.839429:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431568.839467:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2350:x1876351933597184:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 101us (292us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431568.839473:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14378
00000100:00100000:3.0:1789431568.844922:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.845095:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933597440
00000100:00100000:2.0:1789431568.845107:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933597440
00000100:00100000:2.0:1789431568.845164:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12545
00000100:00100000:2.0:1789431568.845174:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14616:x1876351933597440:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431568.845418:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14616:x1876351933597440:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 245us (517us total) trans 4295121145 rc 0/0
00000100:00100000:2.0:1789431568.845425:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12545
00000100:00100000:1.0:1789431568.849952:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.850100:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933597696
00000100:00100000:0.0:1789431568.850113:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933597696
00000100:00100000:0.0:1789431568.850173:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296295
00000100:00100000:0.0:1789431568.850183:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14617:x1876351933597696:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431568.850205:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431568.850238:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527c38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9337 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.850349:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c3f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.850364:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca000/0xd8e438fb635123e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2a22 expref: 208 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.850374:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c3f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.850406:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca000/0xd8e438fb635123e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2a22 expref: 208 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.850419:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca000/0xd8e438fb635123e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2a22 expref: 208 pid: 12181 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431568.850431:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e90380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894254080:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431568.850524:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba39600 going to sleep for 11 seconds
00000100:00100000:3.0:1789431568.856420:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.856605:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933597824
00000100:00100000:2.0:1789431568.856615:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933597824
00000100:00100000:2.0:1789431568.856676:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296296
00000100:00100000:2.0:1789431568.856686:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:14616:x1876351933597824:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431568.856729:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431568.856752:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527c46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c933e expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.856826:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527c4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.856844:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527c4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.856855:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527c4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.856870:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527c54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.856876:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.856881:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857164:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527c5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857174:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857185:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431568.857490:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab1:0x0]: returning size 85026
00000004:00200000:2.0:1789431568.857496:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431568.857518:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857530:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857538:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527c4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857544:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527c4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857552:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527c4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857558:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431568.857562:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527c4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857570:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527c4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857581:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431568.857584:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431568.857590:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527c4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857600:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527c4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857612:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857618:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527c54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857624:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527c54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857629:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431568.857632:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527c54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857638:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527c54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857644:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xa36e7a4 (ffff90cf13195b00)
00010000:00010000:2.0:1789431568.857647:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431568.857650:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527c54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857655:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527c54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.857684:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527c46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c933e expref: 211 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431568.857849:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e90380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894254080:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431568.857871:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c3f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.858033:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c933e expref: 210 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.858041:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:2.0:1789431568.858044:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431568.858046:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523c00, rc 0)
00000100:00100000:0.0:1789431568.859188:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:14616:x1876351933597824:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2498us (2771us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431568.859198:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296296
00000100:00100000:1.0:1789431568.864934:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.864981:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.865674:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933597952
00000100:00100000:3.0:1789431568.865685:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933597952
00010000:00010000:3.0:1789431568.865745:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca000/0xd8e438fb635123e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2a22 expref: 210 pid: 12181 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431568.865791:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16694
00000100:00100000:3.0:1789431568.865801:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3c157100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:2348:x1876351933597952:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431568.865818:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431568.865825:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca000/0xd8e438fb635123e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2a22 expref: 210 pid: 12181 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.865839:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca000/0xd8e438fb635123e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2a22 expref: 210 pid: 12181 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.865860:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce035ca000/0xd8e438fb635123e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2a22 expref: 210 pid: 12181 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.865876:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:3.0:1789431568.865881:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c3f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.865889:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.865896:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c3f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.865930:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431568.865982:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c157100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:2348:x1876351933597952:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 183us (1058us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431568.865990:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16694
00000100:00100000:0.0:1789431568.867395:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933598208
00000100:00100000:0.0:1789431568.867408:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933598208
00000100:00100000:0.0:1789431568.867489:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296297
00000100:00100000:0.0:1789431568.867499:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:14616:x1876351933598208:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431568.867520:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431568.867539:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527c62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9345 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.867640:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527c69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.867655:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527c5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c933e expref: 210 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.867664:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527c69 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.867712:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c933e expref: 210 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.867733:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527c5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c933e expref: 210 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431568.867746:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e90380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894254208:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431568.867828:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba39600 going to sleep for 11 seconds
00010000:00010000:0.0:1789431568.867846:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.867853:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431568.867868:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10094:0x0]: returning size 260096
00010000:00010000:0.0:1789431568.868093:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527c38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9337 expref: 212 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.868110:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9337 expref: 211 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.868118:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:0.0:1789431568.868120:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431568.868124:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3c00, rc 0)
00000100:00100000:0.0:1789431568.868154:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3c157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:14617:x1876351933597696:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 17972us (18213us total) trans 4295121146 rc 0/0
00000100:00100000:0.0:1789431568.868161:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296295
00000100:00100000:2.0:1789431568.871744:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e90380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894254208:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431568.871775:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527c69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431568.874663:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.874904:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933598336
00000100:00100000:0.0:1789431568.874922:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933598336
00010000:00010000:0.0:1789431568.874964:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527c5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c933e expref: 211 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431568.875008:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16695
00000100:00100000:0.0:1789431568.875018:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:2347:x1876351933598336:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431568.875033:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431568.875040:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527c5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c933e expref: 211 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.875075:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c933e expref: 211 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.875097:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527c5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c933e expref: 211 pid: 6797 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.875114:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:0.0:1789431568.875119:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527c69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.875127:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527c69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.875134:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527c69 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.875165:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431568.875212:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:2347:x1876351933598336:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 195us (558us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431568.875231:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16695
00010000:00010000:3.0:1789431568.875731:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527c69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.875741:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527c69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431568.875762:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab1:0x0]: returning size 85026
00010000:00010000:3.0:1789431568.876001:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527c62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9345 expref: 211 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.876023:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527c69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9345 expref: 210 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.876032:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:3.0:1789431568.876035:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431568.876037:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3200, rc 0)
00000100:00100000:3.0:1789431568.876098:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:14616:x1876351933598208:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8601us (11116us total) trans 4295121147 rc 0/0
00000100:00100000:3.0:1789431568.876104:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296297
00000100:00100000:3.0:1789431568.878610:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.879020:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933598464
00000100:00100000:1.0:1789431568.879030:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933598464
00000100:00100000:1.0:1789431568.879117:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296298
00000100:00100000:1.0:1789431568.879128:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:14617:x1876351933598464:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431568.879151:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431568.879172:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527c7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c934c expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.879803:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527c85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.879821:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c3f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9337 expref: 211 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.879830:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527c85 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.879867:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9337 expref: 211 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.879883:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c3f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9337 expref: 211 pid: 5848 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.879897:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894254336:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431568.880320:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3900 going to sleep for 11 seconds
00000100:00100000:1.0:1789431568.885045:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.885179:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894254336:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431568.885209:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527c85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.885450:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.885550:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933598720
00000100:00100000:0.0:1789431568.885558:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933598720
00000100:00100000:0.0:1789431568.885614:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296299
00000100:00100000:0.0:1789431568.885623:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14616:x1876351933598720:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431568.885645:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431568.885664:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527c8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9353 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.885760:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527c93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.885774:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527c69 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9345 expref: 213 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.885783:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527c93 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.885814:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527c69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9345 expref: 213 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.885826:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527c69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9345 expref: 213 pid: 5847 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431568.885838:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e93100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894254464:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431568.885925:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba39d80 going to sleep for 11 seconds
00000100:00100000:3.0:1789431568.892479:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933598592
00000100:00100000:3.0:1789431568.892494:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933598592
00000100:00100000:0.0:1789431568.896127:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e93100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894254464:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431568.896158:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527c93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.896566:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c3f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9337 expref: 214 pid: 5848 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.896614:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16696
00000100:00100000:1.0:1789431568.896624:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb04450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:2348:x1876351933598592:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431568.896639:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431568.896646:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c3f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9337 expref: 214 pid: 5848 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.896658:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9337 expref: 214 pid: 5848 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.896681:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527c3f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9337 expref: 214 pid: 5848 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.896823:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:1.0:1789431568.896830:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527c85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.896841:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.896850:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527c85 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.896880:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431568.897010:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb04450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:2348:x1876351933598592:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 387us (11974us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431568.897018:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16696
00010000:00010000:2.0:1789431568.897187:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.897196:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431568.897250:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10094:0x0]: returning size 260096
00000004:00200000:2.0:1789431568.897255:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431568.897274:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.897314:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527c7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c934c expref: 213 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.897333:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527c85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c934c expref: 212 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.897340:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:2.0:1789431568.897343:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431568.897345:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309200, rc 0)
00000100:00100000:2.0:1789431568.897381:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14617:x1876351933598464:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 18255us (18781us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.897390:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296298
00000100:00100000:2.0:1789431568.902977:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.903340:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933599104
00000100:00100000:0.0:1789431568.903350:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933599104
00000100:00100000:2.0:1789431568.903947:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.904240:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933598848
00000100:00100000:3.0:1789431568.904247:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933598848
00010000:00010000:3.0:1789431568.904283:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527c69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9345 expref: 213 pid: 5847 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431568.904584:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12546
00000100:00100000:0.0:1789431568.904597:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14617:x1876351933599104:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431568.904803:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16697
00000100:00100000:3.0:1789431568.904812:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:2347:x1876351933598848:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431568.904828:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431568.904837:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527c69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9345 expref: 213 pid: 5847 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.904851:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527c69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9345 expref: 213 pid: 5847 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.904872:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63527c69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab1:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9345 expref: 213 pid: 5847 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.904889:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:3.0:1789431568.904895:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527c93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.904904:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.904979:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527c93 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.905065:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431568.905116:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:2347:x1876351933598848:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 305us (1174us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431568.905124:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16697
00010000:00010000:2.0:1789431568.905206:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.905214:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431568.905255:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab1:0x0]: returning size 85026
00000004:00200000:2.0:1789431568.905260:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431568.905277:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.905305:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527c8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9353 expref: 213 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.905319:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2800/0xd8e438fb63527c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9353 expref: 212 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.905331:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab1:0x0].0x0 (ffff90ce07190a00)
00010000:00010000:2.0:1789431568.905334:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431568.905336:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2800, rc 0)
00000100:00100000:2.0:1789431568.905363:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14616:x1876351933598720:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 19742us (19913us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.905370:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296299
00000100:00100000:0.0:1789431568.906885:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:14617:x1876351933599104:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 2284us (3910us total) trans 4295121148 rc 0/0
00000100:00100000:0.0:1789431568.906897:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12546
00000100:00100000:2.0:1789431568.914376:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.914452:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933599232
00000100:00100000:0.0:1789431568.914461:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933599232
00000100:00100000:0.0:1789431568.914520:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296300
00000100:00100000:0.0:1789431568.914529:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:14617:x1876351933599232:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431568.914553:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431568.914572:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527c9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c935a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.914635:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527ca1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.914651:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.914663:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.914678:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527ca8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.914703:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.914711:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.914821:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527caf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.914830:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527caf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.914837:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527caf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431568.914870:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10094:0x0]: returning size 260096
00000004:00200000:0.0:1789431568.914874:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431568.914891:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527caf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.914901:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527caf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.914921:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.914928:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527ca1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.914935:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.914945:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431568.914949:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.914957:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527ca1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.914967:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431568.914970:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431568.914975:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527ca1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.914981:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63527ca1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.914993:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.915000:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527ca8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.915005:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.915010:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431568.915012:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.915018:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.915029:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x469e1765 (ffff90ce07190f00)
00010000:00010000:0.0:1789431568.915032:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431568.915035:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527ca8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.915041:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527ca8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.915278:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527c9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c935a expref: 213 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.915293:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527caf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c935a expref: 212 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.915301:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:0.0:1789431568.915304:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431568.915307:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2e00, rc 0)
00000100:00100000:0.0:1789431568.915372:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14617:x1876351933599232:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 844us (1006us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431568.915380:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296300
00000100:00100000:3.0:1789431568.916500:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.916642:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933599360
00000100:00100000:0.0:1789431568.916650:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933599360
00000100:00100000:0.0:1789431568.916865:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296301
00000100:00100000:0.0:1789431568.916875:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14616:x1876351933599360:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431568.916893:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431568.916922:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527cb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9361 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.916984:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527cbd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.916998:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527cbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917009:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527cbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917024:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527cc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917031:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917038:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917330:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527ccb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917340:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917348:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431568.917378:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:0.0:1789431568.917382:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431568.917399:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917416:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917424:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527cbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917430:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527cbd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917437:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527cbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917443:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431568.917447:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527cbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917454:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527cbd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917465:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431568.917468:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431568.917472:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527cbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917478:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527cbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917490:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917496:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527cc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917502:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917507:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431568.917510:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917516:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527cc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917524:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xbb97fc59 (ffff90ce07190e00)
00010000:00010000:0.0:1789431568.917527:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431568.917529:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527cc4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917536:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527cc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917566:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527cb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9361 expref: 214 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917577:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527ccb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9361 expref: 213 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.917584:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:0.0:1789431568.917586:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431568.917589:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2600, rc 0)
00000100:00100000:0.0:1789431568.917636:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14616:x1876351933599360:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 763us (1141us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431568.917643:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296301
00000100:00100000:3.0:1789431568.928525:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.928638:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933599488
00000100:00100000:1.0:1789431568.928648:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933599488
00000100:00100000:1.0:1789431568.928723:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14379
00000100:00100000:1.0:1789431568.928733:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:2350:x1876351933599488:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431568.928748:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431568.928772:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527caf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c935a expref: 213 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.928790:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:1.0:1789431568.928795:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431568.928853:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:2350:x1876351933599488:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 121us (337us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431568.928861:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14379
00000100:00100000:2.0:1789431568.938327:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.938413:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933599872
00000100:00100000:1.0:1789431568.938423:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933599872
00000100:00100000:1.0:1789431568.938479:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296302
00000100:00100000:1.0:1789431568.938489:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14616:x1876351933599872:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431568.938510:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431568.938530:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527cd2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c936f expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.938635:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527cd9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.938654:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527ccb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9361 expref: 213 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.938664:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527cd9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.938712:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527ccb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9361 expref: 213 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.938725:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527ccb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9361 expref: 213 pid: 12181 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.938738:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894254592:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431568.938817:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3540 going to sleep for 11 seconds
00000100:00100000:2.0:1789431568.942275:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.942626:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933600000
00000100:00100000:3.0:1789431568.942636:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933600000
00000100:00100000:3.0:1789431568.942744:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296303
00000100:00100000:3.0:1789431568.942756:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:14617:x1876351933600000:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431568.942779:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431568.942800:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527ce0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9368 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.942904:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ce7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.942919:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527c85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c934c expref: 215 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.942927:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ce7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.942962:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527c85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c934c expref: 215 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.942974:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527c85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c934c expref: 215 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431568.942986:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba19500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894254720:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431568.943087:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf055966c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431568.946546:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.946631:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933600128
00000100:00100000:2.0:1789431568.946643:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933600128
00010000:00010000:2.0:1789431568.946679:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527ccb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9361 expref: 216 pid: 12181 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.946730:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16698
00000100:00100000:2.0:1789431568.946739:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:2349:x1876351933600128:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431568.946753:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431568.946760:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527ccb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9361 expref: 216 pid: 12181 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.946773:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527ccb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9361 expref: 216 pid: 12181 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.946795:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431568.946800:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527cd9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.946811:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527cd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.946819:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527cd9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.946836:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431568.946880:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:2349:x1876351933600128:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 141us (345us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431568.946887:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16698
00010000:00010000:1.0:1789431568.949822:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527ccb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9361 expref: 215 pid: 12181 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.949847:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894254592:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431568.949872:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527cd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.949886:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527cd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.949893:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527cd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431568.949913:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00010000:00010000:1.0:1789431568.950108:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527cd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c936f expref: 216 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.950125:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527cd9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c936f expref: 215 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.950134:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:1.0:1789431568.950137:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431568.950141:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308200, rc 0)
00000100:00100000:1.0:1789431568.950211:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14616:x1876351933599872:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11723us (11893us total) trans 4295121149 rc 0/0
00000100:00100000:1.0:1789431568.950220:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296302
00000100:00100000:0.0:1789431568.951379:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba19500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894254720:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431568.951403:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ce7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431568.951699:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.951770:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933600256
00000100:00100000:3.0:1789431568.951778:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933600256
00010000:00010000:3.0:1789431568.951809:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527c85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c934c expref: 215 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431568.951851:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16699
00000100:00100000:3.0:1789431568.951860:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:2348:x1876351933600256:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431568.951874:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431568.951880:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527c85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c934c expref: 215 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.951892:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527c85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c934c expref: 215 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.951912:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527c85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c934c expref: 215 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.951925:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:3.0:1789431568.951930:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ce7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.951940:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ce7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.951948:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ce7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.951976:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431568.952020:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:2348:x1876351933600256:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 162us (334us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431568.952027:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16699
00010000:00010000:2.0:1789431568.952401:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ce7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.952409:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ce7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431568.952427:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10094:0x0]: returning size 260096
00010000:00010000:2.0:1789431568.952559:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527ce0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9368 expref: 215 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.952575:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ce7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9368 expref: 214 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431568.952584:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:2.0:1789431568.952587:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431568.952589:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7bc00, rc 0)
00000100:00100000:2.0:1789431568.952624:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:14617:x1876351933600000:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9871us (10360us total) trans 4295121150 rc 0/0
00000100:00100000:2.0:1789431568.952631:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296303
00000100:00100000:2.0:1789431568.959871:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431568.959904:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.959978:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933600384
00000100:00100000:1.0:1789431568.959989:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933600384
00000100:00100000:1.0:1789431568.960035:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933600512
00000100:00100000:1.0:1789431568.960037:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933600512
00000100:00100000:1.0:1789431568.960083:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296304
00000100:00100000:1.0:1789431568.960092:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14616:x1876351933600384:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431568.960114:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431568.960133:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527cfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9376 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.960211:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.960236:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527cd9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c936f expref: 216 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.960245:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d03 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.960278:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527cd9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c936f expref: 216 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431568.960290:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527cd9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c936f expref: 216 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.960305:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894254848:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431568.960379:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3c00 going to sleep for 11 seconds
00000100:00100000:3.0:1789431568.960748:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296305
00000100:00100000:3.0:1789431568.960759:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14617:x1876351933600512:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431568.960769:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431568.960780:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527d0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c937d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.960827:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527d11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.960839:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ce7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9368 expref: 217 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.960846:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527d11 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.960866:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ce7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9368 expref: 217 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.960876:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ce7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9368 expref: 217 pid: 5847 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431568.960886:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ba1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894254976:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431568.960933:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf055960c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431568.963637:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3ba1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894254976:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431568.963668:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527d11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.963757:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894254848:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431568.963773:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431568.965184:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.965226:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.965299:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933600640
00000100:00100000:3.0:1789431568.965309:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933600640
00010000:00010000:3.0:1789431568.965349:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527cd9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c936f expref: 218 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431568.965388:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933600768
00000100:00100000:3.0:1789431568.965391:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933600768
00010000:00010000:3.0:1789431568.965404:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ce7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9368 expref: 219 pid: 5847 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431568.965431:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16700
00000100:00100000:3.0:1789431568.965440:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:2347:x1876351933600640:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431568.965454:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431568.965463:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527cd9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c936f expref: 219 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.965475:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527cd9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c936f expref: 219 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.965497:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527cd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10aad:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c936f expref: 219 pid: 12775 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.965512:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:3.0:1789431568.965517:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.965525:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.965533:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d03 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.965561:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431568.965607:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:2347:x1876351933600640:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 168us (429us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431568.965614:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16700
00000100:00100000:3.0:1789431568.965632:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16701
00000100:00100000:3.0:1789431568.965638:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:2347:x1876351933600768:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431568.965645:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431568.965650:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ce7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9368 expref: 217 pid: 5847 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.965659:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ce7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9368 expref: 217 pid: 5847 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.965673:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ce7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9368 expref: 217 pid: 5847 timeout: 3126 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.965684:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:3.0:1789431568.965699:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527d11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.965713:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.965719:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527d11 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.965737:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431568.965756:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:2347:x1876351933600768:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 118us (535us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431568.965762:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16701
00010000:00010000:3.0:1789431568.965784:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.965792:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431568.965836:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:3.0:1789431568.965840:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431568.965862:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.965892:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527cfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9376 expref: 216 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.965905:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9376 expref: 215 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.965913:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:3.0:1789431568.965916:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431568.965919:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:3.0:1789431568.965945:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14616:x1876351933600384:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 5854us (6083us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431568.965952:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296304
00010000:00010000:3.0:1789431568.965974:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.965980:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431568.966001:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10094:0x0]: returning size 260096
00000004:00200000:3.0:1789431568.966005:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431568.966013:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.966029:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527d0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c937d expref: 215 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.966039:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527d11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c937d expref: 214 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431568.966045:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:3.0:1789431568.966088:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431568.966090:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a000, rc 0)
00000100:00100000:3.0:1789431568.966111:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:14617:x1876351933600512:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 5355us (6205us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431568.966117:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296305
00000100:00100000:2.0:1789431568.978601:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.978837:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933601024
00000100:00100000:1.0:1789431568.978848:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933601024
00000100:00100000:1.0:1789431568.978904:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12547
00000100:00100000:1.0:1789431568.978913:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:14616:x1876351933601024:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431568.979190:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14616:x1876351933601024:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 277us (598us total) trans 4295121151 rc 0/0
00000100:00100000:1.0:1789431568.979197:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12547
00000100:00100000:1.0:1789431568.986458:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431568.986561:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933601152
00000100:00100000:0.0:1789431568.986572:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933601152
00000100:00100000:0.0:1789431568.986633:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296306
00000100:00100000:0.0:1789431568.986643:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14616:x1876351933601152:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431568.986668:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431568.986699:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9384 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.986764:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527d1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.986779:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527d1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.986792:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527d1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.986808:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527d26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.986815:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.986822:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987095:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527d2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987104:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987111:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431568.987147:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10aad:0x0]: returning size 83190
00000004:00200000:0.0:1789431568.987151:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431568.987170:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987181:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987190:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527d1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987196:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527d1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987203:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527d1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987209:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431568.987213:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527d1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987232:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527d1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987243:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431568.987246:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431568.987251:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527d1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987257:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527d1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987269:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987275:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527d26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987280:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987285:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431568.987288:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987294:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527d26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987301:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xbb97fc59 (ffff90ce07190e00)
00010000:00010000:0.0:1789431568.987303:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431568.987306:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527d26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987312:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527d26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987341:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9384 expref: 217 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987354:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527d2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9384 expref: 216 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.987361:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:0.0:1789431568.987364:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431568.987366:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3e00, rc 0)
00000100:00100000:0.0:1789431568.987440:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14616:x1876351933601152:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 798us (991us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431568.987448:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296306
00000100:00100000:3.0:1789431568.997418:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431568.997463:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431568.997522:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933601536
00000100:00100000:1.0:1789431568.997534:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933601536
00000100:00100000:0.0:1789431568.997565:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933601280
00000100:00100000:0.0:1789431568.997571:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933601280
00000100:00100000:1.0:1789431568.997596:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12548
00000100:00100000:1.0:1789431568.997607:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14617:x1876351933601536:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431568.997617:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14380
00000100:00100000:0.0:1789431568.997627:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e8a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:2348:x1876351933601280:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431568.997641:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431568.997666:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527d2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9384 expref: 217 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431568.997694:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:0.0:1789431568.997699:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431568.997755:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e8a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:2348:x1876351933601280:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 128us (346us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431568.997763:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14380
00000100:00100000:1.0:1789431568.997842:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14617:x1876351933601536:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 236us (376us total) trans 4295121152 rc 0/0
00000100:00100000:1.0:1789431568.997850:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12548
00000100:00100000:3.0:1789431569.006418:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.009327:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933601792
00000100:00100000:2.0:1789431569.009345:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933601792
00000100:00100000:2.0:1789431569.009407:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296307
00000100:00100000:2.0:1789431569.009419:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14616:x1876351933601792:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431569.009472:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431569.009501:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9376 expref: 216 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.009527:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce387a4a00/0xd8e438fb6352730f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10aad:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c907b expref: 215 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.009538:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195a00)
00010000:00010000:2.0:1789431569.009549:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431569.009572:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527d34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.009586:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527d34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.009595:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527d34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.009610:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527d3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.009619:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.009625:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.009911:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527d42 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.009921:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527d42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.009929:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527d42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431569.010544:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1249, 64 off88192
00000004:00080000:2.0:1789431569.010554:0:6797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3027041504220ns, next at 3028041502123ns, rc = 0
00010000:00010000:2.0:1789431569.010610:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63527d49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.010620:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63527d49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.010627:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63527d49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.010634:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63527d49 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.010640:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63527d49 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.010651:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63527d49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.010674:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431569.010704:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527d42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.010711:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527d42 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.010715:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431569.010718:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527d42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.010722:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63527d49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.010724:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.010728:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431569.010728:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527d42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.010731:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63527d49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.010736:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527d42 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.010746:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195d00)
00010000:00010000:2.0:1789431569.010748:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431569.012662:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527d42 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.012702:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527d42 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aad:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.012739:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527d34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.012751:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527d34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.012758:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527d34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.012763:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431569.012767:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527d34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.012775:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527d34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.012790:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431569.012793:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431569.012797:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527d34 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.012803:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527d34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431569.012812:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003a22f432 reply state 00000000431ba3b8 transno 4295121153 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.012822:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431569.012970:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63527d49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.012983:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aad:0x0].0x0 (ffff90cf13195d00)
00010000:00010000:1.0:1789431569.012986:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431569.012990:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63527d49 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.012996:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63527d49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aad:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.013017:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431569.013020:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431569.013022:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431569.013158:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14616:x1876351933601792:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3736us (6743us total) trans 4295121153 rc 0/0
00000100:00100000:3.0:1789431569.013173:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296307
00000100:00100000:0.0:1789431569.014355:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.024216:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933601920
00000100:00100000:3.0:1789431569.024235:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933601920
00000100:00100000:3.0:1789431569.024290:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296308
00000100:00100000:3.0:1789431569.024300:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14617:x1876351933601920:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431569.024323:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431569.024345:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527d50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c938b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024407:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527d57 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024422:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527d57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024434:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527d57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024449:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527d5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024455:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527d5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024461:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527d5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024563:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527d65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024573:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527d65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024580:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527d65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431569.024612:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10094:0x0]: returning size 260096
00000004:00200000:3.0:1789431569.024617:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431569.024635:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527d65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024647:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527d65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024654:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527d57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024661:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527d57 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024667:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527d57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024673:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431569.024677:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527d57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024685:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527d57 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024707:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431569.024711:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431569.024715:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527d57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024721:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527d57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024734:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527d5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024745:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527d5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024751:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527d5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024756:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431569.024759:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527d5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024765:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527d5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024772:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x469e1765 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431569.024775:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431569.024778:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527d5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024783:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527d5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024813:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527d50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c938b expref: 218 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024827:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527d65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c938b expref: 217 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.024835:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:3.0:1789431569.024838:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431569.024841:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b600, rc 0)
00000100:00100000:3.0:1789431569.025193:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14617:x1876351933601920:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 892us (10973us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431569.025201:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296308
00010000:00010000:0.0:1789431569.025650:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.025659:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527d3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.025666:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527d3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.025671:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431569.025674:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527d3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.025680:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527d3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.025701:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xbb97fc59 (ffff90cf13195b00)
00010000:00010000:0.0:1789431569.025703:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431569.025707:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527d3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.025712:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527d3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xbb97fc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.032205:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.032268:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933602176
00000100:00100000:0.0:1789431569.032279:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933602176
00000100:00100000:0.0:1789431569.032340:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296309
00000100:00100000:0.0:1789431569.032350:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14617:x1876351933602176:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431569.032373:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431569.032392:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527d6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9392 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.032491:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.032506:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527d11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c937d expref: 217 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.032514:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527d65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c938b expref: 217 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.032522:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.032554:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527d65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c938b expref: 217 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.032568:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527d65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c938b expref: 217 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.032582:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e90380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894255104:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431569.032710:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527d11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c937d expref: 217 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.032722:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527d11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c937d expref: 217 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.032732:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e96680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894255232:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431569.032759:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba393c0 going to sleep for 11 seconds
00000100:00100000:1.0:1789431569.036715:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.036833:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933602304
00000100:00100000:0.0:1789431569.036844:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933602304
00010000:00010000:0.0:1789431569.036886:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527d65 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c938b expref: 218 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.036930:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16702
00000100:00100000:0.0:1789431569.036939:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:2350:x1876351933602304:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431569.036953:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431569.036960:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527d65 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c938b expref: 218 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.036974:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527d65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c938b expref: 218 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.036995:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:0.0:1789431569.037001:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.037010:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.037016:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431569.037096:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:2350:x1876351933602304:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 158us (391us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431569.037105:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16702
00000100:00100000:0.0:1789431569.037311:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e96680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894255232:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431569.037326:0:5847:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@000000001db0536c x1876351894255104) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527d65 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c938b expref: 217 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.037342:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527d65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c938b expref: 217 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.037359:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e90380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894255104:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431569.037379:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:0.0:1789431569.037383:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.037390:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.037398:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.048857:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.048909:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.048974:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933602560
00000100:00100000:1.0:1789431569.048984:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933602560
00000100:00100000:1.0:1789431569.049038:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296310
00000100:00100000:1.0:1789431569.049086:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14616:x1876351933602560:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.049108:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.049138:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527d7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9399 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049208:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d81 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049223:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049234:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049248:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527d88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x16ffa7f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049255:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527d88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x16ffa7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049262:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527d88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x16ffa7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049313:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049321:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049328:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049334:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.049338:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049346:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049357:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431569.049360:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.049364:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049371:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527d81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049383:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527d88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x16ffa7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049389:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527d88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x16ffa7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049395:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527d88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x16ffa7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049401:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.049404:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527d88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x16ffa7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049410:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527d88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x16ffa7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049416:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x16ffa7f1 (ffff90ce03149d00)
00010000:00010000:1.0:1789431569.049418:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.049420:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527d88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x16ffa7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049426:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527d88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x16ffa7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049452:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527d7a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9399 expref: 218 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049461:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431569.049463:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.049467:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527d7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9399 expref: 218 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.049475:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308c00, rc 0)
00000100:00100000:1.0:1789431569.049532:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14616:x1876351933602560:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 485us (621us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431569.049539:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296310
00000100:00100000:0.0:1789431569.049927:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933602432
00000100:00100000:0.0:1789431569.049943:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933602432
00010000:00010000:0.0:1789431569.049969:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527d11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c937d expref: 217 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.050000:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16703
00000100:00100000:0.0:1789431569.050009:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:2348:x1876351933602432:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431569.050019:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431569.050024:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527d11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c937d expref: 217 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.050035:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527d11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c937d expref: 217 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.050075:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63527d11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c937d expref: 217 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.050087:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:0.0:1789431569.050091:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.050099:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.050105:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.050375:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431569.050400:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.050409:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431569.050427:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10094:0x0]: returning size 260096
00000100:00100000:0.0:1789431569.050455:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:2348:x1876351933602432:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 448us (1608us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431569.050463:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16703
00010000:00010000:2.0:1789431569.050576:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527d6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9392 expref: 217 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.050592:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9392 expref: 216 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.050598:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:2.0:1789431569.050600:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431569.050602:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3c00, rc 0)
00000100:00100000:2.0:1789431569.050626:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14617:x1876351933602176:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 18279us (18433us total) trans 4295121154 rc 0/0
00000100:00100000:2.0:1789431569.050633:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296309
00000100:00100000:2.0:1789431569.055717:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.055832:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933602688
00000100:00100000:3.0:1789431569.055843:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933602688
00000100:00100000:3.0:1789431569.055907:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296311
00000100:00100000:3.0:1789431569.055918:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14616:x1876351933602688:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431569.055940:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431569.055962:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527d96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c93a0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.056044:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527d9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.056099:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.056112:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431569.056148:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008d:0x0]: returning size 16384
00000004:00200000:3.0:1789431569.056152:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431569.056170:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.056195:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527d96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93a0 expref: 218 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.056213:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527d9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93a0 expref: 217 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.056294:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431569.056298:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431569.056302:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7aa00, rc 0)
00000100:00100000:3.0:1789431569.056353:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14616:x1876351933602688:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 437us (663us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431569.056361:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296311
00000100:00100000:3.0:1789431569.064296:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.064345:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.064407:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933602944
00000100:00100000:2.0:1789431569.064418:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933602944
00000100:00100000:2.0:1789431569.064482:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12549
00000100:00100000:2.0:1789431569.064493:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14616:x1876351933602944:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431569.064931:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933602816
00000100:00100000:1.0:1789431569.064937:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933602816
00000100:00100000:1.0:1789431569.064987:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296312
00000100:00100000:1.0:1789431569.064996:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14617:x1876351933602816:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.065008:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.065028:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527da4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c93a7 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.065143:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527dab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.065159:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9392 expref: 219 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.065167:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527dab lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.065204:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9392 expref: 219 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.065219:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9392 expref: 219 pid: 5847 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.065233:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894255360:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431569.065312:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3c00 going to sleep for 11 seconds
00000100:00100000:1.0:1789431569.069282:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894255360:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431569.069315:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527dab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.073606:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14616:x1876351933602944:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 9106us (9251us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431569.073618:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12549
00000100:00100000:1.0:1789431569.073789:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.073893:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933603072
00000100:00100000:2.0:1789431569.073901:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933603072
00010000:00010000:2.0:1789431569.073935:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9392 expref: 219 pid: 5847 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.073974:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16704
00000100:00100000:2.0:1789431569.073983:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:2347:x1876351933603072:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431569.073996:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431569.074002:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9392 expref: 219 pid: 5847 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.074014:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9392 expref: 219 pid: 5847 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.074070:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527d73 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9392 expref: 219 pid: 5847 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.074087:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:2.0:1789431569.074091:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527dab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.074102:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.074110:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527dab lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.074142:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431569.074166:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:2347:x1876351933603072:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 184us (379us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431569.074173:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16704
00010000:00010000:2.0:1789431569.075173:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.075185:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431569.075232:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10094:0x0]: returning size 260096
00000004:00200000:2.0:1789431569.075237:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431569.075256:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.075305:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527da4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93a7 expref: 218 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.075323:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527dab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93a7 expref: 217 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.075331:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:2.0:1789431569.075334:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431569.075337:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:2.0:1789431569.075377:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14617:x1876351933602816:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10382us (11091us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431569.075384:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296312
00000100:00100000:3.0:1789431569.092121:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.092265:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933603200
00000100:00100000:1.0:1789431569.092274:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933603200
00000100:00100000:1.0:1789431569.092322:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296313
00000100:00100000:1.0:1789431569.092330:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14616:x1876351933603200:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.092350:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.092369:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527db2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c93ae expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092428:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527db9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092443:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527db9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092454:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527db9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092467:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527dc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092474:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092481:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092572:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527dc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092584:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092591:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431569.092622:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10095:0x0]: returning size 260096
00000004:00200000:1.0:1789431569.092626:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431569.092645:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092657:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092663:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527db9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092669:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527db9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092675:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527db9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092680:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.092684:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527db9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092711:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527db9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092724:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431569.092727:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.092733:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527db9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092738:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527db9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092751:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092757:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527dc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092763:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092769:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.092772:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092778:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527dc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092785:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x469e1765 (ffff90ce03149d00)
00010000:00010000:1.0:1789431569.092787:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.092789:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527dc0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092794:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527dc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092822:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527db2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93ae expref: 219 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092836:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93ae expref: 218 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.092843:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:1.0:1789431569.092845:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431569.092847:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309200, rc 0)
00000100:00100000:1.0:1789431569.092914:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14616:x1876351933603200:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 585us (802us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.092921:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296313
00000100:00100000:0.0:1789431569.098536:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.098609:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933603328
00000100:00100000:1.0:1789431569.098619:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933603328
00000100:00100000:1.0:1789431569.098683:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296314
00000100:00100000:1.0:1789431569.098704:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14617:x1876351933603328:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.098725:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.098751:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527dce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c93b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.098820:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527dd5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.098836:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527dd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.098849:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527dd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.098863:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527ddc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.098870:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.098876:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.098973:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527de3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.098982:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.098989:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431569.099021:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10094:0x0]: returning size 260096
00000004:00200000:1.0:1789431569.099025:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431569.099044:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.099366:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.099375:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527dd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.099382:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527dd5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.099390:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527dd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.099401:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.099405:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527dd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.099413:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527dd5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.099425:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431569.099428:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.099433:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527dd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.099440:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527dd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.099454:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.099461:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527ddc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.099466:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527ddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.099472:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.099475:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527ddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.099482:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527ddc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.099494:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x469e1765 (ffff90ce03149900)
00010000:00010000:1.0:1789431569.099497:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.099500:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527ddc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.099506:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527ddc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.099541:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527dce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93b5 expref: 220 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.099626:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527de3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93b5 expref: 219 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.099635:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:1.0:1789431569.099637:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431569.099639:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:1.0:1789431569.099750:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14617:x1876351933603328:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1047us (1223us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.099758:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296314
00000100:00100000:3.0:1789431569.116002:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.116082:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933603456
00000100:00100000:3.0:1789431569.116091:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.116093:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933603456
00000100:00100000:1.0:1789431569.116146:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933603712
00000100:00100000:1.0:1789431569.116149:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933603712
00000100:00100000:1.0:1789431569.116185:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14381
00000100:00100000:1.0:1789431569.116196:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce36219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:2348:x1876351933603456:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431569.116212:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431569.116240:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527de3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93b5 expref: 220 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.116242:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14382
00000100:00100000:2.0:1789431569.116251:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d986a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:2347:x1876351933603712:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431569.116260:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:2.0:1789431569.116260:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431569.116265:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431569.116270:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527dc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93ae expref: 219 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.116284:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:2.0:1789431569.116287:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431569.116314:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce36219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:2348:x1876351933603456:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 121us (322us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431569.116314:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d986a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:2347:x1876351933603712:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 64us (265us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.116322:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14381
00000100:00100000:3.0:1789431569.119259:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.119408:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933603840
00000100:00100000:0.0:1789431569.119418:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933603840
00000100:00100000:0.0:1789431569.119468:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296315
00000100:00100000:0.0:1789431569.119477:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14617:x1876351933603840:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431569.119530:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431569.119556:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527dab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93a7 expref: 218 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.119596:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:0.0:1789431569.119602:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431569.119650:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527dea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.119725:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527dea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.119737:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527dea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431569.119872:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000adf9e1fa reply state 000000000a07ffbd transno 4295121155 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527dea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.119882:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431569.119982:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14617:x1876351933603840:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 497us (723us total) trans 4295121155 rc 0/0
00000100:00100000:0.0:1789431569.119989:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296315
00010000:00010000:1.0:1789431569.122731:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527dea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.122749:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527dea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.122757:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527dea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.122764:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.122769:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527dea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.122777:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527dea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.122794:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:1.0:1789431569.122798:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.122803:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527dea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.122809:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527dea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.124037:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14382
00000100:00100000:3.0:1789431569.124891:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.124934:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.125200:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933604096
00000100:00100000:1.0:1789431569.125210:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933604096
00000100:00100000:1.0:1789431569.125271:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296316
00000100:00100000:1.0:1789431569.125281:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14616:x1876351933604096:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.125302:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.125321:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527df1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c93bc expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.125424:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527df8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.125439:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635129f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2bfe expref: 218 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.125448:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527df8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.125482:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635129f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2bfe expref: 218 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.125497:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635129f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2bfe expref: 218 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.125510:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894255488:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431569.125607:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3c00 going to sleep for 11 seconds
00000100:00100000:2.0:1789431569.125953:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933604224
00000100:00100000:2.0:1789431569.125959:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933604224
00000100:00100000:2.0:1789431569.126016:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8412
00000100:00100000:2.0:1789431569.126026:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+66:2349:x1876351933604224:12345-192.168.203.4@tcp:2:dbench.0
00000100:00080000:0.0:1789431569.126043:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00010000:2.0:1789431569.126302:0:14486:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb size from disk: 260096 -> 260096
00002000:00010000:2.0:1789431569.126306:0:14486:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb mtime from disk: 1789431500 -> 1789431488
00002000:00010000:2.0:1789431569.126309:0:14486:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb atime from disk: 1789431492 -> 1789431558
00002000:00010000:2.0:1789431569.126311:0:14486:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb ctime from disk: 1789431513 -> 1789431568
00002000:00010000:2.0:1789431569.126313:0:14486:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb blocks from disk: 515 -> 515
00000100:00100000:2.0:1789431569.126360:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2349:x1876351933604224:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 335us (1424us total) trans 4294969677 rc 0/0
00000100:00100000:2.0:1789431569.126367:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8412
00000100:00100000:1.0:1789431569.129704:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894255488:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431569.129736:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527df8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.136148:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.137142:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933604352
00000100:00100000:2.0:1789431569.137154:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933604352
00010000:00010000:2.0:1789431569.137211:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635129f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2bfe expref: 219 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.137255:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16705
00000100:00100000:2.0:1789431569.137264:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:2347:x1876351933604352:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431569.137280:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431569.137287:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635129f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2bfe expref: 219 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.137300:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635129f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2bfe expref: 219 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.137323:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635129f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2bfe expref: 219 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.137341:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:2.0:1789431569.137346:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527df8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.137354:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527df8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.137362:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527df8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.137394:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431569.137456:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:2347:x1876351933604352:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 192us (1317us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431569.137463:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16705
00010000:00010000:0.0:1789431569.137532:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527df8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.137541:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527df8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431569.137794:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10095:0x0]: returning size 260096
00010000:00010000:0.0:1789431569.137940:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527df1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93bc expref: 219 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.137956:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527df8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93bc expref: 218 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.137969:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:0.0:1789431569.137971:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431569.137985:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309000, rc 0)
00000100:00100000:0.0:1789431569.138012:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14616:x1876351933604096:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12733us (13125us total) trans 4295121156 rc 0/0
00000100:00100000:0.0:1789431569.138019:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296316
00000100:00100000:3.0:1789431569.144912:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.145135:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933604608
00000100:00100000:1.0:1789431569.145146:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933604608
00000100:00100000:1.0:1789431569.145209:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12550
00000100:00100000:1.0:1789431569.145218:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14617:x1876351933604608:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431569.145470:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14617:x1876351933604608:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 252us (567us total) trans 4295121157 rc 0/0
00000100:00100000:1.0:1789431569.145477:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12550
00000100:00100000:3.0:1789431569.146895:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.152451:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.155833:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933604736
00000100:00100000:1.0:1789431569.155847:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933604736
00000100:00100000:2.0:1789431569.155945:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933604864
00000100:00100000:2.0:1789431569.155953:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933604864
00000100:00100000:1.0:1789431569.156033:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296317
00000100:00100000:1.0:1789431569.156044:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14616:x1876351933604736:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.156090:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.156110:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527e06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c93c3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.156190:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527e0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.156205:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527df8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93bc expref: 221 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.156214:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527e0d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.156261:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527df8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93bc expref: 221 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.156275:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527df8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93bc expref: 221 pid: 12181 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.156304:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894255616:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431569.156393:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3c00 going to sleep for 11 seconds
00000100:00100000:1.0:1789431569.159565:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894255616:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431569.159598:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527e0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.163027:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.163188:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933604992
00000100:00100000:1.0:1789431569.163203:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933604992
00010000:00010000:1.0:1789431569.163260:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527df8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93bc expref: 222 pid: 12181 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.163315:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16706
00000100:00100000:1.0:1789431569.163326:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb05c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:2348:x1876351933604992:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431569.163340:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431569.163348:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527df8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93bc expref: 222 pid: 12181 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.163361:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527df8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93bc expref: 222 pid: 12181 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.163383:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527df8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93bc expref: 222 pid: 12181 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.163408:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:1.0:1789431569.163413:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527e0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.163423:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.163432:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527e0d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.163458:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431569.163500:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb05c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:2348:x1876351933604992:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 177us (483us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.163507:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16706
00010000:00010000:1.0:1789431569.163564:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.163572:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431569.163610:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10095:0x0]: returning size 260096
00000004:00200000:1.0:1789431569.163614:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431569.163632:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.163659:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527e06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93c3 expref: 221 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.163673:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527e0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93c3 expref: 220 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.163683:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:1.0:1789431569.163701:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431569.163704:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309e00, rc 0)
00000100:00100000:1.0:1789431569.163730:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14616:x1876351933604736:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7688us (16841us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.163737:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296317
00000100:00100000:1.0:1789431569.163753:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296318
00000100:00100000:1.0:1789431569.163761:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14617:x1876351933604864:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.163777:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.163791:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527e14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c93ca expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.163841:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.163851:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.164109:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.164128:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.164136:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.164143:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.164250:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.164260:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.164267:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431569.165765:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10094:0x0]: returning size 260096
00000004:00200000:1.0:1789431569.165773:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431569.165801:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.165818:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.165828:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.165834:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.165842:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.165847:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.165851:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.165931:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.165948:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431569.165951:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.165956:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.165962:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.165979:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.165985:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.165991:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.165997:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.166000:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.166006:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.166014:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x469e1765 (ffff90ce03149900)
00010000:00010000:1.0:1789431569.166016:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.166019:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.166025:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.166087:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527e14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93ca expref: 221 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.166102:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93ca expref: 220 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.166110:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:1.0:1789431569.166112:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431569.166115:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309600, rc 0)
00000100:00100000:1.0:1789431569.166172:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14617:x1876351933604864:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2411us (13732us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.166180:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296318
00000100:00100000:2.0:1789431569.175995:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.176037:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933605248
00000100:00100000:0.0:1789431569.176065:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933605248
00000100:00100000:0.0:1789431569.176131:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296319
00000100:00100000:0.0:1789431569.176142:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14617:x1876351933605248:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431569.176168:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431569.176190:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527e30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c93d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.176311:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527e37 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.176326:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93ca expref: 221 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.176335:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527e37 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.176368:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93ca expref: 221 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.176381:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93ca expref: 221 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.176394:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e90380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894255744:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431569.176475:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba393c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431569.179876:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e90380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894255744:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431569.179906:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527e37 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.182092:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.182308:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933605504
00000100:00100000:0.0:1789431569.182318:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933605504
00000100:00100000:0.0:1789431569.182377:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12551
00000100:00100000:0.0:1789431569.182388:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3bbf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14616:x1876351933605504:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431569.182672:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3bbf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14616:x1876351933605504:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 284us (630us total) trans 4295121158 rc 0/0
00000100:00100000:0.0:1789431569.182680:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12551
00000100:00100000:0.0:1789431569.185734:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.188957:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933605632
00000100:00100000:1.0:1789431569.188972:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933605632
00010000:00010000:1.0:1789431569.189019:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93ca expref: 223 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.189135:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16707
00000100:00100000:1.0:1789431569.189147:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:2348:x1876351933605632:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431569.189162:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431569.189169:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93ca expref: 223 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.189185:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93ca expref: 223 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.189214:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93ca expref: 223 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.189241:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:1.0:1789431569.189247:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527e37 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.189257:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527e37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.189265:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527e37 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.189294:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431569.189351:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:2348:x1876351933605632:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 206us (3624us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.189358:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16707
00010000:00010000:0.0:1789431569.190500:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527e37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.190513:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527e37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431569.190535:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10094:0x0]: returning size 260096
00010000:00010000:0.0:1789431569.190714:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63527e30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93d1 expref: 223 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.190736:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527e37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93d1 expref: 222 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.190751:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:0.0:1789431569.190754:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431569.190758:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3e00, rc 0)
00000100:00100000:0.0:1789431569.190821:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14617:x1876351933605248:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 14680us (14847us total) trans 4295121159 rc 0/0
00000100:00100000:0.0:1789431569.190829:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296319
00000100:00100000:0.0:1789431569.197109:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.197146:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.197267:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933605760
00000100:00100000:2.0:1789431569.197277:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933605760
00000100:00100000:2.0:1789431569.197339:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933605888
00000100:00100000:2.0:1789431569.197342:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933605888
00000100:00100000:2.0:1789431569.197375:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296320
00000100:00100000:2.0:1789431569.197385:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14616:x1876351933605760:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431569.197406:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431569.197427:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527e45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c93d8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.197492:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527e4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.197508:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527e4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.197520:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527e4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.197535:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527e53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.197542:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.197549:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.197647:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527e5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.197657:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.197668:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.197794:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296321
00000100:00100000:1.0:1789431569.197806:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14617:x1876351933605888:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.197820:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.197830:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527e61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c93df expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.197888:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.197901:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527e37 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93d1 expref: 225 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.197912:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e68 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.197944:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527e37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93d1 expref: 225 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.197958:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527e37 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93d1 expref: 225 pid: 5847 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.197972:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894255872:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431569.198076:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3300 going to sleep for 11 seconds
00000004:00200000:2.0:1789431569.198367:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10095:0x0]: returning size 260096
00000004:00200000:2.0:1789431569.198373:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431569.198396:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.198409:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.198417:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527e4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.198424:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527e4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.198431:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527e4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.198437:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431569.198441:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527e4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.198448:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527e4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.198460:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431569.198463:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431569.198468:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527e4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.198478:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527e4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.198490:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.198496:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527e53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.198501:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527e53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.198506:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431569.198509:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527e53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.198515:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527e53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.198522:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x469e1765 (ffff90cf13195a00)
00010000:00010000:2.0:1789431569.198524:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431569.198527:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527e53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.198532:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63527e53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.198561:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63527e45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93d8 expref: 226 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.198578:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93d8 expref: 225 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.198585:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:2.0:1789431569.198587:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431569.198590:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523800, rc 0)
00000100:00100000:2.0:1789431569.198624:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14616:x1876351933605760:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1241us (1524us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431569.198631:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296320
00000100:00100000:0.0:1789431569.204775:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.205130:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894255872:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431569.205158:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.206394:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933606016
00000100:00100000:3.0:1789431569.206405:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933606016
00010000:00010000:3.0:1789431569.206450:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527e37 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93d1 expref: 225 pid: 5847 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.206495:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16708
00000100:00100000:3.0:1789431569.206506:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e919180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:2347:x1876351933606016:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431569.206520:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431569.206528:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527e37 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93d1 expref: 225 pid: 5847 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.206541:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527e37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93d1 expref: 225 pid: 5847 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.206562:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527e37 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93d1 expref: 225 pid: 5847 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.206578:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:3.0:1789431569.206583:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.206592:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.206601:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e68 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.206630:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431569.206682:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e919180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:2347:x1876351933606016:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 178us (1917us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431569.206702:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16708
00010000:00010000:1.0:1789431569.206768:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.206777:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431569.206820:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10094:0x0]: returning size 260096
00000004:00200000:1.0:1789431569.206825:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431569.206846:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.206890:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527e61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93df expref: 224 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.206912:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93df expref: 223 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.206921:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:1.0:1789431569.206923:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431569.206926:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:1.0:1789431569.206954:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14617:x1876351933605888:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9150us (9806us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.206961:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296321
00000100:00100000:0.0:1789431569.218361:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.218464:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933606144
00000100:00100000:1.0:1789431569.218474:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933606144
00000100:00100000:1.0:1789431569.218542:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14383
00000100:00100000:1.0:1789431569.218552:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:2348:x1876351933606144:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431569.218568:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431569.218592:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63527e5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93d8 expref: 223 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.218613:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:1.0:1789431569.218618:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431569.218673:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:2348:x1876351933606144:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 122us (322us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.218680:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14383
00000100:00100000:2.0:1789431569.224117:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.224239:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933606400
00000100:00100000:1.0:1789431569.224251:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933606400
00000100:00100000:1.0:1789431569.224314:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296322
00000100:00100000:1.0:1789431569.224325:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14616:x1876351933606400:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.224346:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.224366:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527e6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c93e6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.224465:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.224480:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527e0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93c3 expref: 223 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.224488:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e76 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.224522:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527e0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93c3 expref: 223 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.224534:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527e0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93c3 expref: 223 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.224547:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894256000:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431569.224628:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3300 going to sleep for 11 seconds
00000100:00100000:3.0:1789431569.228330:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.228572:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933606528
00000100:00100000:1.0:1789431569.228581:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933606528
00000100:00100000:1.0:1789431569.228638:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296323
00000100:00100000:1.0:1789431569.228649:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14617:x1876351933606528:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.228668:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.228711:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527e7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c93ed expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.228775:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527e84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.228790:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527e84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.228802:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527e84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.228818:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.228825:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.228832:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.228927:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527e92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.228937:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.228944:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431569.228976:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10094:0x0]: returning size 260096
00000004:00200000:1.0:1789431569.228980:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431569.228999:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.229009:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.229017:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527e84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.229024:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527e84 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.229030:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527e84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.229035:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.229040:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527e84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.229178:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527e84 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.229193:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431569.229196:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.229202:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527e84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.229208:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb63527e84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.229231:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.229237:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.229243:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.229248:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.229251:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.229257:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.229264:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x469e1765 (ffff90ce03149900)
00010000:00010000:1.0:1789431569.229267:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.229269:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.229276:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63527e8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.229499:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527e7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93ed expref: 226 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.229513:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527e92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93ed expref: 225 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.229520:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:1.0:1789431569.229523:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431569.229526:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308c00, rc 0)
00000100:00100000:1.0:1789431569.229626:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14617:x1876351933606528:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 979us (1305us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.229634:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296323
00000100:00100000:1.0:1789431569.234620:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894256000:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431569.234650:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.239537:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.239582:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.239669:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933606656
00000100:00100000:0.0:1789431569.239679:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933606656
00010000:00010000:0.0:1789431569.239737:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527e0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93c3 expref: 225 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.239781:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16709
00000100:00100000:0.0:1789431569.239791:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:2348:x1876351933606656:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431569.239807:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431569.239814:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527e0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93c3 expref: 225 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.239828:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527e0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93c3 expref: 225 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.239852:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527e0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93c3 expref: 225 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.239879:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:0.0:1789431569.239884:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.239893:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.239900:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e76 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.239928:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431569.239976:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:2348:x1876351933606656:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 187us (448us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431569.239983:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16709
00010000:00010000:0.0:1789431569.240009:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.240017:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431569.240035:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10095:0x0]: returning size 260096
00010000:00010000:0.0:1789431569.240201:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527e6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93e6 expref: 225 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.240228:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93e6 expref: 224 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.240236:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:0.0:1789431569.240239:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431569.240241:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309600, rc 0)
00000100:00100000:0.0:1789431569.240265:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14616:x1876351933606400:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 15943us (16158us total) trans 4295121160 rc 0/0
00000100:00100000:0.0:1789431569.240271:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296322
00000100:00100000:0.0:1789431569.240709:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933606912
00000100:00100000:0.0:1789431569.240716:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933606912
00000100:00100000:3.0:1789431569.245216:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.245851:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933607040
00000100:00100000:1.0:1789431569.245871:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933607040
00000100:00100000:1.0:1789431569.245928:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296324
00000100:00100000:1.0:1789431569.245939:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14617:x1876351933606912:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431569.245995:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:1.0:1789431569.246020:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527e92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93ed expref: 225 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.246042:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527e68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93df expref: 224 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.246073:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:1.0:1789431569.246078:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431569.246118:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527ea0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.246131:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.246141:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.246485:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296325
00000100:00100000:3.0:1789431569.246497:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14616:x1876351933607040:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431569.246511:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431569.246522:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ea7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c93f4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.246581:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527eae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.246593:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e76 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93e6 expref: 224 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.246600:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527eae lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.246632:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93e6 expref: 224 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.246646:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e76 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93e6 expref: 224 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.246659:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894256128:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431569.246753:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf055960c0 going to sleep for 11 seconds
00000004:00010000:1.0:1789431569.247539:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001437ea40 reply state 0000000053ee7a27 transno 4295121161 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.247551:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431569.247633:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+226:14617:x1876351933606912:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1694us (8047us total) trans 4295121161 rc 0/0
00000100:00100000:1.0:1789431569.247640:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296324
00000100:00100000:3.0:1789431569.253235:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.253268:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933607168
00000100:00100000:3.0:1789431569.253277:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933607168
00000100:00100000:3.0:1789431569.253326:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8413
00000100:00100000:3.0:1789431569.253336:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2348:x1876351933607168:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:3.0:1789431569.253532:0:14471:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb size from disk: 260096 -> 260096
00002000:00010000:3.0:1789431569.253536:0:14471:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb mtime from disk: 1789431488 -> 1789431556
00002000:00010000:3.0:1789431569.253540:0:14471:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb atime from disk: 1789431558 -> 1789431548
00002000:00010000:3.0:1789431569.253543:0:14471:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb ctime from disk: 1789431568 -> 1789431568
00002000:00010000:3.0:1789431569.253545:0:14471:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb blocks from disk: 515 -> 515
00000100:00100000:3.0:1789431569.253597:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2348:x1876351933607168:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 262us (382us total) trans 4294969678 rc 0/0
00000100:00100000:3.0:1789431569.253604:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8413
00000100:00100000:3.0:1789431569.253788:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894256128:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431569.253811:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527eae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.254199:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.254209:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527ea0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.254227:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527ea0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.254233:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431569.254237:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527ea0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.254245:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527ea0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.254260:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:0.0:1789431569.254262:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431569.254267:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527ea0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.254273:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527ea0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.257390:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.257503:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933607296
00000100:00100000:1.0:1789431569.257513:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933607296
00010000:00010000:1.0:1789431569.257550:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e76 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93e6 expref: 225 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.257590:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16710
00000100:00100000:1.0:1789431569.257602:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:2347:x1876351933607296:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431569.257616:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431569.257622:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e76 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93e6 expref: 225 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.257634:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93e6 expref: 225 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.257655:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527e76 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93e6 expref: 225 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.257673:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:1.0:1789431569.257678:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527eae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.257698:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.257716:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527eae lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.257746:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431569.257800:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:2347:x1876351933607296:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 199us (419us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.257809:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16710
00010000:00010000:1.0:1789431569.257948:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.257957:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431569.258000:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10095:0x0]: returning size 260096
00000004:00200000:1.0:1789431569.258004:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431569.258024:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.258086:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63527ea7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93f4 expref: 224 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.258101:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93f4 expref: 223 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.258108:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:1.0:1789431569.258110:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431569.258113:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b000, rc 0)
00000100:00100000:1.0:1789431569.258144:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14616:x1876351933607040:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11651us (12937us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.258154:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296325
00000100:00100000:0.0:1789431569.269826:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.269898:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933607808
00000100:00100000:1.0:1789431569.269909:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933607808
00000100:00100000:1.0:1789431569.269967:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12552
00000100:00100000:1.0:1789431569.269977:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14617:x1876351933607808:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431569.270241:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14617:x1876351933607808:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 265us (424us total) trans 4295121162 rc 0/0
00000100:00100000:1.0:1789431569.270248:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12552
00000100:00100000:1.0:1789431569.271823:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.271901:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933607552
00000100:00100000:0.0:1789431569.271910:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933607552
00000100:00100000:0.0:1789431569.271957:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12553
00000100:00100000:0.0:1789431569.271967:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14616:x1876351933607552:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431569.272210:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14616:x1876351933607552:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 244us (393us total) trans 4295121163 rc 0/0
00000100:00100000:0.0:1789431569.272229:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12553
00000100:00100000:3.0:1789431569.276350:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.276532:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933607936
00000100:00100000:1.0:1789431569.276541:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933607936
00000100:00100000:1.0:1789431569.276600:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296326
00000100:00100000:1.0:1789431569.276611:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14617:x1876351933607936:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.276632:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.276652:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527eb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c93fb expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.276732:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527ebc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.276747:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527ebc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.276758:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527ebc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.276772:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ec3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.276780:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.276787:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.276904:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527eca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.276913:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.276920:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431569.276954:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10094:0x0]: returning size 260096
00000004:00200000:1.0:1789431569.276958:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431569.276979:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.276990:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.276997:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527ebc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.277003:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527ebc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.277010:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527ebc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.277020:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.277024:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527ebc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.277030:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527ebc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.277041:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431569.277044:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.277085:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527ebc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.277093:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527ebc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.277106:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.277112:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.277119:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.277124:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.277126:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.277132:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.277142:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x469e1765 (ffff90ce03149900)
00010000:00010000:1.0:1789431569.277145:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.277148:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ec3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.277153:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ec3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.277182:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527eb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93fb expref: 227 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.277194:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527eca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93fb expref: 226 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.277201:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:1.0:1789431569.277203:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431569.277205:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:1.0:1789431569.277295:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+226:14617:x1876351933607936:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 686us (954us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.277302:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296326
00000100:00100000:3.0:1789431569.282957:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.285761:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933608064
00000100:00100000:1.0:1789431569.285776:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933608064
00000100:00100000:1.0:1789431569.285837:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296327
00000100:00100000:1.0:1789431569.285849:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+226:14616:x1876351933608064:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.286083:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.286105:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527ed1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9402 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.286175:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ed8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.286190:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.286200:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.286212:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527edf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.286340:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.286348:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286509:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527ee6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286519:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286527:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431569.286558:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10095:0x0]: returning size 260096
00000004:00200000:0.0:1789431569.286563:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431569.286581:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286591:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286598:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286604:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ed8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286610:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286616:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431569.286620:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286627:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ed8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286638:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431569.286640:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431569.286646:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ed8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286652:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527ed8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286664:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286670:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527edf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286675:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527edf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286680:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431569.286683:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527edf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286709:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527edf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286720:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x469e1765 (ffff90ce03149900)
00010000:00010000:0.0:1789431569.286722:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431569.286725:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527edf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286731:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527edf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286760:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527ed1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9402 expref: 228 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286776:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9402 expref: 227 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.286783:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:0.0:1789431569.286786:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431569.286788:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3e00, rc 0)
00000100:00100000:0.0:1789431569.286921:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:14616:x1876351933608064:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1009us (4006us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431569.286931:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296327
00000100:00100000:2.0:1789431569.297157:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.297324:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933608576
00000100:00100000:1.0:1789431569.297335:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933608576
00000100:00100000:1.0:1789431569.297394:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296328
00000100:00100000:1.0:1789431569.297405:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:14617:x1876351933608576:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.297425:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.297445:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527eed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9410 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.297545:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527ef4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.297564:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527eca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93fb expref: 228 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.297573:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527ef4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.297606:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527eca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93fb expref: 228 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.297620:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527eca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93fb expref: 228 pid: 12775 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.297633:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894256256:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431569.297731:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3600 going to sleep for 11 seconds
00000100:00100000:3.0:1789431569.303712:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.303779:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.303815:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.303897:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933608704
00000100:00100000:2.0:1789431569.303906:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933608704
00000100:00100000:2.0:1789431569.303971:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933608832
00000100:00100000:2.0:1789431569.303975:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933608832
00010000:00010000:2.0:1789431569.303992:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527eca lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93fb expref: 230 pid: 12775 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.304018:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16711
00000100:00100000:2.0:1789431569.304028:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:2347:x1876351933608832:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431569.304042:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431569.304077:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527eca lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93fb expref: 230 pid: 12775 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.304091:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527eca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93fb expref: 230 pid: 12775 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.304117:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:2.0:1789431569.304121:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527ef4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.304130:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527ef4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.304138:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527ef4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.304157:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431569.304206:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:2347:x1876351933608832:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 179us (426us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431569.304213:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16711
00000100:00100000:2.0:1789431569.304248:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14384
00000100:00100000:2.0:1789431569.304254:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:2349:x1876351933608704:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431569.304262:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431569.304273:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527ee6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9402 expref: 229 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.304287:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:2.0:1789431569.304291:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431569.304309:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:2349:x1876351933608704:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 55us (624us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431569.304315:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14384
00000100:00100000:1.0:1789431569.304777:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933608320
00000100:00100000:1.0:1789431569.304783:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933608320
00000100:00100000:1.0:1789431569.304827:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296329
00000100:00100000:1.0:1789431569.304836:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14616:x1876351933608320:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.304851:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.304876:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527efb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9409 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.304976:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527f02 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.304989:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527eae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93f4 expref: 229 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.305002:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527f02 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.305032:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93f4 expref: 229 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.305071:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527eae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93f4 expref: 229 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.305085:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894256384:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431569.305146:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3000 going to sleep for 11 seconds
00010000:00010000:1.0:1789431569.305179:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527eca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93fb expref: 229 pid: 12775 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.305192:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894256256:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431569.305207:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527ef4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.305215:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527ef4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.305232:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527ef4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431569.305247:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10094:0x0]: returning size 260096
00010000:00010000:1.0:1789431569.305368:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527eed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9410 expref: 230 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.305386:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527ef4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9410 expref: 229 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.305393:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:1.0:1789431569.305396:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431569.305398:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309600, rc 0)
00000100:00100000:1.0:1789431569.305422:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14617:x1876351933608576:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8020us (8273us total) trans 4295121164 rc 0/0
00000100:00100000:1.0:1789431569.305428:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296328
00000100:00100000:1.0:1789431569.311102:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894256384:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431569.311131:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527f02 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.314733:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.314979:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933608960
00000100:00100000:0.0:1789431569.314990:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933608960
00000100:00100000:0.0:1789431569.315091:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296330
00000100:00100000:0.0:1789431569.315103:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14617:x1876351933608960:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431569.315124:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431569.315145:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527f10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9417 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.315249:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527f17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.315264:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527ef4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9410 expref: 230 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.315272:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527f17 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.315304:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527ef4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9410 expref: 230 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.315316:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527ef4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9410 expref: 230 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.315329:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1e91a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894256512:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431569.315404:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba39a80 going to sleep for 11 seconds
00000100:00100000:3.0:1789431569.321320:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.321348:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.321465:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933609088
00000100:00100000:1.0:1789431569.321473:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933609088
00010000:00010000:1.0:1789431569.321513:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527eae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93f4 expref: 231 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.321545:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933609216
00000100:00100000:1.0:1789431569.321548:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933609216
00010000:00010000:1.0:1789431569.321558:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527ef4 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9410 expref: 232 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.321583:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16712
00000100:00100000:1.0:1789431569.321593:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:2348:x1876351933609088:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431569.321606:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431569.321613:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527eae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93f4 expref: 232 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.321625:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93f4 expref: 232 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.321647:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63527eae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93f4 expref: 232 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.321663:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:1.0:1789431569.321668:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527f02 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.321676:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527f02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.321699:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527f02 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.321724:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431569.321771:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:2348:x1876351933609088:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 179us (459us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.321778:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16712
00000100:00100000:1.0:1789431569.321795:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16713
00000100:00100000:1.0:1789431569.321802:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:2347:x1876351933609216:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431569.321810:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431569.321815:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527ef4 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9410 expref: 230 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.321829:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527ef4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9410 expref: 230 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.321840:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:1.0:1789431569.321844:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527f17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.321851:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.321866:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527f17 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.321878:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431569.321897:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:2347:x1876351933609216:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 95us (548us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.321903:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16713
00010000:00010000:1.0:1789431569.321929:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527f02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.321937:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527f02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431569.321955:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10095:0x0]: returning size 260096
00010000:00010000:1.0:1789431569.322133:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527efb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9409 expref: 231 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.322150:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527f02 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9409 expref: 230 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.322158:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:1.0:1789431569.322161:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431569.322164:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308c00, rc 0)
00000100:00100000:1.0:1789431569.322188:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14616:x1876351933608320:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 17354us (18372us total) trans 4295121165 rc 0/0
00000100:00100000:1.0:1789431569.322195:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296329
00010000:00010000:0.0:1789431569.322877:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63527ef4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10094:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9410 expref: 229 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.322894:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf1e91a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894256512:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431569.322915:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.322923:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.322933:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431569.322967:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10094:0x0]: returning size 260096
00000004:00200000:0.0:1789431569.322972:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431569.322987:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.323011:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527f10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10094:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9417 expref: 229 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.323025:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2600/0xd8e438fb63527f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10094:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9417 expref: 228 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.323032:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10094:0x0].0x0 (ffff90ce2e707700)
00010000:00010000:0.0:1789431569.323035:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431569.323038:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2600, rc 0)
00000100:00100000:0.0:1789431569.323115:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14617:x1876351933608960:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8015us (8393us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431569.323122:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296330
00000100:00100000:3.0:1789431569.331000:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.331263:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933609344
00000100:00100000:2.0:1789431569.331274:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933609344
00000100:00100000:2.0:1789431569.331342:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296331
00000100:00100000:2.0:1789431569.331351:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14616:x1876351933609344:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431569.331376:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431569.331398:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527f25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c941e expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.331483:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527f2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.331498:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527f02 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9409 expref: 229 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.331507:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527f2c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.331540:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527f02 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9409 expref: 229 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.331554:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527f02 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9409 expref: 229 pid: 12775 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.331567:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce17f3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894256640:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431569.331647:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf11f8b780 going to sleep for 11 seconds
00000100:00100000:3.0:1789431569.335320:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.335737:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933609472
00000100:00100000:0.0:1789431569.335747:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933609472
00010000:00010000:0.0:1789431569.335789:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527f02 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9409 expref: 230 pid: 12775 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.335833:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16714
00000100:00100000:0.0:1789431569.335844:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:2347:x1876351933609472:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431569.335874:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431569.335882:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527f02 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9409 expref: 230 pid: 12775 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.335896:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527f02 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9409 expref: 230 pid: 12775 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.335918:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:0.0:1789431569.335924:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527f2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.335942:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.335949:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527f2c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.335970:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431569.336018:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:2347:x1876351933609472:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 177us (707us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431569.336025:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16714
00010000:00010000:1.0:1789431569.336272:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527f02 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9409 expref: 229 pid: 12775 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.336288:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894256640:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431569.336308:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.336316:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.336322:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431569.336363:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10095:0x0]: returning size 260096
00000004:00200000:1.0:1789431569.336367:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431569.336385:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.336414:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527f25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c941e expref: 229 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.336433:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527f2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c941e expref: 228 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.336441:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:1.0:1789431569.336444:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431569.336446:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522200, rc 0)
00000100:00100000:1.0:1789431569.336473:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14616:x1876351933609344:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 5123us (5483us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.336479:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296331
00000100:00100000:3.0:1789431569.346799:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.346972:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933609600
00000100:00100000:2.0:1789431569.346983:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933609600
00000100:00100000:2.0:1789431569.347131:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296332
00000100:00100000:2.0:1789431569.347142:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14617:x1876351933609600:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431569.347162:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431569.347184:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63527f33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9425 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347248:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527f3a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347262:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527f3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347274:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527f3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347300:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527f41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347307:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347314:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347372:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527f3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347379:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527f3a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347386:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527f3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347392:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431569.347396:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527f3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347403:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527f3a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347414:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431569.347418:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431569.347423:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527f3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347430:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527f3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347443:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347450:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527f41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347455:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527f41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347459:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431569.347462:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527f41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347467:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527f41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347472:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90cf13195a00)
00010000:00010000:2.0:1789431569.347475:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431569.347477:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527f41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347483:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63527f41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347513:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63527f33 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9425 expref: 229 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347523:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431569.347526:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431569.347529:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63527f33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9425 expref: 229 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.347539:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523600, rc 0)
00000100:00100000:2.0:1789431569.347605:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14617:x1876351933609600:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 465us (815us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431569.347613:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296332
00000100:00100000:2.0:1789431569.356530:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.356617:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933609728
00000100:00100000:1.0:1789431569.356629:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933609728
00000100:00100000:1.0:1789431569.356758:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296333
00000100:00100000:1.0:1789431569.356770:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14616:x1876351933609728:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.356791:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.356814:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527f48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c942c expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.356883:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527f4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.356897:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527f4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.356909:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527f4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.356923:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527f56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.356930:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.356937:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357045:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527f5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357090:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357098:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431569.357131:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10095:0x0]: returning size 260096
00000004:00200000:1.0:1789431569.357135:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431569.357153:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357164:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357171:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527f4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357177:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527f4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357184:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527f4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357195:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.357199:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527f4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357205:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527f4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357228:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431569.357231:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.357236:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527f4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357243:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527f4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357255:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357262:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527f56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357267:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527f56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357273:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.357275:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527f56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357292:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527f56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357304:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x469e1765 (ffff90ce03149d00)
00010000:00010000:1.0:1789431569.357306:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.357309:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527f56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357314:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527f56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357343:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527f48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c942c expref: 230 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357357:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527f5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c942c expref: 229 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.357364:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:1.0:1789431569.357366:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431569.357369:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:1.0:1789431569.357433:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14616:x1876351933609728:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 664us (911us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.357440:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296333
00000100:00100000:3.0:1789431569.361309:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.362232:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.362256:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933610112
00000100:00100000:3.0:1789431569.362266:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933610112
00000100:00100000:3.0:1789431569.362341:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14385
00000100:00100000:3.0:1789431569.362352:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:2350:x1876351933610112:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431569.362370:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431569.362394:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63527f5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c942c expref: 229 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.362413:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:3.0:1789431569.362418:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431569.362470:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:2350:x1876351933610112:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 120us (252us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431569.362478:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14385
00000100:00100000:0.0:1789431569.366456:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933609984
00000100:00100000:0.0:1789431569.366471:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933609984
00000100:00100000:0.0:1789431569.366551:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296334
00000100:00100000:0.0:1789431569.366561:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14617:x1876351933609984:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431569.366579:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431569.366582:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431569.366609:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63527bf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9322 expref: 228 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.366630:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431569.366635:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431569.366648:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527f64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9433 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.366819:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527f6b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.366834:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527f6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.366843:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527f6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.367205:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527f72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.367215:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527f72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.367223:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527f72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431569.368084:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x51b:0x0], index 0: 0
00010000:00010000:0.0:1789431569.368240:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.368252:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.368264:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.368349:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527f6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.368357:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527f6b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.368364:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527f6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.368369:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431569.368373:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527f6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.368380:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527f6b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.368390:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431569.368392:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431569.368397:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527f6b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.368402:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63527f6b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431569.368414:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b36b26ef reply state 00000000c63dadf3 transno 4295121166 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527f72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.368423:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431569.368450:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63527f64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9433 expref: 230 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.368463:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9433 expref: 229 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.368471:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab2:0x0].0x0 (ffff90ce07190f00)
00010000:00010000:0.0:1789431569.368473:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431569.368475:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2200, rc 0)
00000100:00100000:0.0:1789431569.368544:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14617:x1876351933609984:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1985us (7245us total) trans 4295121166 rc 0/0
00000100:00100000:0.0:1789431569.368552:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296334
00000100:00100000:3.0:1789431569.371299:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.372203:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933610368
00000100:00100000:0.0:1789431569.372215:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933610368
00000100:00100000:0.0:1789431569.372275:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296335
00000100:00100000:0.0:1789431569.372285:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14616:x1876351933610368:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431569.372339:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431569.372367:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63527f2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c941e expref: 230 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.372387:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:0.0:1789431569.372392:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431569.372442:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527f87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.372457:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527f87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.372466:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527f87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431569.372609:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000098130b7d reply state 00000000ed0be080 transno 4295121167 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527f87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.372619:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431569.372730:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14616:x1876351933610368:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 446us (1452us total) trans 4295121167 rc 0/0
00000100:00100000:0.0:1789431569.372737:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296335
00000100:00100000:0.0:1789431569.379675:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.379745:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933610496
00010000:00010000:1.0:1789431569.379756:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527f72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.379756:0:14464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933610496
00010000:00010000:1.0:1789431569.379768:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527f72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.379775:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527f72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.379784:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.379789:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527f72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.379797:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527f72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.379813:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90ce07190e00)
00000100:00100000:3.0:1789431569.379814:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8414
00010000:00010000:1.0:1789431569.379816:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.379821:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527f72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.379823:0:14464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2347:x1876351933610496:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.379828:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63527f72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.379840:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431569.379857:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d2dcbad/0xd8e438fb63527f8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x51b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c943a expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431569.379881:0:14464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x51b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431569.379900:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51b:0x0].0x0 since=3027s v=(0 0)
00010000:00010000:3.0:1789431569.379905:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431569.379914:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d2dcbad/0xd8e438fb63527f8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c943a expref: 69 pid: 14464 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.379945:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007d2dcbad/0xd8e438fb63527f8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c943a expref: 69 pid: 14464 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.379969:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a000, rc 0)
00000100:00100000:3.0:1789431569.380027:0:14464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2347:x1876351933610496:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 204us (361us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431569.380034:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8414
00010000:00010000:0.0:1789431569.386487:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527f87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.386504:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527f87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.386512:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527f87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.386519:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431569.386523:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527f87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.386531:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527f87 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.386548:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:0.0:1789431569.386550:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431569.386566:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527f87 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.386572:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63527f87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.386903:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.387252:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933610624
00000100:00100000:3.0:1789431569.387263:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933610624
00000100:00100000:3.0:1789431569.387321:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8415
00000100:00100000:3.0:1789431569.387333:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2348:x1876351933610624:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:3.0:1789431569.387540:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb size from disk: 260096 -> 260096
00002000:00010000:3.0:1789431569.387544:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb mtime from disk: 1789431502 -> 1789431490
00002000:00010000:3.0:1789431569.387547:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb atime from disk: 1789431494 -> 1789431558
00002000:00010000:3.0:1789431569.387550:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb ctime from disk: 1789431514 -> 1789431568
00002000:00010000:3.0:1789431569.387657:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb blocks from disk: 515 -> 515
00000100:00100000:3.0:1789431569.387880:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2348:x1876351933610624:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 547us (979us total) trans 4294970073 rc 0/0
00000100:00100000:3.0:1789431569.387888:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8415
00000100:00100000:2.0:1789431569.398281:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.400557:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933610880
00000100:00100000:0.0:1789431569.400573:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933610880
00000100:00100000:0.0:1789431569.400716:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12554
00000100:00100000:0.0:1789431569.400728:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14617:x1876351933610880:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431569.400899:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.401130:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14617:x1876351933610880:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 404us (2857us total) trans 4295121168 rc 0/0
00000100:00100000:0.0:1789431569.401139:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12554
00000100:00100000:0.0:1789431569.412898:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933611136
00000100:00100000:0.0:1789431569.412913:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933611136
00000100:00100000:0.0:1789431569.413282:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12555
00000100:00100000:0.0:1789431569.413298:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14616:x1876351933611136:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431569.413691:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14616:x1876351933611136:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 387us (12781us total) trans 4295121169 rc 0/0
00000100:00100000:0.0:1789431569.413796:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12555
00000100:00100000:0.0:1789431569.414867:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.415392:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933611392
00000100:00100000:0.0:1789431569.415402:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933611392
00000100:00100000:0.0:1789431569.415440:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12556
00000100:00100000:0.0:1789431569.415450:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14617:x1876351933611392:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431569.419183:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14617:x1876351933611392:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 3722us (4309us total) trans 4295121170 rc 0/0
00000100:00100000:0.0:1789431569.419197:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12556
00000100:00100000:0.0:1789431569.420547:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.422501:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933611520
00000100:00100000:3.0:1789431569.422514:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933611520
00000100:00100000:3.0:1789431569.422706:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296336
00000100:00100000:3.0:1789431569.422718:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14616:x1876351933611520:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431569.422751:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431569.422774:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63527f95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9441 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.422864:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527f9c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.422879:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527f9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.422889:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527f9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.422901:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.422907:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.422913:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.424447:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527faa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.424463:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.424474:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431569.424511:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10095:0x0]: returning size 260096
00000004:00200000:3.0:1789431569.424516:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431569.424536:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.424665:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.424677:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527f9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.426609:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527f9c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.426629:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527f9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.426635:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431569.426640:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527f9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.426649:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527f9c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.426664:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431569.426667:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431569.426672:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527f9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.426679:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63527f9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.427154:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.427162:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fa3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.427168:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.427172:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7be00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431569.427175:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.427180:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fa3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.427189:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x469e1765 (ffff90cf18b78100)
00010000:00010000:3.0:1789431569.427192:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431569.427196:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fa3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.427201:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.427401:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63527f95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9441 expref: 234 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.427420:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527faa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9441 expref: 233 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.427427:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:3.0:1789431569.427430:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431569.427432:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7ba00, rc 0)
00000100:00100000:3.0:1789431569.427550:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14616:x1876351933611520:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4834us (7007us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431569.427568:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296336
00000100:00100000:0.0:1789431569.438569:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.438716:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933611776
00000100:00100000:3.0:1789431569.438727:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933611776
00000100:00100000:3.0:1789431569.438801:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296337
00000100:00100000:3.0:1789431569.438811:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14616:x1876351933611776:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431569.438835:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431569.438855:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63527fb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9448 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.438956:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fb8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.438981:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527faa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9441 expref: 234 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.438990:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fb8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.439025:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527faa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9441 expref: 234 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.439039:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527faa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9441 expref: 234 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.439090:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac77100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894256768:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431569.439173:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf055960c0 going to sleep for 11 seconds
00000100:00100000:0.0:1789431569.440516:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.442227:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933612032
00000100:00100000:2.0:1789431569.442242:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933612032
00000100:00100000:2.0:1789431569.442310:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296338
00000100:00100000:2.0:1789431569.442321:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14617:x1876351933612032:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431569.442377:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431569.442404:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63527f79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9433 expref: 235 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.442427:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab2:0x0].0x0 (ffff90ce07190f00)
00010000:00010000:2.0:1789431569.442439:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431569.442461:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527fbf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.442475:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527fbf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.442484:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527fbf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.442500:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527fc6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.442508:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527fc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.442515:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527fc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.442629:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527fcd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10ab2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.442638:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527fcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.442645:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527fcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.443163:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac77100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894256768:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431569.443185:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fb8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431569.444565:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1250, 64 off88192
00010000:00010000:1.0:1789431569.444641:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527fd4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444657:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444667:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444676:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527fd4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10ab2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444682:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527fd4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10ab2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444702:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527fd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444724:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431569.444749:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527fcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444755:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527fcd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10ab2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444766:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527fcd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444771:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.444775:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527fcd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444783:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527fcd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10ab2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444794:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab2:0x0].0x0 (ffff90cf13195300)
00010000:00010000:1.0:1789431569.444797:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431569.444801:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527fcd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10ab2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444808:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63527fcd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10ab2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444828:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527fbf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444838:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527fbf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444844:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527fbf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444849:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.444853:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527fbf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444858:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527fbf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444867:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431569.444869:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.444872:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527fbf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.444877:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63527fbf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431569.444887:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009e56a3be reply state 00000000be26fb76 transno 4295121171 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527fc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.444896:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:2.0:1789431569.445031:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431569.445039:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527fd4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.445045:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308c00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431569.445074:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527fd4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.445082:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527fd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.445092:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab2:0x0].0x0 (ffff90cf13195300)
00010000:00010000:2.0:1789431569.445094:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431569.445098:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527fd4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10ab2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.445103:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63527fd4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.445115:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14617:x1876351933612032:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2792us (4602us total) trans 4295121171 rc 0/0
00010000:00010000:2.0:1789431569.445117:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431569.445119:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431569.445121:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431569.445124:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296338
00000100:00100000:0.0:1789431569.445923:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.448294:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933612160
00000100:00100000:1.0:1789431569.448308:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933612160
00010000:00010000:1.0:1789431569.448358:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527faa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9441 expref: 236 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.448398:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16715
00000100:00100000:1.0:1789431569.448408:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:2348:x1876351933612160:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431569.448424:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431569.448431:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527faa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9441 expref: 236 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.448445:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527faa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9441 expref: 236 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.448468:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63527faa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9441 expref: 236 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.448485:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:1.0:1789431569.448490:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fb8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.448499:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.448506:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fb8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.448539:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431569.448593:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:2348:x1876351933612160:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 187us (2742us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.448600:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16715
00010000:00010000:3.0:1789431569.449950:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.449972:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431569.449993:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10095:0x0]: returning size 260096
00010000:00010000:3.0:1789431569.450165:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63527fb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9448 expref: 236 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.450184:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9448 expref: 235 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.450192:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:3.0:1789431569.450195:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431569.450197:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7be00, rc 0)
00000100:00100000:3.0:1789431569.450259:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14616:x1876351933611776:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11449us (11709us total) trans 4295121172 rc 0/0
00000100:00100000:3.0:1789431569.450267:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296337
00010000:00010000:1.0:1789431569.455240:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527fc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.455258:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527fc6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.455267:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527fc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.455273:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.455278:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527fc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.455285:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527fc6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.455302:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90cf13195a00)
00010000:00010000:1.0:1789431569.455305:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.455309:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527fc6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.455315:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63527fc6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.465119:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.465205:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933612288
00000100:00100000:1.0:1789431569.465215:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933612288
00000100:00100000:1.0:1789431569.465276:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296339
00000100:00100000:1.0:1789431569.465287:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14616:x1876351933612288:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.465311:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.465331:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527fe2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c944f expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.465420:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527fe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.465435:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fb8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9448 expref: 235 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.465443:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527fe9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.465474:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9448 expref: 235 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.465488:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fb8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9448 expref: 235 pid: 12181 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.465501:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894256896:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431569.465581:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3000 going to sleep for 11 seconds
00000100:00100000:1.0:1789431569.471741:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894256896:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431569.471771:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527fe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.471971:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.472042:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933612416
00000100:00100000:1.0:1789431569.472080:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933612416
00000100:00100000:1.0:1789431569.472136:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296340
00000100:00100000:1.0:1789431569.472146:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07451450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14617:x1876351933612416:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.472166:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.472187:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527ff0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9456 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472251:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527ff7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472265:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527ff7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472275:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527ff7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472290:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527ffe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472297:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472305:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472358:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527ff7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472367:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527ff7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472374:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472380:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.472385:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472393:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527ff7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472404:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431569.472407:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.472412:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527ff7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472417:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63527ff7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472430:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472436:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527ffe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472442:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527ffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472447:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.472449:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527ffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472455:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527ffe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472462:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90ce03149d00)
00010000:00010000:1.0:1789431569.472464:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.472467:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527ffe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472474:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63527ffe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472504:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527ff0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9456 expref: 237 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472514:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431569.472516:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.472520:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63527ff0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9456 expref: 237 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.472531:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:1.0:1789431569.472576:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07451450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14617:x1876351933612416:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 431us (606us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431569.472583:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296340
00000100:00100000:0.0:1789431569.476232:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.476325:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933612544
00000100:00100000:3.0:1789431569.476335:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933612544
00010000:00010000:3.0:1789431569.476377:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fb8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9448 expref: 236 pid: 12181 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.476419:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16716
00000100:00100000:3.0:1789431569.476429:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:2347:x1876351933612544:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431569.476444:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431569.476451:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fb8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9448 expref: 236 pid: 12181 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.476463:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9448 expref: 236 pid: 12181 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.476487:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63527fb8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9448 expref: 236 pid: 12181 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.476502:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:3.0:1789431569.476507:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527fe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.476517:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.476525:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527fe9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.476592:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431569.476645:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:2347:x1876351933612544:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 216us (422us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431569.476652:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16716
00000100:00100000:0.0:1789431569.481224:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.481328:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933612672
00000100:00100000:2.0:1789431569.481338:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933612672
00000100:00100000:2.0:1789431569.481392:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296341
00000100:00100000:2.0:1789431569.481402:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14617:x1876351933612672:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431569.481422:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431569.481443:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528005 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c945d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.481507:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb6352800c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.481527:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb6352800c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.481538:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb6352800c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431569.481572:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008c:0x0]: returning size 16384
00000004:00200000:2.0:1789431569.481576:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431569.481594:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb6352800c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.481619:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528005 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c945d expref: 237 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.481637:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb6352800c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c945d expref: 236 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.481645:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431569.481647:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:2.0:1789431569.481650:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522600, rc 0)
00000100:00100000:2.0:1789431569.481720:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14617:x1876351933612672:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 319us (505us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431569.481727:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296341
00010000:00010000:1.0:1789431569.484944:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.484962:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431569.485015:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10095:0x0]: returning size 260096
00000004:00200000:1.0:1789431569.485020:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431569.485045:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.485106:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63527fe2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c944f expref: 236 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.485135:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c944f expref: 235 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.485144:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:1.0:1789431569.485147:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431569.485151:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:1.0:1789431569.485233:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14616:x1876351933612288:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 19947us (20122us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.485242:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296339
00000100:00100000:0.0:1789431569.491222:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.491274:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933612800
00000100:00100000:2.0:1789431569.491284:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933612800
00000100:00100000:2.0:1789431569.491358:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12557
00000100:00100000:2.0:1789431569.491368:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14617:x1876351933612800:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431569.499214:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.499863:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933612928
00000100:00100000:1.0:1789431569.499874:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933612928
00000100:00100000:1.0:1789431569.499939:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296342
00000100:00100000:1.0:1789431569.499950:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14616:x1876351933612928:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.499971:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.499992:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63528013 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9464 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500093:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352801a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500107:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352801a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500120:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352801a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500133:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63528021 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500141:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63528021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500148:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63528021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500245:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528028 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500254:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500261:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431569.500304:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10095:0x0]: returning size 260096
00000004:00200000:1.0:1789431569.500308:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431569.500339:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500350:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500357:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352801a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500364:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352801a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500371:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352801a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500381:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.500385:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352801a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500393:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352801a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500406:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431569.500409:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.500413:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352801a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500419:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352801a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500432:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63528021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500438:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63528021 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500444:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63528021 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500449:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.500452:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63528021 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500458:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63528021 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500471:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x469e1765 (ffff90ce03149d00)
00010000:00010000:1.0:1789431569.500473:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.500476:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63528021 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500481:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63528021 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500512:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309200/0xd8e438fb63528013 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9464 expref: 238 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500526:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528028 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9464 expref: 237 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.500533:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:1.0:1789431569.500536:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431569.500538:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308200, rc 0)
00000100:00100000:1.0:1789431569.500597:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+237:14616:x1876351933612928:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 650us (1394us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.500604:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296342
00000100:00100000:0.0:1789431569.508341:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14617:x1876351933612800:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 16962us (17123us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431569.508357:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12557
00000100:00100000:1.0:1789431569.508821:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.508997:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.512614:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933613312
00000100:00100000:0.0:1789431569.512630:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933613312
00000100:00100000:0.0:1789431569.512725:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296343
00000100:00100000:0.0:1789431569.512736:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14616:x1876351933613312:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431569.512788:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431569.512817:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb63527fe9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c944f expref: 236 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.512837:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:0.0:1789431569.512842:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431569.512890:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352802f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.512903:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528028 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9464 expref: 235 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.512916:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352802f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.512949:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528028 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9464 expref: 235 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.512963:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528028 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9464 expref: 235 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.512976:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e829180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894257024:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431569.513176:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba39a80 going to sleep for 11 seconds
00000100:00100000:3.0:1789431569.514038:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933613056
00000100:00100000:3.0:1789431569.516391:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933613056
00010000:00010000:1.0:1789431569.516635:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528028 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9464 expref: 236 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.516720:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16717
00000100:00100000:1.0:1789431569.516733:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e8a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:2348:x1876351933613056:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431569.516750:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431569.516757:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528028 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9464 expref: 236 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.516771:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528028 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9464 expref: 236 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.516793:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:1.0:1789431569.516798:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352802f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.516807:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352802f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.516816:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352802f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.516837:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431569.516903:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e8a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:2348:x1876351933613056:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 174us (8084us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.516910:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16717
00000100:00100000:0.0:1789431569.518195:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431569.518286:0:6797:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@000000008ebbc090 x1876351894257024) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528028 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9464 expref: 235 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.518307:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528028 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9464 expref: 235 pid: 5848 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.518325:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e829180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894257024:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431569.518345:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:0.0:1789431569.518353:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352802f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.518362:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352802f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.518369:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352802f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.518503:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933613568
00000100:00100000:2.0:1789431569.518511:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933613568
00000004:00010000:0.0:1789431569.518527:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003201c8d9 reply state 0000000019a0d0d9 transno 4295121173 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352802f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.518535:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431569.518561:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296344
00000100:00100000:2.0:1789431569.518570:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14617:x1876351933613568:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431569.518587:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431569.518612:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528036 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c946b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.518627:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+238:14616:x1876351933613312:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 5893us (9630us total) trans 4295121173 rc 0/0
00000100:00100000:0.0:1789431569.518633:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296343
00010000:00010000:2.0:1789431569.518677:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352803d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518724:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352803d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518743:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352803d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518758:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528044 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518765:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528044 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518771:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528044 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518815:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352803d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518822:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352803d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518830:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352803d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518836:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431569.518841:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352803d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518849:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352803d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518860:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431569.518863:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431569.518866:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352803d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518873:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352803d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518884:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528044 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518891:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528044 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518896:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528044 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518901:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431569.518903:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528044 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518915:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528044 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518922:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90cf13195300)
00010000:00010000:2.0:1789431569.518924:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431569.518927:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528044 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518933:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528044 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518961:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528036 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c946b expref: 237 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518970:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431569.518972:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:2.0:1789431569.518976:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528036 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c946b expref: 237 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.518984:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523800, rc 0)
00000100:00100000:2.0:1789431569.519015:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14617:x1876351933613568:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 446us (826us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431569.519021:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296344
00010000:00010000:3.0:1789431569.526473:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352802f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.526490:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352802f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.526499:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352802f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.526504:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431569.526509:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352802f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.526516:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352802f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.526532:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:3.0:1789431569.526535:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431569.526539:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352802f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.526545:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352802f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.526679:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.527465:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933613824
00000100:00100000:2.0:1789431569.527477:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933613824
00000100:00100000:2.0:1789431569.527540:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296345
00000100:00100000:2.0:1789431569.527561:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14617:x1876351933613824:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431569.527584:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431569.527587:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:2.0:1789431569.527610:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb6352800c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c945d expref: 235 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.527626:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431569.527630:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431569.527642:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb6352804b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9472 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.527774:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528052 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.527787:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528052 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.527797:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528052 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.527818:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528059 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.527826:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.527832:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:2.0:1789431569.528346:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x51b:0x0], index 1: 0
00010000:00010000:2.0:1789431569.528503:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.528516:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.528524:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.528555:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528052 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.528563:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528052 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.528570:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528052 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.528576:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431569.528580:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528052 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.528587:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528052 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.528597:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431569.528599:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431569.528603:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528052 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.528610:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528052 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431569.528620:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008ebbc090 reply state 0000000014468b25 transno 4295121174 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.528630:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:2.0:1789431569.528655:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb6352804b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9472 expref: 237 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.528669:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9472 expref: 236 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.528677:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431569.528679:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431569.528681:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523a00, rc 0)
00000100:00100000:2.0:1789431569.528764:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+237:14617:x1876351933613824:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1214us (2088us total) trans 4295121174 rc 0/0
00000100:00100000:2.0:1789431569.528772:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296345
00000100:00100000:0.0:1789431569.534778:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.534933:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933613952
00000100:00100000:3.0:1789431569.534943:0:14490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933613952
00010000:00010000:1.0:1789431569.535008:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.535011:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8416
00010000:00010000:1.0:1789431569.535023:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528059 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.535024:0:14490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2347:x1876351933613952:12345-192.168.203.4@tcp:2:dbench.0
00010000:00010000:1.0:1789431569.535038:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528059 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.535044:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522200 already unused, calling callback (ffffffffc211f4f0)
00002000:00010000:3.0:1789431569.535242:0:14490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb size from disk: 260096 -> 260096
00002000:00010000:3.0:1789431569.535246:0:14490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb mtime from disk: 1789431490 -> 1789431556
00002000:00010000:3.0:1789431569.535248:0:14490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb atime from disk: 1789431558 -> 1789431548
00002000:00010000:3.0:1789431569.535251:0:14490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb ctime from disk: 1789431568 -> 1789431569
00002000:00010000:3.0:1789431569.535253:0:14490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb blocks from disk: 515 -> 515
00000100:00100000:3.0:1789431569.535784:0:14490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2347:x1876351933613952:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 759us (1012us total) trans 4294970074 rc 0/0
00000100:00100000:3.0:1789431569.535794:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8416
00010000:00010000:1.0:1789431569.536737:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528059 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.536752:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528059 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.536769:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90cf13195600)
00010000:00010000:1.0:1789431569.536772:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.536777:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528059 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.536784:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528059 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.554131:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.554224:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933614208
00000100:00100000:1.0:1789431569.554247:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933614208
00000100:00100000:1.0:1789431569.554308:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12558
00000100:00100000:1.0:1789431569.554319:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf077d3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14616:x1876351933614208:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431569.554716:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf077d3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+237:14616:x1876351933614208:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 398us (593us total) trans 4295121175 rc 0/0
00000100:00100000:1.0:1789431569.554725:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12558
00000100:00100000:2.0:1789431569.561083:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.561321:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933614336
00000100:00100000:1.0:1789431569.561331:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933614336
00000100:00100000:1.0:1789431569.561405:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8417
00000100:00100000:1.0:1789431569.561415:0:14500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2347:x1876351933614336:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.561432:0:14500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.561453:0:14500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb6352806e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x51b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9479 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789431569.561484:0:14500:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x51b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:1.0:1789431569.561504:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51b:0x0].0x0 since=3027s v=(0 0)
00010000:00010000:1.0:1789431569.561508:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431569.561517:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb6352806e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9479 expref: 72 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.561535:0:14500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb6352806e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9479 expref: 72 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.561548:0:14500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309200, rc 0)
00000100:00100000:1.0:1789431569.562006:0:14500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2347:x1876351933614336:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 591us (931us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.562014:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8417
00000100:00100000:0.0:1789431569.564019:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.564271:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933614464
00000100:00100000:1.0:1789431569.564292:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933614464
00000100:00100000:1.0:1789431569.564355:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296346
00000100:00100000:1.0:1789431569.564367:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+237:14616:x1876351933614464:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.564394:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.564417:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63528075 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9480 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564479:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352807c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564497:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352807c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564507:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352807c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564520:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528083 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564527:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564534:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564776:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352808a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564786:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352808a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564793:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352808a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431569.564826:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10095:0x0]: returning size 260096
00000004:00200000:1.0:1789431569.564830:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431569.564849:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352808a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564861:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352808a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564873:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352807c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564879:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352807c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564886:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352807c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564892:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.564896:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352807c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564904:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352807c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564914:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431569.564917:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.564921:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352807c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564927:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352807c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564940:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564946:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528083 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564952:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528083 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564958:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.564961:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528083 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564967:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528083 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564975:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x469e1765 (ffff90ce03149b00)
00010000:00010000:1.0:1789431569.564977:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.564980:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528083 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.564986:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528083 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.565014:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309e00/0xd8e438fb63528075 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9480 expref: 239 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.565028:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352808a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9480 expref: 238 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.565036:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:1.0:1789431569.565038:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431569.565040:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308200, rc 0)
00000100:00100000:1.0:1789431569.565254:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+238:14616:x1876351933614464:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 889us (1241us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.565261:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296346
00000100:00100000:0.0:1789431569.576641:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.576695:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.576772:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933614592
00000100:00100000:1.0:1789431569.576783:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933614592
00000100:00100000:1.0:1789431569.576842:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8418
00000100:00100000:1.0:1789431569.576853:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:14617:x1876351933614592:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.576870:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.576888:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f94645f/0xd8e438fb63528091 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x51b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9487 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.576919:0:14468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb6352806e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x51b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9479 expref: 73 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.576927:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431569.576931:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431569.576936:0:14468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f94645f/0xd8e438fb63528091 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x51b:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9487 expref: 73 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.576967:0:14468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb6352806e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9479 expref: 73 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.576980:0:14468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb6352806e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x51b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9479 expref: 73 pid: 14500 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.576993:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14468:1876351894257152:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431569.577102:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3f00 going to sleep for 11 seconds
00000100:00100000:2.0:1789431569.578344:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933614848
00000100:00100000:2.0:1789431569.578354:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933614848
00000100:00100000:2.0:1789431569.578409:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296347
00000100:00100000:2.0:1789431569.578418:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+238:14616:x1876351933614848:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431569.578435:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431569.578455:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63528098 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c948e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.578565:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352809f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.578580:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352808a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9480 expref: 239 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.578590:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352809f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.578619:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352808a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9480 expref: 239 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.578631:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352808a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9480 expref: 239 pid: 12181 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.578643:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce17f3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894257280:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431569.578726:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3e6cb780 going to sleep for 11 seconds
00000100:00100000:2.0:1789431569.583295:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14468:1876351894257152:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431569.583331:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006f94645f/0xd8e438fb63528091 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x51b:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9487 expref: 73 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.583352:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309e00, rc 0)
00000100:00100000:2.0:1789431569.583413:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:14617:x1876351933614592:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6561us (6780us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431569.583422:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8418
00000100:00100000:3.0:1789431569.583909:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894257280:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431569.583931:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352809f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.587542:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.587681:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933614976
00000100:00100000:3.0:1789431569.587707:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933614976
00010000:00010000:3.0:1789431569.587748:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb6352806e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x51b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9479 expref: 73 pid: 14500 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.587793:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16718
00000100:00100000:3.0:1789431569.587803:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2347:x1876351933614976:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431569.587820:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431569.587844:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb6352806e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x51b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9479 expref: 73 pid: 14500 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.587858:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb6352806e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9479 expref: 73 pid: 14500 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.587882:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb6352806e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x51b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9479 expref: 73 pid: 14500 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.587898:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431569.587902:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431569.587910:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006f94645f/0xd8e438fb63528091 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9487 expref: 72 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.587921:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f94645f/0xd8e438fb63528091 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x51b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9487 expref: 72 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.587958:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006f94645f/0xd8e438fb63528091 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x51b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9487 expref: 72 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.587972:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac77100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5834:1876351894257408:192.168.203.4@tcp:105:
00000100:00100000:3.0:1789431569.588100:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf055960c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431569.593761:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac77100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5834:1876351894257408:192.168.203.4@tcp:105:
00010000:00010000:3.0:1789431569.593789:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431569.593845:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2347:x1876351933614976:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 6042us (6312us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431569.593855:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16718
00000100:00100000:0.0:1789431569.602432:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.602533:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933615104
00000100:00100000:2.0:1789431569.602544:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933615104
00010000:00010000:2.0:1789431569.602599:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352808a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9480 expref: 240 pid: 12181 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.602641:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16719
00000100:00100000:2.0:1789431569.602651:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+240:2347:x1876351933615104:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431569.602667:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431569.602675:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352808a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9480 expref: 240 pid: 12181 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.602697:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352808a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9480 expref: 240 pid: 12181 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.602728:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352808a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9480 expref: 240 pid: 12181 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.602744:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:2.0:1789431569.602750:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352809f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.602759:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352809f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.602767:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352809f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.602805:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431569.602864:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+239:2347:x1876351933615104:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 214us (443us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431569.602872:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16719
00010000:00010000:0.0:1789431569.603653:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352809f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.603665:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352809f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431569.603694:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10095:0x0]: returning size 260096
00010000:00010000:0.0:1789431569.603845:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63528098 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c948e expref: 240 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.603864:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352809f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c948e expref: 239 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.603877:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:0.0:1789431569.603880:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431569.603882:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523600, rc 0)
00000100:00100000:0.0:1789431569.603933:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+239:14616:x1876351933614848:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 25516us (27247us total) trans 4295121176 rc 0/0
00000100:00100000:0.0:1789431569.603941:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296347
00000100:00100000:0.0:1789431569.614008:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.614109:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933615232
00000100:00100000:1.0:1789431569.614120:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933615232
00000100:00100000:1.0:1789431569.614176:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296348
00000100:00100000:1.0:1789431569.614186:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+239:14616:x1876351933615232:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.614210:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.614238:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635280ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9495 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.614314:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635280b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.614330:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352809f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c948e expref: 240 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.614339:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635280b4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.614369:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352809f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c948e expref: 240 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.614381:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352809f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c948e expref: 240 pid: 5847 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.614393:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894257536:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431569.614472:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3540 going to sleep for 11 seconds
00000100:00100000:1.0:1789431569.617249:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894257536:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431569.617278:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635280b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.622587:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.623040:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933615360
00000100:00100000:2.0:1789431569.623087:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933615360
00010000:00010000:2.0:1789431569.623129:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352809f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c948e expref: 241 pid: 5847 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.623176:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16720
00000100:00100000:2.0:1789431569.623186:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+241:2348:x1876351933615360:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431569.623202:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431569.623210:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352809f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c948e expref: 241 pid: 5847 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.623233:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352809f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c948e expref: 241 pid: 5847 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.623256:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352809f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10095:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c948e expref: 241 pid: 5847 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.623274:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:2.0:1789431569.623279:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635280b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.623289:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635280b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.623297:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635280b4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.623386:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431569.623442:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+240:2348:x1876351933615360:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 257us (864us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431569.623449:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16720
00000100:00100000:2.0:1789431569.628859:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.628923:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933615616
00000100:00100000:0.0:1789431569.628934:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933615616
00000100:00100000:0.0:1789431569.628996:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12559
00000100:00100000:0.0:1789431569.629007:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+240:14617:x1876351933615616:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431569.629378:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+241:14617:x1876351933615616:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 372us (528us total) trans 4295121177 rc 0/0
00000100:00100000:0.0:1789431569.629386:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12559
00010000:00010000:1.0:1789431569.631672:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635280b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.631704:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635280b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431569.631748:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10095:0x0]: returning size 260096
00000004:00200000:1.0:1789431569.631752:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431569.631772:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635280b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.631811:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635280ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10095:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9495 expref: 241 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.631832:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309000/0xd8e438fb635280b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10095:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9495 expref: 240 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.631842:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10095:0x0].0x0 (ffff90ce2d731700)
00010000:00010000:1.0:1789431569.631845:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431569.631849:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309000, rc 0)
00000100:00100000:1.0:1789431569.631912:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+240:14616:x1876351933615232:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 17727us (17911us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.631920:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296348
00000100:00100000:2.0:1789431569.645598:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.645936:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933615872
00000100:00100000:0.0:1789431569.645947:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933615872
00000100:00100000:0.0:1789431569.646009:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296349
00000100:00100000:0.0:1789431569.646018:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+240:14617:x1876351933615872:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431569.646040:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431569.646163:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635280bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c949c expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.646517:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635280c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.646535:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528060 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9472 expref: 241 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.646545:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635280c2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.646579:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9472 expref: 241 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.646592:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528060 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9472 expref: 241 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.646618:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e828700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894257664:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431569.646815:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba39900 going to sleep for 11 seconds
00000100:00100000:0.0:1789431569.651366:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.651823:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933616000
00000100:00100000:3.0:1789431569.651833:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933616000
00010000:00010000:3.0:1789431569.651871:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528060 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9472 expref: 242 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.651912:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16721
00000100:00100000:3.0:1789431569.651922:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+242:2348:x1876351933616000:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431569.651935:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431569.651942:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528060 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9472 expref: 242 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.651960:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528060 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9472 expref: 242 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.651982:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90cf13195700)
00010000:00010000:3.0:1789431569.651987:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635280c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.651997:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635280c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.652003:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635280c2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.652023:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431569.652100:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+242:2348:x1876351933616000:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 179us (743us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431569.652107:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16721
00010000:00010000:1.0:1789431569.655864:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528060 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9472 expref: 241 pid: 5849 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.655893:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e828700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894257664:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431569.655917:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635280c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.655933:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635280c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.655940:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635280c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431569.655962:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00010000:00010000:1.0:1789431569.656158:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635280bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c949c expref: 242 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.656175:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635280c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c949c expref: 241 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.656185:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90cf13195700)
00010000:00010000:1.0:1789431569.656188:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431569.656192:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2000, rc 0)
00000100:00100000:1.0:1789431569.656383:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+241:14617:x1876351933615872:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10365us (10793us total) trans 4295121178 rc 0/0
00000100:00100000:1.0:1789431569.656392:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296349
00000100:00100000:3.0:1789431569.661007:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.661220:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933616128
00000100:00100000:1.0:1789431569.661229:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933616128
00000100:00100000:1.0:1789431569.661276:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296350
00000100:00100000:1.0:1789431569.661286:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+241:14616:x1876351933616128:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.661305:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.661326:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635280d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c94a3 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661396:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635280d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661411:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635280d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661422:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635280d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661435:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635280de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661443:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635280de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661449:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635280de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661498:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635280d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661505:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635280d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661513:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635280d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661519:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.661523:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635280d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661535:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635280d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661546:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431569.661549:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.661553:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635280d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661559:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635280d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661571:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635280de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661577:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635280de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661583:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635280de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661588:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.661590:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635280de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661596:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635280de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661614:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce03149b00)
00010000:00010000:1.0:1789431569.661617:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.661620:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635280de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661626:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635280de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661653:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635280d0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94a3 expref: 242 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661663:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431569.661666:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.661669:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635280d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94a3 expref: 242 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.661678:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:1.0:1789431569.661933:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+241:14616:x1876351933616128:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 648us (937us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431569.661940:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296350
00000100:00100000:3.0:1789431569.667915:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.668023:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.677457:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.677487:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.677508:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933616512
00000100:00100000:3.0:1789431569.677517:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933616512
00000100:00100000:3.0:1789431569.677560:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933616768
00000100:00100000:3.0:1789431569.677563:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933616768
00000100:00100000:3.0:1789431569.677591:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296351
00000100:00100000:3.0:1789431569.678565:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+242:14617:x1876351933616512:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431569.678596:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431569.678620:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635280e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c94aa expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.678722:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635280ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.678737:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635280c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c949c expref: 243 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.678745:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635280ec lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.678779:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635280c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c949c expref: 243 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.678794:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635280c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c949c expref: 243 pid: 6797 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.678808:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac74380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894257792:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431569.678885:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf055960c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431569.678912:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296352
00000100:00100000:3.0:1789431569.678922:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+243:14616:x1876351933616768:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431569.678932:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431569.678934:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431569.678953:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63527d9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c93a0 expref: 243 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.678973:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431569.678978:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431569.678986:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635280f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c94b1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.679092:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635280fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.679104:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635280fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.679113:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635280fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.679127:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528101 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.679134:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.679139:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.685507:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933616256
00000100:00100000:1.0:1789431569.685520:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933616256
00002000:00100000:1.0:1789431569.685604:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x28:0x0] (0->4095)  req@ffff90ce1ac74700 x1876351933616256/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:40/0 lens 4584/0 e 0 to 0 dl 1789431580 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431569.685617:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce1ac74700 with x1876351933616256 ext(0->4095)
00002000:00010000:1.0:1789431569.685622:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce1ac74700
00000100:00100000:1.0:1789431569.685649:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933616384
00000100:00100000:1.0:1789431569.685652:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933616384
00002000:00100000:1.0:1789431569.685667:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2a:0x0] (0->4095)  req@ffff90ce1ac75f80 x1876351933616384/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:40/0 lens 4584/0 e 0 to 0 dl 1789431580 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431569.685676:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce1ac75f80 with x1876351933616384 ext(0->4095)
00002000:00010000:1.0:1789431569.685680:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce1ac75f80
00000100:00100000:0.0:1789431569.685802:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1577
00000100:00100000:0.0:1789431569.685815:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2349:x1876351933616256:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:1.0:1789431569.686329:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1578
00000100:00100000:1.0:1789431569.686340:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2350:x1876351933616384:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:1.0:1789431569.686543:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2350:x1876351933616384:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 204us (18519us total) trans 4294969680 rc 0/0
00000100:00100000:1.0:1789431569.686552:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1578
00002000:00100000:1.0:1789431569.686560:0:14435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2a:0x0] (0->4095)  req@ffff90ce1ac75f80 x1876351933616384/t4294969680(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:40/0 lens 4584/448 e 0 to 0 dl 1789431580 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431569.686569:0:14435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce1ac75f80 with x1876351933616384 ext(0->4095)
00002000:00010000:1.0:1789431569.686574:0:14435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce1ac75f80
00000100:00100000:0.0:1789431569.687097:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2349:x1876351933616256:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 402us (18307us total) trans 4294969679 rc 0/0
00000100:00100000:0.0:1789431569.687108:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1577
00002000:00100000:0.0:1789431569.687116:0:14461:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x28:0x0] (0->4095)  req@ffff90ce1ac74700 x1876351933616256/t4294969679(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:40/0 lens 4584/448 e 0 to 0 dl 1789431580 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431569.687125:0:14461:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce1ac74700 with x1876351933616256 ext(0->4095)
00002000:00010000:0.0:1789431569.687129:0:14461:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce1ac74700
00000100:00100000:2.0:1789431569.689487:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac74380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894257792:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431569.689516:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635280ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:3.0:1789431569.690451:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x51c:0x0], index 0: 0
00010000:00010000:3.0:1789431569.691710:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528108 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.691730:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.691748:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.691787:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635280fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.691794:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635280fa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.691801:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635280fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.691807:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431569.691812:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635280fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.691818:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635280fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.691829:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431569.691832:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431569.691836:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635280fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.691842:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635280fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431569.691856:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c31b0f05 reply state 00000000aa514de1 transno 4295121179 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.691864:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431569.691898:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635280f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94b1 expref: 245 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.691912:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528108 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94b1 expref: 244 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.691919:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab4:0x0].0x0 (ffff90cf18b78200)
00010000:00010000:3.0:1789431569.691921:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431569.691924:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b000, rc 0)
00000100:00100000:3.0:1789431569.692002:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14616:x1876351933616768:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 13082us (14513us total) trans 4295121179 rc 0/0
00000100:00100000:3.0:1789431569.692010:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296352
00000100:00100000:3.0:1789431569.694100:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.694175:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933616896
00000100:00100000:1.0:1789431569.694184:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933616896
00010000:00010000:1.0:1789431569.694234:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635280c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c949c expref: 245 pid: 6797 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.694266:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16722
00000100:00100000:1.0:1789431569.694277:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:2347:x1876351933616896:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431569.694301:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431569.694308:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635280c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c949c expref: 245 pid: 6797 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.694321:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635280c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c949c expref: 245 pid: 6797 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.694341:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635280c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c949c expref: 245 pid: 6797 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.694362:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90cf13195700)
00010000:00010000:1.0:1789431569.694368:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635280ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.694377:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635280ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.694385:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635280ec lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.694415:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431569.694461:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:2347:x1876351933616896:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 186us (370us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.694468:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16722
00010000:00010000:3.0:1789431569.695045:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635280ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.695077:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635280ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431569.695119:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00000004:00200000:3.0:1789431569.695124:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431569.695143:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635280ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.695173:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635280e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94aa expref: 244 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.695188:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635280ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94aa expref: 243 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.695199:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90cf13195700)
00010000:00010000:3.0:1789431569.695202:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431569.695205:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a400, rc 0)
00000100:00100000:3.0:1789431569.695260:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+243:14617:x1876351933616512:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 17661us (17815us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431569.695267:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296351
00010000:00010000:3.0:1789431569.695530:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.695538:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528101 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.695546:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528101 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.695552:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431569.695556:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528101 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.695564:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528101 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.695576:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90cf18b78100)
00010000:00010000:3.0:1789431569.695579:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431569.695583:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528101 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.695589:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528101 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.703485:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.703559:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933617024
00000100:00100000:3.0:1789431569.703569:0:14491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933617024
00000100:00100000:3.0:1789431569.703626:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8419
00000100:00100000:3.0:1789431569.703637:0:14491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2348:x1876351933617024:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431569.703656:0:14491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431569.703676:0:14491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63528116 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x51c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c94b8 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431569.703712:0:14491:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x51c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431569.703731:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51c:0x0].0x0 since=3027s v=(0 0)
00010000:00010000:3.0:1789431569.703736:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431569.703745:0:14491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63528116 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94b8 expref: 74 pid: 14491 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.703763:0:14491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63528116 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94b8 expref: 74 pid: 14491 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.703775:0:14491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7aa00, rc 0)
00000100:00100000:3.0:1789431569.703834:0:14491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2348:x1876351933617024:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 198us (358us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431569.703841:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8419
00000100:00100000:1.0:1789431569.711620:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.711736:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933617280
00000100:00100000:0.0:1789431569.711747:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933617280
00000100:00100000:0.0:1789431569.711804:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12560
00000100:00100000:0.0:1789431569.711815:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+242:14616:x1876351933617280:12345-192.168.203.4@tcp:35:dbench.0
00010000:00010000:1.0:1789431569.712392:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431569.712521:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+243:14616:x1876351933617280:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 706us (909us total) trans 4295121180 rc 0/0
00000100:00100000:2.0:1789431569.712531:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12560
00000100:00100000:2.0:1789431569.726634:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.726880:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933617536
00000100:00100000:0.0:1789431569.726890:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933617536
00000100:00100000:0.0:1789431569.726948:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12561
00000100:00100000:0.0:1789431569.726961:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+243:14616:x1876351933617536:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431569.727720:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14616:x1876351933617536:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 259us (592us total) trans 4295121181 rc 0/0
00000100:00100000:0.0:1789431569.727730:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12561
00000100:00100000:1.0:1789431569.730957:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.731082:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933617664
00000100:00100000:2.0:1789431569.731091:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933617664
00002000:00100000:2.0:1789431569.731139:0:14440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x51b:0x0] (0->74401)  req@ffff90ce2a7eb480 x1876351933617664/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:40/0 lens 488/0 e 0 to 0 dl 1789431580 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431569.731149:0:14440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce2a7eb480 with x1876351933617664 ext(0->74401)
00002000:00010000:2.0:1789431569.731154:0:14440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce2a7eb480
00000100:00100000:2.0:1789431569.731184:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1579
00000100:00100000:2.0:1789431569.731193:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2347:x1876351933617664:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:3.0:1789431569.749736:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2347:x1876351933617664:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 18533us (18778us total) trans 4294970075 rc 0/0
00000100:00100000:3.0:1789431569.749750:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1579
00002000:00100000:3.0:1789431569.749765:0:14440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x51b:0x0] (0->74401)  req@ffff90ce2a7eb480 x1876351933617664/t4294970075(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:40/0 lens 488/448 e 0 to 0 dl 1789431580 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431569.749777:0:14440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce2a7eb480 with x1876351933617664 ext(0->74401)
00002000:00010000:3.0:1789431569.749783:0:14440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce2a7eb480
00000100:00100000:1.0:1789431569.764894:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.764992:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933617920
00000100:00100000:0.0:1789431569.765003:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933617920
00000100:00100000:0.0:1789431569.765097:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296353
00000100:00100000:0.0:1789431569.765107:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14616:x1876351933617920:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431569.765161:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431569.765188:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528108 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94b1 expref: 244 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.765207:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab4:0x0].0x0 (ffff90cf18b78200)
00010000:00010000:0.0:1789431569.765229:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431569.765249:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352811d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.765263:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352811d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.765272:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352811d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.765285:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528124 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.765292:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.765298:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.765400:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352812b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10ab4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.765408:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352812b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.765415:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352812b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:0.0:1789431569.765942:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1251, 64 off88256
00000004:00080000:0.0:1789431569.765950:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3027796901234ns, next at 3028796899183ns, rc = 0
00010000:00010000:0.0:1789431569.766009:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528132 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766019:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528132 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766028:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528132 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766035:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528132 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10ab4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766089:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528132 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10ab4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766096:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528132 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766122:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431569.766141:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352812b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766148:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352812b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10ab4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766154:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352812b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766159:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431569.766164:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352812b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766171:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352812b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10ab4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766179:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab4:0x0].0x0 (ffff90ce07190f00)
00010000:00010000:0.0:1789431569.766182:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431569.766187:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352812b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10ab4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766194:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352812b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10ab4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766213:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352811d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766220:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352811d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766226:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352811d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766231:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431569.766233:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352811d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766240:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352811d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766247:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431569.766249:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431569.766252:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352811d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.766258:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352811d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431569.766267:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000001fe36b reply state 000000001c158ae4 transno 4295121182 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.766276:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431569.766350:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14616:x1876351933617920:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1241us (1462us total) trans 4295121182 rc 0/0
00000100:00100000:0.0:1789431569.766361:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296353
00010000:00010000:3.0:1789431569.766633:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431569.766640:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528132 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.766647:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431569.766651:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528132 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.766665:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528132 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.766675:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab4:0x0].0x0 (ffff90ce07190f00)
00010000:00010000:3.0:1789431569.766677:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431569.766688:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528132 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10ab4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.766701:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528132 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.766717:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431569.766719:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431569.766721:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431569.770573:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.770591:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528124 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.770600:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528124 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.770606:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431569.770611:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528124 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.770618:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528124 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.770635:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce07190900)
00010000:00010000:0.0:1789431569.770638:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431569.770642:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528124 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.770649:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528124 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.777852:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.778799:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933618048
00000100:00100000:0.0:1789431569.778810:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933618048
00000100:00100000:0.0:1789431569.778912:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296354
00000100:00100000:0.0:1789431569.778923:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14617:x1876351933618048:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:3.0:1789431569.788129:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.788161:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933618176
00000100:00100000:3.0:1789431569.788172:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933618176
00000100:00100000:3.0:1789431569.788226:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296355
00000100:00100000:3.0:1789431569.788236:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14616:x1876351933618176:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431569.788256:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431569.788281:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528139 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c94bf expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788349:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528140 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788365:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528140 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788376:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528140 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788390:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528147 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788397:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788403:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788610:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528140 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788618:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528140 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788626:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528140 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788631:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7be00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431569.788636:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528140 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788643:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528140 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788655:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431569.788658:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431569.788842:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528140 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788851:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528140 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788863:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788869:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528147 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788874:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528147 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788879:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431569.788881:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528147 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788887:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528147 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788896:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90cf18b78100)
00010000:00010000:3.0:1789431569.788898:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431569.788902:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528147 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788908:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528147 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788941:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528139 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94bf expref: 246 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788951:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431569.788965:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431569.788970:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528139 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94bf expref: 246 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.788979:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7ba00, rc 0)
00000100:00100000:3.0:1789431569.789043:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14616:x1876351933618176:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 809us (928us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431569.789084:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296355
00000100:00100000:1.0:1789431569.797741:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.798186:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933618304
00000100:00100000:0.0:1789431569.798197:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933618304
00000100:00100000:0.0:1789431569.798253:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296356
00000100:00100000:0.0:1789431569.798263:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14616:x1876351933618304:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431569.798282:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431569.798302:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352814e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c94c6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.798362:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528155 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.798376:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.798387:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431569.798431:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008d:0x0]: returning size 16384
00000004:00200000:0.0:1789431569.798434:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431569.798452:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.798474:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352814e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94c6 expref: 247 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.798489:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528155 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94c6 expref: 246 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.798497:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431569.798500:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431569.798503:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3c00, rc 0)
00000100:00100000:0.0:1789431569.798553:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+246:14616:x1876351933618304:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 292us (821us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431569.798559:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296356
00000100:00100000:2.0:1789431569.817224:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.817313:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933618432
00000100:00100000:1.0:1789431569.817324:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933618432
00000100:00100000:1.0:1789431569.817380:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12562
00000100:00100000:1.0:1789431569.817390:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+246:14616:x1876351933618432:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431569.822678:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+246:14616:x1876351933618432:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 5271us (5454us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431569.822710:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12562
00000100:00100000:1.0:1789431569.832446:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.833795:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933618688
00000100:00100000:3.0:1789431569.833808:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933618688
00000100:00100000:3.0:1789431569.833874:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296357
00000100:00100000:3.0:1789431569.833885:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+246:14616:x1876351933618688:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431569.833905:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431569.833926:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352815c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c94cd expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834009:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528163 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834029:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528163 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834042:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528163 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834092:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352816a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834100:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352816a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834107:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352816a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834503:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528163 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834512:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528163 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834519:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528163 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834524:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431569.834528:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528163 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834536:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528163 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834552:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431569.834555:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431569.834560:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528163 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834567:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528163 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834579:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352816a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834585:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352816a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834591:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352816a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834597:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7be00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431569.834599:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352816a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834605:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352816a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834612:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90cf18b78100)
00010000:00010000:3.0:1789431569.834615:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431569.834618:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352816a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834624:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352816a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834659:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352815c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94cd expref: 247 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834670:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431569.834672:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:3.0:1789431569.834676:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352815c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94cd expref: 247 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.834696:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7ba00, rc 0)
00000100:00100000:3.0:1789431569.835128:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+246:14616:x1876351933618688:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1243us (2689us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431569.835137:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296357
00000100:00100000:3.0:1789431569.850758:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.851233:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933618944
00000100:00100000:0.0:1789431569.851244:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933618944
00000100:00100000:0.0:1789431569.851301:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296358
00000100:00100000:0.0:1789431569.851312:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+246:14616:x1876351933618944:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431569.851332:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431569.851336:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431569.851363:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528155 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94c6 expref: 246 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.851383:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431569.851388:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431569.851401:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528171 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c94d4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.851659:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528178 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.851676:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528178 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.851696:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528178 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.851712:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb6352817f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.851720:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb6352817f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.851727:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb6352817f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431569.853388:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x51c:0x0], index 1: 0
00010000:00010000:1.0:1789431569.859895:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528186 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.859918:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.859931:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.859984:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528178 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.859992:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528178 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.860000:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528178 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.860007:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431569.860011:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528178 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.860019:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528178 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.860031:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431569.860034:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431569.860039:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528178 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.860068:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528178 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431569.860082:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f6a55f1e reply state 00000000c63dadf3 transno 4295121183 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb6352817f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.860091:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431569.860127:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528171 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94d4 expref: 248 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.860142:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94d4 expref: 247 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.860150:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90ce03149b00)
00010000:00010000:1.0:1789431569.860152:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431569.860155:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309c00, rc 0)
00000100:00100000:1.0:1789431569.860226:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+248:14616:x1876351933618944:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8915us (9477us total) trans 4295121183 rc 0/0
00000100:00100000:1.0:1789431569.860235:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296358
00000100:00100000:1.0:1789431569.870573:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431569.870580:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb6352817f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.870594:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb6352817f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.870612:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb6352817f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.870619:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431569.870624:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb6352817f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.870632:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb6352817f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.870646:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce07190e00)
00010000:00010000:0.0:1789431569.870649:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431569.870654:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb6352817f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.870708:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933619072
00000100:00100000:3.0:1789431569.870718:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933619072
00000100:00100000:3.0:1789431569.870767:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8420
00000100:00100000:3.0:1789431569.870777:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2347:x1876351933619072:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431569.870793:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431569.870812:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2b5b7cd/0xd8e438fb63528194 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x51c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c94db expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431569.870838:0:14497:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x51c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431569.870857:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51c:0x0].0x0 since=3027s v=(0 0)
00010000:00010000:3.0:1789431569.870861:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431569.870870:0:14497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b5b7cd/0xd8e438fb63528194 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94db expref: 75 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.870903:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d2b5b7cd/0xd8e438fb63528194 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94db expref: 75 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.870914:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a200, rc 0)
00000100:00100000:3.0:1789431569.870964:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+75:2347:x1876351933619072:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 188us (415us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431569.870970:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8420
00010000:00010000:0.0:1789431569.871024:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb6352817f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.879313:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.879579:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933619200
00000100:00100000:1.0:1789431569.879591:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933619200
00000100:00100000:1.0:1789431569.879653:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8421
00000100:00100000:1.0:1789431569.879664:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+75:14616:x1876351933619200:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.879695:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.879715:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb6352819b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x51c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c94e2 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.879758:0:14469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2b5b7cd/0xd8e438fb63528194 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x51c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94db expref: 76 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.879768:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431569.879773:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431569.879780:0:14469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb6352819b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x51c:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94e2 expref: 76 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.879816:0:14469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2b5b7cd/0xd8e438fb63528194 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94db expref: 76 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.879830:0:14469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2b5b7cd/0xd8e438fb63528194 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x51c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94db expref: 76 pid: 14497 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.879846:0:14469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14469:1876351894257920:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431569.879938:0:14469:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3240 going to sleep for 11 seconds
00000001:00080000:2.0:1789431569.884253:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121182 is committed
00000004:00080000:2.0:1789431569.884265:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 373 committed
00000004:00080000:2.0:1789431569.884349:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 372 committed
00000004:00080000:2.0:1789431569.884374:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 370 committed
00000100:00100000:0.0:1789431569.884624:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14617:x1876351933618048:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 105696us (106775us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431569.884635:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296354
00000100:00100000:3.0:1789431569.884730:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894258432:0@lo:6:osp-syn-0-0.0
00000100:00100000:0.0:1789431569.884771:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894258048:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431569.884788:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431569.884878:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431569.885038:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894258560:0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431569.885089:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431569.886348:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894258176:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431569.886384:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431569.888617:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894258432
00000100:00100000:2.0:1789431569.888631:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894258432
00000100:00100000:2.0:1789431569.889110:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894258048
00000100:00100000:2.0:1789431569.889114:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894258048
00000100:00100000:2.0:1789431569.889129:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894258560
00000100:00100000:2.0:1789431569.889131:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894258560
00000100:00100000:2.0:1789431569.889151:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8422
00000100:00100000:2.0:1789431569.889160:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3313:x1876351894258432:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:2.0:1789431569.889186:0:14471:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1308 count 1
00010000:00010000:2.0:1789431569.889208:0:14471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb635281a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x51c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.889229:0:14471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63528116 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x51c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94b8 expref: 73 pid: 14491 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.889237:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431569.889241:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431569.889246:0:14471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb635281a2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x51c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.889278:0:14471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63528116 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94b8 expref: 73 pid: 14491 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.889290:0:14471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63528116 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x51c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94b8 expref: 73 pid: 14491 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.889304:0:14471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce17f3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14471:1876351894258816:192.168.203.4@tcp:104:
00000100:00080000:0.0:1789431569.897211:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1789431569.897221:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1789431569.897249:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8423
00000100:00100000:0.0:1789431569.897272:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1876351894258048:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:0.0:1789431569.897306:0:8217:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1304 count 1
00010000:00010000:0.0:1789431569.897331:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae1ae174/0xd8e438fb635281a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.897351:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab95b4b2/0xd8e438fb6352701b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa9 expref: 73 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.897360:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x518:0x0].0x0 since=4s v=(0 0)
00010000:00010000:0.0:1789431569.897364:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x518:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1789431569.897369:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae1ae174/0xd8e438fb635281a9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.897404:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ab95b4b2/0xd8e438fb6352701b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa9 expref: 73 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.897421:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ab95b4b2/0xd8e438fb6352701b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa9 expref: 73 pid: 14490 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.897436:0:8217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8217:1876351894258944:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431569.897508:0:8217:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf048d6e40 going to sleep for 11 seconds
00000100:00100000:2.0:1789431569.900021:0:14471:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e840 going to sleep for 11 seconds
00000100:00100000:2.0:1789431569.900080:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8424
00000100:00100000:2.0:1789431569.900101:0:14499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3314:x1876351894258560:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:2.0:1789431569.900135:0:14499:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1305 count 1
00010000:00010000:2.0:1789431569.900160:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b437823/0xd8e438fb635281b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x519:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.900181:0:14499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000026047ea6/0xd8e438fb63527879 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x519:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9211 expref: 76 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.900190:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x519:0x0].0x0 since=2s v=(0 0)
00010000:00010000:2.0:1789431569.900195:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x519:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431569.900200:0:14499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b437823/0xd8e438fb635281b0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x519:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.900231:0:14499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000026047ea6/0xd8e438fb63527879 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x519:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9211 expref: 76 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.900245:0:14499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000026047ea6/0xd8e438fb63527879 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x519:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9211 expref: 76 pid: 14500 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.900259:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce17f3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:14499:1876351894259072:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431569.900314:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e6c0 going to sleep for 11 seconds
00000100:00100000:2.0:1789431569.901872:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e82a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894258304:0@lo:6:osp-syn-1-0.0
00000100:00100000:0.0:1789431569.910159:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.910190:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933619328
00000100:00100000:0.0:1789431569.910200:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933619328
00010000:00010000:0.0:1789431569.910245:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b5b7cd/0xd8e438fb63528194 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x51c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94db expref: 77 pid: 14497 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.910280:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16723
00000100:00100000:0.0:1789431569.910289:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+77:2348:x1876351933619328:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431569.910304:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431569.910328:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d2b5b7cd/0xd8e438fb63528194 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x51c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94db expref: 77 pid: 14497 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.910343:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2b5b7cd/0xd8e438fb63528194 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x51c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94db expref: 77 pid: 14497 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.910368:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431569.910373:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431569.910381:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb6352819b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x51c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94e2 expref: 77 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.910396:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb6352819b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x51c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94e2 expref: 77 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.910434:0:14498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb6352819b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x51c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94e2 expref: 77 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.910447:0:14498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:14498:1876351894259200:192.168.203.4@tcp:105:
00000100:00100000:0.0:1789431569.910512:0:14498:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf37387c00 going to sleep for 11 seconds
00000100:00100000:3.0:1789431569.911801:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2e828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894258688:0@lo:6:osp-syn-1-0.0
00000100:00100000:3.0:1789431569.911846:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431569.911867:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1789431569.911872:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894259328:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1789431569.911894:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431569.912029:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894258176
00000100:00100000:3.0:1789431569.912041:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894258176
00000100:00100000:3.0:1789431569.912087:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894258688
00000100:00100000:3.0:1789431569.912090:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894258688
00000100:00100000:3.0:1789431569.912109:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8425
00000100:00100000:3.0:1789431569.912117:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1876351894258176:12345-0@lo:6:osp-syn-0-0.0
00002000:00080000:3.0:1789431569.912145:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1307 count 1
00010000:00010000:3.0:1789431569.912169:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb635281b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x51b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.912187:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007d2dcbad/0xd8e438fb63527f8e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x51b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c943a expref: 73 pid: 14464 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.912196:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431569.912200:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431569.912205:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb635281b7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x51b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.912244:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007d2dcbad/0xd8e438fb63527f8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c943a expref: 73 pid: 14464 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.912257:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007d2dcbad/0xd8e438fb63527f8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x51b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c943a expref: 73 pid: 14464 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.912270:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf04828700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1876351894259456:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431569.912303:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf05596d80 going to sleep for 11 seconds
00000100:00100000:3.0:1789431569.912318:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894259328
00000100:00100000:3.0:1789431569.912321:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894259328
00000100:00100000:3.0:1789431569.912344:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136
00000100:00100000:3.0:1789431569.912351:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3311:x1876351894259328:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1789431569.912363:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 18743296 granted 430768128 pending 3407872 free 3835691008 avail 3828350976
00000100:00100000:3.0:1789431569.912401:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3311:x1876351894259328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (507us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431569.912411:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136
00000100:00100000:3.0:1789431569.912443:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8426
00000100:00100000:3.0:1789431569.912450:0:14490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3311:x1876351894258688:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:3.0:1789431569.912465:0:14490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1304 count 1
00010000:00010000:3.0:1789431569.912479:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb635281be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.912491:0:14490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb635271c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9012 expref: 77 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.912499:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x518:0x0].0x0 since=3s v=(0 0)
00010000:00010000:3.0:1789431569.912502:0:14490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x518:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431569.912505:0:14490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb635281be lrc: 4/0,1 mode: --/PW res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.912524:0:14490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb635271c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9012 expref: 77 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.912533:0:14490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb635271c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9012 expref: 77 pid: 14497 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.912544:0:14490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf0482bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14490:1876351894259584:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431569.912565:0:14490:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf05596000 going to sleep for 11 seconds
00000100:00100000:3.0:1789431569.912594:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969669 gen 2
00000004:00080000:3.0:1789431569.912598:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf37e70380, transno 4294969668
00000004:00080000:3.0:1789431569.912607:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf37e71c00, transno 4294969669
00000100:00100000:3.0:1789431569.912619:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894259328:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1789431569.913182:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431569.913271:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.913727:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894258304
00000100:00100000:3.0:1789431569.913733:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894258304
00000100:00100000:3.0:1789431569.913772:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933619456
00000100:00100000:3.0:1789431569.913775:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933619456
00000100:00100000:3.0:1789431569.913796:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8427
00000100:00100000:3.0:1789431569.913804:0:14500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+7:3312:x1876351894258304:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:3.0:1789431569.913824:0:14500:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1302 count 1
00010000:00010000:3.0:1789431569.913843:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635281c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.913859:0:14500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a54d6ca/0xd8e438fb63526b0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e0c expref: 78 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.913868:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x516:0x0].0x0 since=5s v=(0 0)
00010000:00010000:3.0:1789431569.913872:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x516:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431569.913876:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635281c5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.913900:0:14500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a54d6ca/0xd8e438fb63526b0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e0c expref: 78 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.913911:0:14500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a54d6ca/0xd8e438fb63526b0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e0c expref: 78 pid: 14482 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.913924:0:14500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf04828e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:14500:1876351894259712:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431569.913973:0:14500:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf05596780 going to sleep for 11 seconds
00000100:00100000:3.0:1789431569.913990:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8428
00000100:00100000:3.0:1789431569.913998:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+78:2348:x1876351933619456:12345-192.168.203.4@tcp:16:dbench.0
00010000:00010000:2.0:1789431569.917114:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2b5b7cd/0xd8e438fb63528194 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x51c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94db expref: 78 pid: 14497 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.917141:0:14469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14469:1876351894257920:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431569.917173:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000abbb6ec7/0xd8e438fb6352819b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x51c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94e2 expref: 77 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.917189:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309200, rc 0)
00000100:00100000:2.0:1789431569.917252:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+77:14616:x1876351933619200:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 37589us (37949us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431569.917262:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8421
00000100:00100000:2.0:1789431569.929930:0:14471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14471:1876351894258816:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431569.929945:0:14498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:14498:1876351894259200:192.168.203.4@tcp:105:
00010000:00010000:2.0:1789431569.929966:0:14471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb635281a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x51c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.929997:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:14499:1876351894259072:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431569.930011:0:14499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b437823/0xd8e438fb635281b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x519:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431569.930042:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431569.930122:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+76:2348:x1876351933619328:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 19832us (19971us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431569.930134:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16723
00000100:00100000:0.0:1789431569.930819:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431569.930844:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.930870:0:14490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf0482bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:14490:1876351894259584:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431569.930886:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431569.930891:0:14490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb635281be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431569.930916:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.934550:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933619968
00000100:00100000:2.0:1789431569.934567:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933619968
00010000:00010000:2.0:1789431569.934613:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007d2dcbad/0xd8e438fb63527f8e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x51b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c943a expref: 74 pid: 14464 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.934843:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933620096
00000100:00100000:2.0:1789431569.934849:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933620096
00010000:00010000:2.0:1789431569.934865:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb635271c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9012 expref: 76 pid: 14497 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.936186:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933619712
00000100:00100000:1.0:1789431569.936197:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933619712
00010000:00010000:1.0:1789431569.936234:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ab95b4b2/0xd8e438fb6352701b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa9 expref: 75 pid: 14490 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.938809:0:8217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8217:1876351894258944:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431569.938840:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ae1ae174/0xd8e438fb635281a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.938887:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf04828700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1876351894259456:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431569.938901:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb635281b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x51b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.939027:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933620224
00000100:00100000:3.0:1789431569.939034:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933620224
00010000:00010000:3.0:1789431569.939086:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a54d6ca/0xd8e438fb63526b0c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e0c expref: 77 pid: 14482 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.939118:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16724
00000100:00100000:3.0:1789431569.939191:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb5b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+75:2349:x1876351933619968:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431569.939207:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431569.939213:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007d2dcbad/0xd8e438fb63527f8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x51b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c943a expref: 75 pid: 14464 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.939225:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007d2dcbad/0xd8e438fb63527f8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c943a expref: 75 pid: 14464 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.939253:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d2dcbad/0xd8e438fb63527f8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x51b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c943a expref: 75 pid: 14464 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.939269:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431569.939274:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51b:0x0].0x0 since=0s v=(0 0)
00000100:00100000:2.0:1789431569.939280:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16725
00010000:00010000:3.0:1789431569.939282:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb635281b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x51b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.939296:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+77:2349:x1876351933620096:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431569.939296:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb635281b7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x51b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.939310:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431569.939317:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb635271c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x518:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9012 expref: 77 pid: 14497 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.939326:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431569.939329:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb635271c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x518:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9012 expref: 77 pid: 14497 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.939346:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb635271c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x518:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9012 expref: 77 pid: 14497 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.939357:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x518:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431569.939361:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x518:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1789431569.939365:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb635281be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.939373:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb635281be lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.939379:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb5b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2349:x1876351933619968:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 190us (8560us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431569.939390:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16724
00000100:00100000:3.0:1789431569.939437:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16726
00000100:00100000:3.0:1789431569.939444:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2348:x1876351933619712:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431569.939451:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431569.939456:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ab95b4b2/0xd8e438fb6352701b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x518:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa9 expref: 73 pid: 14490 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.939466:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ab95b4b2/0xd8e438fb6352701b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x518:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa9 expref: 73 pid: 14490 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.939484:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab95b4b2/0xd8e438fb6352701b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x518:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8fa9 expref: 73 pid: 14490 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.939494:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x518:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431569.939497:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x518:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431569.939501:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae1ae174/0xd8e438fb635281a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.939509:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae1ae174/0xd8e438fb635281a9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x518:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.939525:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431569.939543:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2348:x1876351933619712:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 99us (8659us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431569.939550:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16726
00000100:00100000:3.0:1789431569.939565:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16727
00000100:00100000:3.0:1789431569.939571:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+76:2348:x1876351933620224:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431569.939578:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431569.939582:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a54d6ca/0xd8e438fb63526b0c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e0c expref: 76 pid: 14482 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.939592:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a54d6ca/0xd8e438fb63526b0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e0c expref: 76 pid: 14482 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.939609:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x516:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431569.939612:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x516:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1789431569.939616:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635281c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.939623:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635281c5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.939635:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431569.939652:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+76:2348:x1876351933620224:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 81us (8738us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431569.939659:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16727
00010000:00010000:2.0:1789431569.939714:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431569.939716:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a54d6ca/0xd8e438fb63526b0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c8e0c expref: 75 pid: 14482 timeout: 3127 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.939729:0:14500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf04828e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:14500:1876351894259712:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431569.939744:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2349:x1876351933620096:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 452us (8897us total) trans 0 rc 0/0
00010000:00010000:3.0:1789431569.939745:0:14500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635281c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.939767:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16725
00010000:00010000:3.0:1789431569.939768:0:14500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635281c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.939778:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635281c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.939797:0:14490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb635281be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.939797:0:14500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635281c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.939819:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb635281be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.939821:0:14500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635281c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.939845:0:14490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb635281be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.939853:0:14490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb635281be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.939854:0:14500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431569.939873:0:14490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:3.0:1789431569.940495:0:14500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+8:3312:x1876351894258304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26689us (27313us total) trans 4294970076 rc 0/0
00000100:00100000:3.0:1789431569.940503:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8427
00010000:00010000:3.0:1789431569.940529:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb635281b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x51b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.940538:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb635281b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x51b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.940546:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb635281b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x51b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.940553:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb635281b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.940566:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool
00000100:00100000:3.0:1789431569.940889:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3311:x1876351894258176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28772us (54503us total) trans 4294969681 rc 0/0
00000100:00100000:3.0:1789431569.940899:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8425
00010000:00010000:3.0:1789431569.940918:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ae1ae174/0xd8e438fb635281a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.940927:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae1ae174/0xd8e438fb635281a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.940934:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae1ae174/0xd8e438fb635281a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.940941:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae1ae174/0xd8e438fb635281a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.940952:0:8217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool
00000100:00100000:3.0:1789431569.941274:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3314:x1876351894258048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 44014us (56395us total) trans 4294969682 rc 0/0
00000100:00100000:3.0:1789431569.941281:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8423
00010000:00010000:3.0:1789431569.941299:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp.  (3 blwis in pool)
00010000:00010000:3.0:1789431569.941305:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635281c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941313:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431569.941317:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635281c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941327:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635281c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941341:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635281c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941348:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abb289d/0xd8e438fb635281c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941365:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp.  (2 blwis in pool)
00010000:00010000:3.0:1789431569.941369:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb635281be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941375:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7be00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431569.941378:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb635281be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941384:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb635281be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941392:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb635281be lrc: 1/0,0 mode: --/PW res: [0x280000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941398:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007711befc/0xd8e438fb635281be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941409:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:3.0:1789431569.941412:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb635281b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941418:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431569.941420:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb635281b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941427:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb635281b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x51b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941435:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb635281b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x51b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941442:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013cff579/0xd8e438fb635281b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x51b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941453:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431569.941456:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae1ae174/0xd8e438fb635281a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941463:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2000 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431569.941466:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae1ae174/0xd8e438fb635281a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941473:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae1ae174/0xd8e438fb635281a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941482:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae1ae174/0xd8e438fb635281a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941490:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae1ae174/0xd8e438fb635281a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.941501:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431569.941503:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431569.941505:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:3.0:1789431569.941536:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1ac74380/2, rc 0, transno 4294969682
00000100:00100000:3.0:1789431569.941543:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894258048:0@lo:6:osp-syn-0-0.0
00000100:00100000:3.0:1789431569.941568:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294970064 gen 2
00000004:00080000:3.0:1789431569.941573:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3afce300, transno 4294970064
00000100:00100000:3.0:1789431569.941586:0:3312:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search  req@ffff90ce2e82a680 x1876351894258304/t4294970076(4294970076) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789431585 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295
00000004:00080000:3.0:1789431569.941594:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2e82a680/2, rc 0, transno 4294970076
00000100:00100000:3.0:1789431569.941598:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876351894258304:0@lo:6:osp-syn-1-0.0
00010000:00010000:1.0:1789431569.942485:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431569.942494:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431569.942825:0:14490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3311:x1876351894258688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30372us (30975us total) trans 4294970077 rc 0/0
00000100:00100000:2.0:1789431569.942834:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8426
00010000:00010000:2.0:1789431569.942858:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431569.942916:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.942977:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431569.943868:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933619584
00000100:00100000:3.0:1789431569.943879:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933619584
00010000:00010000:3.0:1789431569.943912:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63528116 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x51c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94b8 expref: 72 pid: 14491 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.943946:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933619840
00000100:00100000:3.0:1789431569.943949:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933619840
00000100:00100000:2.0:1789431569.944360:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16728
00000100:00100000:2.0:1789431569.944371:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2347:x1876351933619584:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431569.944385:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431569.944392:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63528116 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x51c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94b8 expref: 72 pid: 14491 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.944469:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63528116 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94b8 expref: 72 pid: 14491 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.944491:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c316d2c/0xd8e438fb63528116 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x51c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94b8 expref: 72 pid: 14491 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.944508:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431569.944512:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431569.944518:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb635281a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x51c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.944527:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb635281a2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x51c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.944555:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431569.944599:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2347:x1876351933619584:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 230us (1684us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431569.944606:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16728
00010000:00010000:2.0:1789431569.944632:0:14471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb635281a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x51c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.944768:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000026047ea6/0xd8e438fb63527879 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x519:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9211 expref: 74 pid: 14500 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.944794:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16729
00000100:00100000:3.0:1789431569.944802:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2347:x1876351933619840:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431569.944811:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431569.944816:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000026047ea6/0xd8e438fb63527879 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x519:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9211 expref: 74 pid: 14500 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.944826:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000026047ea6/0xd8e438fb63527879 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x519:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9211 expref: 74 pid: 14500 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.944840:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026047ea6/0xd8e438fb63527879 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x519:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9211 expref: 74 pid: 14500 timeout: 3127 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.944850:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x519:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431569.944854:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x519:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431569.944858:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b437823/0xd8e438fb635281b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x519:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.944867:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b437823/0xd8e438fb635281b0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x519:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.944878:0:14471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb635281a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x51c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.944890:0:14471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb635281a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x51c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431569.944891:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431569.944901:0:14471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb635281a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431569.944916:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2347:x1876351933619840:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 113us (1936us total) trans 0 rc 0/0
00010000:00010000:2.0:1789431569.944920:0:14471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:3.0:1789431569.944925:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16729
00000004:00080000:3.0:1789431569.946615:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1ac75880/2, rc 0, transno 4294969681
00000100:00100000:3.0:1789431569.946628:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894258176:0@lo:6:osp-syn-0-0.0
00000004:00080000:3.0:1789431569.946651:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2e828700/2, rc 0, transno 4294970077
00000100:00100000:3.0:1789431569.946657:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894258688:0@lo:6:osp-syn-1-0.0
00010000:00010000:2.0:1789431569.948281:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431569.948292:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb635281a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.948305:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431569.948310:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb635281a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.948322:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb635281a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x51c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.948344:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb635281a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x51c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.948352:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019edd0c2/0xd8e438fb635281a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x51c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.948373:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431569.948375:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431569.948377:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431569.948391:0:14499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b437823/0xd8e438fb635281b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.948402:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b437823/0xd8e438fb635281b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.948600:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b437823/0xd8e438fb635281b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.948609:0:14499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b437823/0xd8e438fb635281b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.948630:0:14499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:3.0:1789431569.948644:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3313:x1876351894258432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 59481us (63854us total) trans 4294969683 rc 0/0
00000100:00100000:3.0:1789431569.948655:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8422
00000100:00100000:2.0:1789431569.948982:0:14499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+8:3314:x1876351894258560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 48891us (63892us total) trans 4294970078 rc 0/0
00000100:00100000:2.0:1789431569.948990:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8424
00010000:00010000:2.0:1789431569.949009:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431569.949013:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b437823/0xd8e438fb635281b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.949020:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523e00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431569.949023:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b437823/0xd8e438fb635281b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.949032:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b437823/0xd8e438fb635281b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.949044:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b437823/0xd8e438fb635281b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.949075:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b437823/0xd8e438fb635281b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431569.949089:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431569.949091:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431569.949092:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000004:00080000:3.0:1789431569.949242:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2e82ad80/2, rc 0, transno 4294970078
00000100:00100000:3.0:1789431569.949249:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2e82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876351894258560:0@lo:6:osp-syn-1-0.0
00000100:00100000:1.0:1789431569.951834:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431569.953007:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933620480
00000100:00100000:2.0:1789431569.953019:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933620480
00000004:00080000:0.0:1789431569.953905:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce1ac76300/2, rc 0, transno 4294969683
00000100:00100000:0.0:1789431569.953917:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894258432:0@lo:6:osp-syn-0-0.0
00000100:00100000:2.0:1789431569.954277:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12563
00000100:00100000:2.0:1789431569.954465:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14616:x1876351933620480:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431569.954989:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933620480:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 526us (3162us total) trans 4295121184 rc 0/0
00000100:00100000:2.0:1789431569.954997:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12563
00000100:00100000:0.0:1789431569.968473:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431569.973375:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933620736
00000100:00100000:1.0:1789431569.973390:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933620736
00000100:00100000:1.0:1789431569.973448:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296359
00000100:00100000:1.0:1789431569.973458:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14616:x1876351933620736:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431569.973482:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431569.973502:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635281cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c94e9 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.973601:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635281d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.973616:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528186 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94d4 expref: 197 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.973624:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635281d3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.973657:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94d4 expref: 197 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431569.978000:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528186 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94d4 expref: 197 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431569.978023:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894259840:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431569.978162:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3840 going to sleep for 11 seconds
00000100:00100000:3.0:1789431569.986097:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894259840:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431569.986126:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635281d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431569.999939:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.006282:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933620864
00000100:00100000:0.0:1789431570.006298:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933620864
00010000:00010000:0.0:1789431570.006541:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528186 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94d4 expref: 198 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.006578:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16730
00000100:00100000:0.0:1789431570.006590:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:2348:x1876351933620864:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431570.006604:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431570.006611:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528186 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94d4 expref: 198 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.006624:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94d4 expref: 198 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.006648:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528186 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94d4 expref: 198 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.006786:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90ce03149b00)
00010000:00010000:0.0:1789431570.006793:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635281d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.006803:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635281d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.006811:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635281d3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.006888:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431570.006952:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:2348:x1876351933620864:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 365us (7022us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431570.006971:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16730
00000100:00080000:1.0:1789431570.007356:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00010000:00010000:3.0:1789431570.007835:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635281d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.007847:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635281d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431570.007868:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00010000:00010000:3.0:1789431570.012095:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635281cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94e9 expref: 198 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.012126:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635281d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94e9 expref: 197 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.012135:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90ce03149b00)
00010000:00010000:3.0:1789431570.012138:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431570.012141:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:3.0:1789431570.012228:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14616:x1876351933620736:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 38770us (43760us total) trans 4295121185 rc 0/0
00000100:00100000:3.0:1789431570.012240:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296359
00000001:00080000:0.0:1789431570.013174:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970072 is committed
00000001:00080000:0.0:1789431570.013187:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970075 is committed
00000100:00100000:3.0:1789431570.013486:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2348:x1876351933619456:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 99485us (100211us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.013495:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8428
00000100:00100000:0.0:1789431570.016828:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.016898:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933620992
00000100:00100000:3.0:1789431570.016908:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933620992
00000100:00100000:2.0:1789431570.019326:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296360
00000100:00100000:2.0:1789431570.019346:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14616:x1876351933620992:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.019371:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.019392:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635281e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c94f0 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.019472:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635281e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.019486:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635281d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94e9 expref: 198 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.019500:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635281e8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.019531:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635281d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94e9 expref: 198 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.019544:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635281d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94e9 expref: 198 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.019557:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce17f3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894259968:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431570.019647:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf14143000 going to sleep for 11 seconds
00000100:00100000:2.0:1789431570.029318:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.029429:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.029455:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933621248
00000100:00100000:2.0:1789431570.029463:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933621248
00000100:00100000:2.0:1789431570.029506:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296361
00000100:00100000:2.0:1789431570.029515:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933621248:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.029534:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.029553:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb635281ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c94f7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.029628:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635281f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.029642:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635281f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.029658:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635281f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.029673:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb635281fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.029689:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb635281fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.029696:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb635281fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.029945:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528204 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.029954:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031106:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431570.031149:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00000004:00200000:2.0:1789431570.031154:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431570.031173:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031185:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031194:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635281f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031205:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635281f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031213:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635281f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031219:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.031223:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635281f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031230:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635281f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031242:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431570.031245:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.031250:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635281f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031257:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635281f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031273:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb635281fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031279:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb635281fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031285:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb635281fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031290:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.031293:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb635281fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031298:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb635281fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031305:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90cf13195500)
00010000:00010000:2.0:1789431570.031308:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.031311:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb635281fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031317:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb635281fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031354:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb635281ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94f7 expref: 201 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031368:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528204 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94f7 expref: 200 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.031375:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90cf13195700)
00010000:00010000:2.0:1789431570.031377:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431570.031380:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522400, rc 0)
00000100:00100000:2.0:1789431570.031453:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14617:x1876351933621248:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1938us (2023us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.031463:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296361
00000100:00100000:0.0:1789431570.031695:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933621120
00000100:00100000:0.0:1789431570.031703:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933621120
00010000:00010000:0.0:1789431570.031734:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635281d3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94e9 expref: 200 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.031766:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16731
00000100:00100000:0.0:1789431570.031774:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:2348:x1876351933621120:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431570.031785:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431570.031790:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635281d3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94e9 expref: 200 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.031801:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635281d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94e9 expref: 200 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.031814:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90ce03149b00)
00010000:00010000:0.0:1789431570.031818:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635281e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.031826:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635281e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.031833:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635281e8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.031847:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431570.031874:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:2348:x1876351933621120:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 101us (2568us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431570.031881:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16731
00010000:00010000:3.0:1789431570.034196:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb635281d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94e9 expref: 199 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.034221:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894259968:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431570.034250:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635281e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.034343:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635281e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.034351:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635281e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431570.034394:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00000004:00200000:3.0:1789431570.035192:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431570.035285:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635281e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.035328:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635281e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94f0 expref: 199 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.035346:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635281e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94f0 expref: 198 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.035355:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90ce03149b00)
00010000:00010000:2.0:1789431570.035358:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431570.035362:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522600, rc 0)
00000100:00100000:2.0:1789431570.035431:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14616:x1876351933620992:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 16093us (18612us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.035440:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296360
00000100:00100000:2.0:1789431570.039248:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.039320:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933621504
00000100:00100000:1.0:1789431570.039331:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933621504
00000100:00100000:1.0:1789431570.039389:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296362
00000100:00100000:1.0:1789431570.039400:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933621504:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431570.039451:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:1.0:1789431570.039477:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528204 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94f7 expref: 198 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.039498:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635280ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94aa expref: 197 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.039509:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90cf13195700)
00010000:00010000:1.0:1789431570.039518:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431570.039563:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352820b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.039576:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352820b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.039586:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352820b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431570.039757:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000a00e7f3 reply state 0000000017439da6 transno 4295121186 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352820b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.039767:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431570.039859:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933621504:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 460us (618us total) trans 4295121186 rc 0/0
00000100:00100000:1.0:1789431570.039865:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296362
00010000:00010000:2.0:1789431570.050007:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352820b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.050025:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352820b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.050034:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352820b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.050040:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.050045:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352820b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.050075:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352820b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.050093:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149e00)
00010000:00010000:2.0:1789431570.050096:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.050102:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352820b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.050108:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb6352820b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.050419:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.050497:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933621632
00000100:00100000:1.0:1789431570.050507:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933621632
00000100:00100000:1.0:1789431570.050563:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296363
00000100:00100000:1.0:1789431570.050575:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14617:x1876351933621632:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431570.050599:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431570.050625:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528212 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c94fe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.050678:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528212 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94fe expref: 198 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.050702:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528212 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94fe expref: 198 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.050721:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:1.0:1789431570.050724:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00010000:1.0:1789431570.050727:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309600, rc 0)
00000100:00100000:1.0:1789431570.050786:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933621632:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 214us (372us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431570.050793:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296363
00000100:00100000:0.0:1789431570.058303:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.058347:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.058431:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933621888
00000100:00100000:1.0:1789431570.058441:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933621888
00002000:00100000:1.0:1789431570.058503:0:14484:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x51c:0x0] (0->74401)  req@ffff90ce20fd5180 x1876351933621888/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:41/0 lens 488/0 e 0 to 0 dl 1789431581 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431570.058515:0:14484:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce20fd5180 with x1876351933621888 ext(0->74401)
00002000:00010000:1.0:1789431570.058520:0:14484:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce20fd5180
00000100:00100000:1.0:1789431570.058552:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1580
00000100:00100000:1.0:1789431570.058562:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2350:x1876351933621888:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:2.0:1789431570.058830:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933621760
00000100:00100000:2.0:1789431570.058835:0:14501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933621760
00000100:00100000:2.0:1789431570.058871:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8429
00000100:00100000:2.0:1789431570.058879:0:14501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2347:x1876351933621760:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:2.0:1789431570.059104:0:14501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x51b:0x0] updating lvb size from disk: 0 -> 74402
00002000:00010000:2.0:1789431570.059108:0:14501:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x51b:0x0] updating lvb mtime from disk: 0 -> 1789431557
00002000:00010000:2.0:1789431570.059110:0:14501:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x51b:0x0] updating lvb atime from disk: 0 -> 1789431559
00002000:00010000:2.0:1789431570.059112:0:14501:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x51b:0x0] updating lvb ctime from disk: 0 -> 1789431569
00002000:00010000:2.0:1789431570.059114:0:14501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x51b:0x0] updating lvb blocks from disk: 1 -> 259
00000100:00100000:2.0:1789431570.059149:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2347:x1876351933621760:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 270us (801us total) trans 4294970079 rc 0/0
00000100:00100000:2.0:1789431570.059156:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8429
00000100:00080000:0.0:1789431570.059352:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1789431570.069731:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.069878:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933622144
00000100:00100000:3.0:1789431570.069887:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933622144
00000100:00100000:3.0:1789431570.070186:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296364
00000100:00100000:3.0:1789431570.070198:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933622144:12345-192.168.203.4@tcp:55:dbench.0
00010000:00010000:3.0:1789431570.070268:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528219 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.070284:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528219 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.070296:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528219 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.070321:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528219 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.070328:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528219 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.070335:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528219 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.070342:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431570.070346:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528219 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.070353:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528219 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.070363:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:3.0:1789431570.070366:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:3.0:1789431570.070372:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528219 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.070378:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528219 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.070496:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2350:x1876351933621888:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 11929us (12196us total) trans 4294970080 rc 0/0
00000100:00100000:1.0:1789431570.070513:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1580
00000100:00100000:3.0:1789431570.070514:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933622144:12345-192.168.203.4@tcp:55:dbench.0 Request processed in 316us (797us total) trans 0 rc -22/-22
00000100:00100000:3.0:1789431570.070526:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296364
00002000:00100000:1.0:1789431570.070527:0:14484:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x51c:0x0] (0->74401)  req@ffff90ce20fd5180 x1876351933621888/t4294970080(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:41/0 lens 488/448 e 0 to 0 dl 1789431581 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431570.070538:0:14484:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce20fd5180 with x1876351933621888 ext(0->74401)
00002000:00010000:1.0:1789431570.070544:0:14484:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce20fd5180
00000100:00100000:2.0:1789431570.090601:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.090657:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933622272
00000100:00100000:3.0:1789431570.090667:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933622272
00000100:00100000:3.0:1789431570.090738:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296365
00000100:00100000:3.0:1789431570.090749:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14616:x1876351933622272:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:1.0:1789431570.096675:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.096743:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933622400
00000100:00100000:1.0:1789431570.096753:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933622400
00002000:00100000:1.0:1789431570.096801:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x51b:0x0] (0->4095)  req@ffff90ce2a7e9c00 x1876351933622400/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:41/0 lens 4584/0 e 0 to 0 dl 1789431581 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431570.096823:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce2a7e9c00 with x1876351933622400 ext(0->4095)
00002000:00010000:1.0:1789431570.096829:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce2a7e9c00
00000100:00100000:1.0:1789431570.096856:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1581
00000100:00100000:1.0:1789431570.096866:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2347:x1876351933622400:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:1.0:1789431570.104039:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2347:x1876351933622400:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 7164us (7363us total) trans 4294970081 rc 0/0
00000100:00100000:1.0:1789431570.104071:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1581
00002000:00100000:1.0:1789431570.104085:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x51b:0x0] (0->4095)  req@ffff90ce2a7e9c00 x1876351933622400/t4294970081(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:41/0 lens 4584/448 e 0 to 0 dl 1789431581 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431570.104096:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce2a7e9c00 with x1876351933622400 ext(0->4095)
00002000:00010000:1.0:1789431570.104103:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce2a7e9c00
00000100:00100000:0.0:1789431570.117184:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.117318:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933622528
00000100:00100000:1.0:1789431570.117327:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933622528
00000100:00100000:1.0:1789431570.117416:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296366
00000100:00100000:1.0:1789431570.117426:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933622528:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:1.0:1789431570.117544:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933622528:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 119us (369us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431570.117551:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296366
00000100:00100000:1.0:1789431570.126166:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.126263:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933622656
00000100:00100000:3.0:1789431570.126274:0:14505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933622656
00000100:00100000:3.0:1789431570.126337:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8430
00000100:00100000:3.0:1789431570.126348:0:14505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2348:x1876351933622656:12345-192.168.203.4@tcp:16:dbench.0
00000001:00080000:0.0:1789431570.183467:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121183 is committed
00000001:00080000:0.0:1789431570.183483:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121186 is committed
00000100:00100000:2.0:1789431570.184673:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+194:14616:x1876351933622272:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 93200us (93355us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.184749:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296365
00000100:00100000:0.0:1789431570.187720:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.191029:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933622784
00000100:00100000:3.0:1789431570.191044:0:14464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933622784
00000100:00100000:3.0:1789431570.191150:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8431
00000100:00100000:3.0:1789431570.191161:0:14464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2350:x1876351933622784:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:3.0:1789431570.191276:0:14464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2350:x1876351933622784:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 117us (3565us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.191283:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8431
00000100:00100000:3.0:1789431570.194269:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2348:x1876351933622656:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 67914us (68103us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.194281:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8430
00000001:00080000:3.0:1789431570.194402:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970081 is committed
00000001:00080000:3.0:1789431570.194418:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970078 is committed
00000100:00100000:0.0:1789431570.206558:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.206659:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933622912
00000100:00100000:2.0:1789431570.206669:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933622912
00000100:00100000:2.0:1789431570.206743:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296367
00000100:00100000:2.0:1789431570.206752:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+194:14616:x1876351933622912:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.206772:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.206791:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528220 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9505 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.206852:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528227 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.206866:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528227 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.206876:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528227 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.206889:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb6352822e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.206896:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb6352822e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.206912:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb6352822e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207394:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528235 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207403:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207411:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431570.207444:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00000004:00200000:2.0:1789431570.207449:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431570.207467:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207483:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207492:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528227 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207499:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528227 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207506:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528227 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207513:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.207517:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528227 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207525:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528227 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207537:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431570.207540:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.207545:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528227 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207552:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528227 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207565:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb6352822e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207572:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb6352822e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207579:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb6352822e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207584:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.207588:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb6352822e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207594:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb6352822e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207602:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90cf13195300)
00010000:00010000:2.0:1789431570.207604:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.207607:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb6352822e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207612:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb6352822e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207642:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528220 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9505 expref: 196 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207656:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9505 expref: 195 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.207663:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90ce03149b00)
00010000:00010000:2.0:1789431570.207665:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431570.207668:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522200, rc 0)
00000100:00100000:2.0:1789431570.207748:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14616:x1876351933622912:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 997us (1199us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.207755:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296367
00000100:00100000:3.0:1789431570.214137:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.214329:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933623168
00000100:00100000:2.0:1789431570.214339:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933623168
00000100:00100000:2.0:1789431570.214400:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12564
00000100:00100000:2.0:1789431570.214412:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0776fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+195:14617:x1876351933623168:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431570.214975:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0776fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+196:14617:x1876351933623168:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 562us (843us total) trans 4295121187 rc 0/0
00000100:00100000:2.0:1789431570.214984:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12564
00000100:00100000:1.0:1789431570.224919:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.224966:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.225087:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933623552
00000100:00100000:2.0:1789431570.225090:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933623424
00000100:00100000:3.0:1789431570.225098:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933623552
00000100:00100000:2.0:1789431570.225099:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933623424
00000100:00100000:3.0:1789431570.225199:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296368
00000100:00100000:3.0:1789431570.225270:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14617:x1876351933623552:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431570.225381:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431570.225403:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb6352823c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c950c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.225490:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528243 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.225504:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528243 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.225516:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528243 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.225531:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352824a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.225661:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352824a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.225669:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352824a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.225697:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296369
00000100:00100000:2.0:1789431570.225708:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14616:x1876351933623424:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431570.225740:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431570.225758:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528235 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9505 expref: 198 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.225779:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635281e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94f0 expref: 197 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.225789:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90ce03149b00)
00010000:00010000:2.0:1789431570.225798:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431570.225834:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528251 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.225844:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.225857:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431570.226322:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a395a182 reply state 000000002f47a899 transno 4295121188 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.226332:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431570.226428:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14616:x1876351933623424:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 722us (1460us total) trans 4295121188 rc 0/0
00000100:00100000:2.0:1789431570.226436:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296369
00010000:00010000:3.0:1789431570.231815:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528258 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.231834:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.231847:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431570.231896:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00000004:00200000:3.0:1789431570.231901:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431570.231922:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.231934:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.231942:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528243 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.231949:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528243 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.231956:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528243 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.231962:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431570.231967:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528243 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.231975:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528243 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.231986:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431570.231989:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431570.231993:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528243 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.231999:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528243 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.232017:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352824a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.232023:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352824a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.232028:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352824a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.232033:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7be00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431570.232036:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352824a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.232041:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352824a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.232149:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90cf18b78d00)
00010000:00010000:3.0:1789431570.232153:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431570.232156:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352824a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.232163:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb6352824a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.232205:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb6352823c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c950c expref: 198 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.232516:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.232650:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933623680
00000100:00100000:2.0:1789431570.232660:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933623680
00000100:00100000:2.0:1789431570.232728:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296370
00000100:00100000:2.0:1789431570.232738:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14616:x1876351933623680:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.232759:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.232776:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb6352825f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9513 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.232814:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.232828:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528251 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.232837:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528251 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.232887:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb6352825f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9513 expref: 200 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.232922:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c950c expref: 199 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.232934:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:3.0:1789431570.232937:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431570.232940:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a000, rc 0)
00000100:00100000:3.0:1789431570.233003:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933623552:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7795us (8093us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.233011:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296368
00010000:00010000:2.0:1789431570.233224:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb6352825f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9513 expref: 198 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.233248:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:2.0:1789431570.233251:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00010000:2.0:1789431570.233254:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523e00, rc 0)
00000100:00100000:2.0:1789431570.233331:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14616:x1876351933623680:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 595us (816us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.233339:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296370
00010000:00010000:1.0:1789431570.236449:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431570.236461:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528251 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.236477:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528251 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.236502:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:1.0:1789431570.236506:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431570.236511:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528251 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.236518:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528251 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.244022:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.244102:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933623808
00000100:00100000:2.0:1789431570.244112:0:14472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933623808
00000100:00100000:2.0:1789431570.244174:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8432
00000100:00100000:2.0:1789431570.244185:0:14472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2347:x1876351933623808:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:2.0:1789431570.244433:0:14472:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x51c:0x0] updating lvb size from disk: 0 -> 74402
00002000:00010000:2.0:1789431570.244438:0:14472:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x51c:0x0] updating lvb mtime from disk: 0 -> 1789431557
00002000:00010000:2.0:1789431570.244440:0:14472:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x51c:0x0] updating lvb atime from disk: 0 -> 1789431559
00002000:00010000:2.0:1789431570.244442:0:14472:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x51c:0x0] updating lvb ctime from disk: 0 -> 1789431569
00002000:00010000:2.0:1789431570.244444:0:14472:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x51c:0x0] updating lvb blocks from disk: 1 -> 259
00000100:00100000:2.0:1789431570.244502:0:14472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2347:x1876351933623808:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 319us (489us total) trans 4294970082 rc 0/0
00000100:00100000:2.0:1789431570.244510:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8432
00000100:00100000:0.0:1789431570.248645:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.248706:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.249186:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933624320
00000100:00100000:1.0:1789431570.249197:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933624320
00000100:00100000:1.0:1789431570.249351:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933624064
00000100:00100000:1.0:1789431570.249356:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933624064
00000100:00100000:1.0:1789431570.249390:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296371
00000100:00100000:1.0:1789431570.249400:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14616:x1876351933624320:12345-192.168.203.4@tcp:55:dbench.0
00010000:00010000:1.0:1789431570.249463:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528266 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.249480:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528266 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.249492:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528266 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.249519:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528266 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.249526:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528266 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.249533:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528266 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.249551:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431570.249555:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528266 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.249563:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528266 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.249580:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:1.0:1789431570.249583:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:1.0:1789431570.249588:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528266 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.249594:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528266 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.249661:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14616:x1876351933624320:12345-192.168.203.4@tcp:55:dbench.0 Request processed in 263us (1026us total) trans 0 rc -22/-22
00000100:00100000:1.0:1789431570.249670:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296371
00000100:00100000:1.0:1789431570.249706:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296372
00000100:00100000:1.0:1789431570.249714:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+197:14617:x1876351933624064:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431570.249723:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431570.249735:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352826d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c951a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.249992:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528274 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.250005:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528258 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c950c expref: 198 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.250013:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528274 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.250075:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c950c expref: 198 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.250095:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528258 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c950c expref: 198 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.250108:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894260096:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431570.250170:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3900 going to sleep for 11 seconds
00000100:00100000:0.0:1789431570.259925:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.260021:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894260096:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431570.260046:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528274 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.260138:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933624448
00000100:00100000:3.0:1789431570.260146:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933624448
00010000:00010000:3.0:1789431570.260182:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528258 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c950c expref: 199 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.260477:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16732
00000100:00100000:2.0:1789431570.260639:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:2347:x1876351933624448:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431570.260656:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431570.260664:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528258 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c950c expref: 199 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.260686:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c950c expref: 199 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.260710:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528258 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c950c expref: 199 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.260731:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:2.0:1789431570.260736:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528274 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.260746:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528274 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.260754:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528274 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.260786:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431570.260833:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:2347:x1876351933624448:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 346us (917us total) trans 0 rc 0/0
00010000:00010000:3.0:1789431570.260878:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528274 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.260887:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528274 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431570.260905:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00010000:00010000:3.0:1789431570.261072:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352826d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c951a expref: 200 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.261089:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528274 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c951a expref: 199 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.261097:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:3.0:1789431570.261100:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431570.261102:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:3.0:1789431570.261129:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933624064:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11416us (12422us total) trans 4295121189 rc 0/0
00000100:00100000:3.0:1789431570.261137:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296372
00000100:00100000:0.0:1789431570.261247:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.261458:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933624576
00000100:00100000:3.0:1789431570.261465:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933624576
00002000:00100000:3.0:1789431570.261497:0:14435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x51c:0x0] (0->4095)  req@ffff90ce20fd4700 x1876351933624576/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:41/0 lens 4584/0 e 0 to 0 dl 1789431581 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431570.261507:0:14435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce20fd4700 with x1876351933624576 ext(0->4095)
00002000:00010000:3.0:1789431570.261512:0:14435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce20fd4700
00000100:00100000:3.0:1789431570.261545:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1582
00000100:00100000:3.0:1789431570.261554:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2347:x1876351933624576:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:3.0:1789431570.262409:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2347:x1876351933624576:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 853us (1158us total) trans 4294970083 rc 0/0
00000100:00100000:3.0:1789431570.262417:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1582
00002000:00100000:3.0:1789431570.262425:0:14435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x51c:0x0] (0->4095)  req@ffff90ce20fd4700 x1876351933624576/t4294970083(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:41/0 lens 4584/448 e 0 to 0 dl 1789431581 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431570.262434:0:14435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce20fd4700 with x1876351933624576 ext(0->4095)
00002000:00010000:3.0:1789431570.262438:0:14435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce20fd4700
00000100:00100000:0.0:1789431570.269920:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.270253:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933624704
00000100:00100000:3.0:1789431570.270264:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933624704
00000100:00100000:3.0:1789431570.270322:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296373
00000100:00100000:3.0:1789431570.270331:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933624704:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431570.270354:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431570.270374:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528282 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9521 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.270456:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528289 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.270471:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528274 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c951a expref: 200 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.270480:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528289 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.270514:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528274 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c951a expref: 200 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.270527:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528274 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c951a expref: 200 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.270550:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf04828700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894260224:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431570.270637:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf05596c00 going to sleep for 11 seconds
00000100:00100000:2.0:1789431570.271589:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16732
00000100:00100000:0.0:1789431570.271975:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.272042:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933624832
00000100:00100000:2.0:1789431570.272078:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933624832
00000100:00100000:2.0:1789431570.272133:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296374
00000100:00100000:2.0:1789431570.272143:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14616:x1876351933624832:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:2.0:1789431570.272255:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14616:x1876351933624832:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 114us (281us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.272261:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296374
00000100:00100000:1.0:1789431570.275406:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.275489:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933624960
00000100:00100000:3.0:1789431570.275498:0:14491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933624960
00000100:00100000:3.0:1789431570.275613:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8433
00000100:00100000:3.0:1789431570.275625:0:14491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2347:x1876351933624960:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:1.0:1789431570.283770:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.283806:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933625088
00000100:00100000:1.0:1789431570.283815:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933625088
00010000:00010000:1.0:1789431570.283850:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528274 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c951a expref: 200 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.283885:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16733
00000100:00100000:1.0:1789431570.283894:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:2347:x1876351933625088:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431570.283909:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431570.283916:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528274 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c951a expref: 200 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.283928:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528274 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c951a expref: 200 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.283954:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:1.0:1789431570.283959:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528289 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.283970:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.283978:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528289 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.283995:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431570.284037:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:2347:x1876351933625088:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 144us (275us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431570.284043:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16733
00010000:00010000:3.0:1789431570.285749:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528274 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c951a expref: 199 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.285774:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf04828700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894260224:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431570.285800:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.286272:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.286285:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431570.286439:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00000004:00200000:2.0:1789431570.286444:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431570.286469:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.286538:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528282 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9521 expref: 199 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.286557:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528289 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9521 expref: 198 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.286566:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:2.0:1789431570.286569:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431570.286572:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7be00, rc 0)
00000100:00100000:2.0:1789431570.287565:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933624704:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 17229us (17648us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.287575:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296373
00000100:00100000:3.0:1789431570.303388:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.303499:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933625344
00000100:00100000:0.0:1789431570.303510:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933625344
00000100:00100000:0.0:1789431570.303642:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12565
00000100:00100000:0.0:1789431570.303656:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933625344:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431570.303960:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933625344:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 305us (581us total) trans 4295121190 rc 0/0
00000100:00100000:0.0:1789431570.303968:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12565
00000100:00100000:3.0:1789431570.309215:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.309500:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933625472
00000100:00100000:2.0:1789431570.309511:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933625472
00000100:00100000:2.0:1789431570.309571:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296375
00000100:00100000:2.0:1789431570.309581:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933625472:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.309608:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.309631:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528290 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9528 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.309708:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528297 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.309724:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528297 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.309739:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528297 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.309753:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352829e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.309760:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352829e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.309766:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352829e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310147:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635282a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310157:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635282a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310164:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635282a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431570.310199:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00000004:00200000:2.0:1789431570.310204:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431570.310225:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635282a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310236:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635282a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310244:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528297 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310254:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528297 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310261:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528297 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310267:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.310271:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528297 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310278:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528297 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310290:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431570.310293:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.310299:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528297 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310306:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528297 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310317:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352829e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310323:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352829e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310329:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352829e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310334:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.310338:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352829e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310344:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352829e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310351:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90cf13195c00)
00010000:00010000:2.0:1789431570.310353:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.310356:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352829e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310362:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352829e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310406:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528290 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9528 expref: 201 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310421:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635282a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9528 expref: 200 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.310428:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:2.0:1789431570.310431:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431570.310433:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523a00, rc 0)
00000100:00100000:2.0:1789431570.310500:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14617:x1876351933625472:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 920us (1302us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.310508:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296375
00000001:00080000:3.0:1789431570.323576:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970082 is committed
00000001:00080000:3.0:1789431570.323597:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970083 is committed
00000100:00100000:2.0:1789431570.323948:0:14491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2347:x1876351933624960:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 48320us (48546us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.323960:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8433
00000100:00100000:3.0:1789431570.326874:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.326928:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.327003:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933625728
00000100:00100000:0.0:1789431570.327024:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933625728
00000100:00100000:0.0:1789431570.327103:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296376
00000100:00100000:0.0:1789431570.327114:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14617:x1876351933625728:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431570.327135:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431570.327157:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635282ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c952f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.327270:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.327285:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528289 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9521 expref: 201 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.327292:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635282a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9528 expref: 201 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.327301:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.327333:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635282a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9528 expref: 201 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.327347:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635282a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9528 expref: 201 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.327360:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce20fd7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894260352:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431570.327450:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528289 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9521 expref: 201 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.327465:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528289 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9521 expref: 201 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.327475:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894260480:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431570.327498:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead6c0 going to sleep for 11 seconds
00000100:00100000:2.0:1789431570.329117:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933625856
00000100:00100000:2.0:1789431570.329131:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933625856
00010000:00010000:2.0:1789431570.329173:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635282a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9528 expref: 202 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.329223:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16734
00000100:00100000:2.0:1789431570.329233:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:2347:x1876351933625856:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431570.329246:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431570.329252:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635282a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9528 expref: 202 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.329264:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635282a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9528 expref: 202 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.329284:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:2.0:1789431570.329290:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.329299:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.329305:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431570.329347:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:2347:x1876351933625856:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 117us (2418us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.329354:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16734
00000100:00100000:3.0:1789431570.330303:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.330415:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933626112
00000100:00100000:3.0:1789431570.330420:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933626112
00000100:00100000:3.0:1789431570.330456:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12566
00000100:00100000:3.0:1789431570.330465:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:14616:x1876351933626112:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431570.330787:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14616:x1876351933626112:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 322us (487us total) trans 4295121191 rc 0/0
00000100:00100000:3.0:1789431570.330794:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12566
00010000:00010000:0.0:1789431570.337149:0:5849:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@000000003dcbb151 x1876351894260352) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635282a5 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9528 expref: 202 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.337174:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635282a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9528 expref: 202 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.337193:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce20fd7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894260352:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431570.337208:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894260480:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431570.337230:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:0.0:1789431570.337237:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.337245:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.337253:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.338574:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.339013:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933626240
00000100:00100000:2.0:1789431570.339023:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933626240
00010000:00010000:2.0:1789431570.339096:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528289 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9521 expref: 202 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.339133:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16735
00000100:00100000:2.0:1789431570.339142:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:2349:x1876351933626240:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431570.339158:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431570.339164:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528289 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9521 expref: 202 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.339177:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528289 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9521 expref: 202 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.339199:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528289 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9521 expref: 202 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.339226:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:2.0:1789431570.339233:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.339242:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.339249:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.339281:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431570.339337:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:2349:x1876351933626240:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 196us (768us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.339344:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16735
00010000:00010000:3.0:1789431570.339455:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.339464:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431570.339485:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00010000:00010000:3.0:1789431570.339626:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635282ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c952f expref: 202 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.339642:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c952f expref: 201 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.339655:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:3.0:1789431570.339657:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431570.339660:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3e00, rc 0)
00000100:00100000:3.0:1789431570.339706:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:14617:x1876351933625728:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12585us (12831us total) trans 4295121192 rc 0/0
00000100:00100000:3.0:1789431570.339713:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296376
00000100:00100000:1.0:1789431570.342518:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.342593:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933626368
00000100:00100000:0.0:1789431570.342602:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933626368
00000100:00100000:0.0:1789431570.342661:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296377
00000100:00100000:0.0:1789431570.342671:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:14616:x1876351933626368:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431570.342707:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431570.342732:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635282c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9536 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.342803:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635282c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.342817:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635282c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.342829:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635282c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.342843:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635282cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.342850:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635282cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.342857:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635282cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343146:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635282d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343156:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635282d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343163:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635282d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431570.343202:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00000004:00200000:0.0:1789431570.343206:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431570.343355:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635282d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343368:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635282d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343377:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635282c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343385:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635282c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343392:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635282c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343398:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431570.343402:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635282c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343409:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635282c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343420:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431570.343423:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431570.343428:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635282c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343434:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635282c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343451:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635282cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343458:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635282cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343464:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635282cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343469:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431570.343472:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635282cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343479:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635282cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343486:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce07190000)
00010000:00010000:0.0:1789431570.343489:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431570.343492:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635282cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343498:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635282cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343528:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635282c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9536 expref: 203 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343542:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635282d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9536 expref: 202 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.343554:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:0.0:1789431570.343556:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431570.343559:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3c00, rc 0)
00000100:00100000:0.0:1789431570.343616:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:14616:x1876351933626368:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 946us (1109us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431570.343623:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296377
00000100:00100000:1.0:1789431570.353623:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.353779:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933626496
00000100:00100000:3.0:1789431570.353791:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933626496
00000100:00100000:3.0:1789431570.353850:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296378
00000100:00100000:3.0:1789431570.353860:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:14617:x1876351933626496:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431570.353885:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431570.353905:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635282dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c953d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.353990:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635282e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.354005:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c952f expref: 203 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.354014:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635282e4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.354080:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c952f expref: 203 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.354093:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c952f expref: 203 pid: 5849 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.354106:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf0482b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894260608:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431570.354237:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf05596780 going to sleep for 11 seconds
00000100:00100000:1.0:1789431570.363504:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.363624:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.363701:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933626752
00000100:00100000:3.0:1789431570.363713:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933626752
00000100:00100000:3.0:1789431570.363773:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296379
00000100:00100000:3.0:1789431570.363784:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:14616:x1876351933626752:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431570.363806:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431570.363827:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635282eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9544 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.363926:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635282f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.363941:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635282d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9536 expref: 205 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.363950:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635282f2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.363982:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635282d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9536 expref: 205 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.363993:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635282d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9536 expref: 205 pid: 6797 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.364007:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf0482a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894260736:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431570.364102:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf055960c0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431570.367448:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933626880
00000100:00100000:3.0:1789431570.367464:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933626880
00010000:00010000:3.0:1789431570.367516:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c952f expref: 206 pid: 5849 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.367573:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16736
00000100:00100000:3.0:1789431570.367582:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2347:x1876351933626880:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431570.367597:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431570.367602:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c952f expref: 206 pid: 5849 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.367614:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c952f expref: 206 pid: 5849 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.367635:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:3.0:1789431570.367641:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635282e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.367649:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635282e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.367657:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635282e4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.367687:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431570.367748:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2347:x1876351933626880:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 167us (4123us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.367755:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16736
00000100:00100000:1.0:1789431570.368913:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.368991:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933627008
00000100:00100000:0.0:1789431570.368998:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933627008
00010000:00010000:0.0:1789431570.369033:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635282d6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9536 expref: 206 pid: 6797 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.369092:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16737
00000100:00100000:0.0:1789431570.369101:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2348:x1876351933627008:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431570.369114:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431570.369121:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635282d6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9536 expref: 206 pid: 6797 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.369134:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635282d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9536 expref: 206 pid: 6797 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.369152:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:0.0:1789431570.369157:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635282f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.369166:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635282f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.369178:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635282f2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.369194:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431570.369240:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2348:x1876351933627008:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 141us (333us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431570.369248:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16737
00010000:00010000:3.0:1789431570.369696:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635282d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9536 expref: 205 pid: 6797 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.369715:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf0482a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894260736:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431570.369736:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635282f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.369746:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635282f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.369752:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635282f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431570.369770:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00010000:00010000:3.0:1789431570.369917:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635282eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9544 expref: 206 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.369933:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635282f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9544 expref: 205 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.369940:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:3.0:1789431570.369943:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431570.369945:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b600, rc 0)
00000100:00100000:3.0:1789431570.369982:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14616:x1876351933626752:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 6201us (6487us total) trans 4295121193 rc 0/0
00000100:00100000:3.0:1789431570.369989:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296379
00010000:00010000:2.0:1789431570.371300:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635282b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c952f expref: 204 pid: 5849 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.371324:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf0482b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894260608:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431570.371346:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635282e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.371354:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635282e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.371359:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635282e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431570.371404:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00000004:00200000:2.0:1789431570.371409:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431570.371428:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635282e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.371461:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb635282dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c953d expref: 204 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.371476:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635282e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c953d expref: 203 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.371486:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:2.0:1789431570.371490:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431570.371493:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7ba00, rc 0)
00000100:00100000:2.0:1789431570.371552:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14617:x1876351933626496:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 17693us (17938us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.371564:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296378
00000100:00100000:1.0:1789431570.378859:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.378952:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933627136
00000100:00100000:2.0:1789431570.378963:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933627136
00000100:00100000:2.0:1789431570.379022:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296380
00000100:00100000:2.0:1789431570.379034:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14616:x1876351933627136:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.379088:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.379110:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528300 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c954b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.379195:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528307 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.379222:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635282f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9544 expref: 204 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.379232:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528307 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.379265:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635282f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9544 expref: 204 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.379278:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635282f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9544 expref: 204 pid: 12181 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.379291:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce17f3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894260864:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431570.379364:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce0bd0b540 going to sleep for 11 seconds
00000100:00100000:1.0:1789431570.385379:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.385465:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933627392
00000100:00100000:0.0:1789431570.385475:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933627392
00000100:00100000:0.0:1789431570.385538:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12567
00000100:00100000:0.0:1789431570.385547:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14617:x1876351933627392:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431570.385801:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14617:x1876351933627392:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 254us (430us total) trans 4295121194 rc 0/0
00000100:00100000:0.0:1789431570.385809:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12567
00000100:00100000:2.0:1789431570.386817:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894260864:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431570.386850:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528307 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.390361:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.390407:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.390502:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933627520
00000100:00100000:2.0:1789431570.390512:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933627520
00000100:00100000:2.0:1789431570.390570:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296381
00000100:00100000:2.0:1789431570.390579:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14617:x1876351933627520:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.390600:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.390621:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352830e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9552 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.390702:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528315 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.390717:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528315 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.390729:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528315 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.390744:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352831c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.390751:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352831c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.390757:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352831c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.390991:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528323 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391001:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391009:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431570.391042:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00000004:00200000:2.0:1789431570.391046:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431570.391112:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391125:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391133:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528315 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391139:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528315 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391145:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528315 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391152:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.391155:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528315 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391163:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528315 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391174:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431570.391177:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.391182:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528315 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391187:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528315 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391200:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352831c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391206:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352831c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391211:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352831c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391217:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.391220:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352831c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391226:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352831c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391233:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90cf13195500)
00010000:00010000:2.0:1789431570.391236:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.391239:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352831c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391244:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352831c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391274:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352830e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9552 expref: 208 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391288:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528323 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9552 expref: 207 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.391295:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:2.0:1789431570.391297:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431570.391299:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523c00, rc 0)
00000100:00100000:2.0:1789431570.391355:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14617:x1876351933627520:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 776us (946us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.391362:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296381
00000100:00100000:0.0:1789431570.391685:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933627648
00000100:00100000:0.0:1789431570.391699:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933627648
00010000:00010000:0.0:1789431570.391728:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635282f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9544 expref: 207 pid: 12181 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.391757:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16738
00000100:00100000:0.0:1789431570.391766:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb58050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:2347:x1876351933627648:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431570.391777:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431570.391783:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635282f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9544 expref: 207 pid: 12181 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.391794:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635282f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9544 expref: 207 pid: 12181 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.391809:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635282f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9544 expref: 207 pid: 12181 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.391820:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:0.0:1789431570.391824:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528307 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.391832:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.391839:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528307 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.391869:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431570.391906:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb58050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2347:x1876351933627648:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 141us (1554us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431570.391913:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16738
00010000:00010000:3.0:1789431570.392119:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.392128:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431570.392159:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00000004:00200000:3.0:1789431570.392163:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431570.392176:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.392200:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528300 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c954b expref: 206 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.392214:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528307 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c954b expref: 205 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.392220:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:3.0:1789431570.392223:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431570.392226:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522e00, rc 0)
00000100:00100000:3.0:1789431570.392261:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14616:x1876351933627136:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 13230us (13410us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.392268:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296380
00000100:00100000:3.0:1789431570.397866:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.398735:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.398873:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933627776
00000100:00100000:0.0:1789431570.398883:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933627776
00000100:00100000:3.0:1789431570.399025:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933628032
00000100:00100000:3.0:1789431570.399031:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933628032
00000100:00100000:0.0:1789431570.399033:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14386
00000100:00100000:0.0:1789431570.399042:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2347:x1876351933627776:12345-192.168.203.4@tcp:103:ldlm_bl.0
00000100:00100000:3.0:1789431570.399073:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296382
00010000:00010000:0.0:1789431570.399075:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:3.0:1789431570.399080:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14617:x1876351933628032:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431570.399097:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431570.399098:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528323 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9552 expref: 206 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.399112:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352832a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9559 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.399115:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:0.0:1789431570.399120:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431570.399165:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2347:x1876351933627776:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 124us (1308us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431570.399172:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14386
00010000:00010000:3.0:1789431570.399201:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528331 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.399226:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635282e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c953d expref: 205 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.399234:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528331 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.399302:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635282e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c953d expref: 205 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.399317:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635282e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c953d expref: 205 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.399454:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce17f3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894260992:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431570.399507:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf05596000 going to sleep for 11 seconds
00000100:00100000:2.0:1789431570.406747:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894260992:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431570.406785:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528331 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.407673:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.407781:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.407806:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933628160
00000100:00100000:2.0:1789431570.407815:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933628160
00000100:00100000:3.0:1789431570.407845:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933628416
00000100:00100000:3.0:1789431570.407850:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933628416
00010000:00010000:2.0:1789431570.407851:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635282e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c953d expref: 206 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.407884:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12568
00000100:00100000:2.0:1789431570.407887:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16739
00000100:00100000:2.0:1789431570.407894:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:2347:x1876351933628160:12345-192.168.203.4@tcp:103:ldlm_bl.0
00000100:00100000:3.0:1789431570.407895:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14616:x1876351933628416:12345-192.168.203.4@tcp:35:dbench.0
00010000:00010000:2.0:1789431570.407976:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431570.407984:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635282e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c953d expref: 207 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.407996:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635282e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c953d expref: 207 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.408016:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635282e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c953d expref: 207 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.408029:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:2.0:1789431570.408033:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528331 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.408042:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528331 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.408077:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528331 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.408098:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431570.408132:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14616:x1876351933628416:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 238us (350us total) trans 4295121195 rc 0/0
00000100:00100000:3.0:1789431570.408139:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12568
00000100:00100000:2.0:1789431570.411962:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2347:x1876351933628160:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 4058us (4284us total) trans 0 rc 0/0
00010000:00010000:3.0:1789431570.411962:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528331 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.411974:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528331 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.411976:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16739
00000004:00200000:3.0:1789431570.411998:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00010000:00010000:3.0:1789431570.412166:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352832a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9559 expref: 207 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.412187:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528331 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9559 expref: 206 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.412196:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:3.0:1789431570.412199:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431570.412202:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7be00, rc 0)
00000100:00100000:3.0:1789431570.412249:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14617:x1876351933628032:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 13169us (13519us total) trans 4295121196 rc 0/0
00000100:00100000:3.0:1789431570.412256:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296382
00000100:00100000:3.0:1789431570.414669:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.414750:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933628544
00000100:00100000:0.0:1789431570.414760:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933628544
00000100:00100000:0.0:1789431570.414816:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296383
00000100:00100000:0.0:1789431570.414825:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14616:x1876351933628544:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431570.414844:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431570.414864:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb6352833f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9560 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.414938:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528346 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.414953:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528346 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.414964:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528346 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.414977:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352834d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.414984:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352834d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.414991:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352834d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415267:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528354 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415278:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415286:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431570.415319:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00000004:00200000:0.0:1789431570.415563:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431570.415586:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415599:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415608:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528346 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415615:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528346 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415623:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528346 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415628:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431570.415633:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528346 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415641:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528346 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415653:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431570.415656:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431570.415662:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528346 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415668:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528346 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415692:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352834d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415698:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352834d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415704:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352834d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415710:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431570.415712:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352834d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415718:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352834d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415725:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce07190000)
00010000:00010000:0.0:1789431570.415728:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431570.415730:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352834d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415736:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352834d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415773:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb6352833f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9560 expref: 208 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415787:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528354 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9560 expref: 207 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.415820:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:0.0:1789431570.415823:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431570.415826:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3200, rc 0)
00000100:00100000:0.0:1789431570.415887:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14616:x1876351933628544:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1063us (1226us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431570.415895:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296383
00000100:00100000:1.0:1789431570.420825:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.422716:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933628672
00000100:00100000:2.0:1789431570.422732:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933628672
00000100:00100000:2.0:1789431570.422805:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296384
00000100:00100000:2.0:1789431570.422816:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14617:x1876351933628672:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.422841:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.422861:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352835b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9567 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.422946:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528362 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.422961:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528331 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9559 expref: 208 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.422970:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528362 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.423004:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528331 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9559 expref: 208 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.423018:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528331 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9559 expref: 208 pid: 12181 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.423032:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce17f3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894261120:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431570.423161:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce0bd0b540 going to sleep for 11 seconds
00000100:00100000:3.0:1789431570.425489:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.425531:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.425594:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933629056
00000100:00100000:1.0:1789431570.425602:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933629056
00000100:00100000:1.0:1789431570.425661:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14387
00000100:00100000:1.0:1789431570.425672:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:2348:x1876351933629056:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431570.425705:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431570.425728:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528354 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9560 expref: 209 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.425747:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:1.0:1789431570.425752:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431570.425809:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:2348:x1876351933629056:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 138us (277us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431570.425817:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14387
00000100:00100000:2.0:1789431570.425907:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933628928
00000100:00100000:2.0:1789431570.425912:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933628928
00000100:00100000:2.0:1789431570.425988:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296385
00000100:00100000:2.0:1789431570.425998:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14616:x1876351933628928:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.426015:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.426031:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528369 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c956e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.426555:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528370 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.426572:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528307 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c954b expref: 209 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.426581:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528370 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.426612:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528307 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c954b expref: 209 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.426625:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528307 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c954b expref: 209 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.426638:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce17f3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894261248:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431570.426809:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce0bd0b600 going to sleep for 11 seconds
00000100:00100000:0.0:1789431570.430583:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894261248:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431570.430617:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528370 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.431121:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.431143:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.434774:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933629184
00000100:00100000:1.0:1789431570.434791:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933629184
00010000:00010000:1.0:1789431570.434840:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528331 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9559 expref: 210 pid: 12181 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.434880:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933629312
00000100:00100000:1.0:1789431570.434884:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933629312
00010000:00010000:1.0:1789431570.434897:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528307 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c954b expref: 211 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.434916:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16740
00000100:00100000:1.0:1789431570.434922:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16741
00000100:00100000:1.0:1789431570.434927:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:2348:x1876351933629312:12345-192.168.203.4@tcp:103:ldlm_bl.0
00000100:00100000:3.0:1789431570.434928:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:2348:x1876351933629184:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431570.434943:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431570.434943:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431570.434950:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528307 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c954b expref: 211 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.434950:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528331 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9559 expref: 211 pid: 12181 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.434963:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528307 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c954b expref: 211 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.434964:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528331 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9559 expref: 211 pid: 12181 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.434984:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528307 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c954b expref: 211 pid: 5848 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.434984:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:3.0:1789431570.434990:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528362 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.434999:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:3.0:1789431570.434999:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.435002:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528370 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.435007:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528362 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.435009:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528370 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.435014:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528370 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.435026:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431570.435030:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431570.435098:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:2348:x1876351933629184:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 174us (3980us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.435106:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16740
00010000:00010000:2.0:1789431570.435603:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528331 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9559 expref: 209 pid: 12181 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.435619:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894261120:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431570.435643:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.435656:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.435662:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431570.435716:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00000004:00200000:2.0:1789431570.435720:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431570.435740:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.435772:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352835b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9567 expref: 209 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.435786:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528362 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9567 expref: 208 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.435793:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:2.0:1789431570.435796:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431570.435798:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523800, rc 0)
00000100:00100000:1.0:1789431570.435846:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:2348:x1876351933629312:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 917us (4700us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431570.435853:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16741
00010000:00010000:1.0:1789431570.435881:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528370 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.435888:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528370 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431570.435901:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00010000:00010000:1.0:1789431570.436018:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528369 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c956e expref: 209 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.436032:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528370 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c956e expref: 208 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.436040:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:1.0:1789431570.436043:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431570.436045:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523c00, rc 0)
00000100:00100000:1.0:1789431570.436086:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14616:x1876351933628928:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10090us (10606us total) trans 4295121197 rc 0/0
00000100:00100000:1.0:1789431570.436092:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296385
00000100:00100000:2.0:1789431570.437207:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14617:x1876351933628672:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 14387us (16383us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.437217:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296384
00000100:00100000:3.0:1789431570.443871:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.444103:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933629568
00000100:00100000:0.0:1789431570.444115:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933629568
00000100:00100000:0.0:1789431570.444181:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12569
00000100:00100000:0.0:1789431570.444193:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14617:x1876351933629568:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431570.445611:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14617:x1876351933629568:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 1415us (1744us total) trans 4295121198 rc 0/0
00000100:00100000:0.0:1789431570.445622:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12569
00000100:00100000:3.0:1789431570.448694:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.448886:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933629696
00000100:00100000:2.0:1789431570.448897:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933629696
00000100:00100000:2.0:1789431570.449029:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296386
00000100:00100000:2.0:1789431570.449040:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14616:x1876351933629696:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.449094:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.449116:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352837e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9575 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.449196:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528385 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.449217:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528370 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c956e expref: 209 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.449236:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528385 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.449271:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528370 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c956e expref: 209 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.449284:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528370 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c956e expref: 209 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.449298:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce17f3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894261376:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431570.449506:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce0bd0b540 going to sleep for 11 seconds
00000100:00100000:2.0:1789431570.455346:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894261376:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431570.455383:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528385 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.456740:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.456777:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.456896:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933629952
00000100:00100000:2.0:1789431570.456914:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933629952
00010000:00010000:2.0:1789431570.456952:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528370 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c956e expref: 210 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.456992:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16742
00000100:00100000:2.0:1789431570.457002:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:2347:x1876351933629952:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431570.457016:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431570.457024:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528370 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c956e expref: 210 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.457036:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528370 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c956e expref: 210 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.457098:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528370 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c956e expref: 210 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.457113:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:2.0:1789431570.457118:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528385 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.457128:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.457135:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528385 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.457167:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431570.457231:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:2347:x1876351933629952:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 231us (452us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.457239:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16742
00010000:00010000:1.0:1789431570.457380:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.457389:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431570.457434:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00000004:00200000:1.0:1789431570.457438:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431570.457459:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.457491:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352837e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9575 expref: 209 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.457507:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9575 expref: 208 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.457515:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:1.0:1789431570.457517:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431570.457520:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522600, rc 0)
00000100:00100000:1.0:1789431570.457546:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14616:x1876351933629696:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8509us (8872us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431570.457554:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296386
00000100:00100000:1.0:1789431570.457570:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933629824
00000100:00100000:1.0:1789431570.457573:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933629824
00000100:00100000:1.0:1789431570.457607:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296387
00000100:00100000:1.0:1789431570.457614:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14617:x1876351933629824:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431570.457631:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431570.457646:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352838c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c957c expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.457702:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528393 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.457714:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528393 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.457722:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528393 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.457737:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352839a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.457744:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352839a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.457751:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352839a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.457981:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635283a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.457996:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635283a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458003:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635283a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431570.458023:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00000004:00200000:1.0:1789431570.458026:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431570.458037:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635283a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458126:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635283a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458138:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528393 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458144:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528393 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458150:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528393 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458155:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431570.458159:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528393 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458166:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528393 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458175:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431570.458178:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431570.458181:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528393 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458187:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528393 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458196:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352839a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458202:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352839a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458208:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352839a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458214:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431570.458216:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352839a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458222:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352839a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458230:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90ce03149900)
00010000:00010000:1.0:1789431570.458232:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431570.458236:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352839a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458242:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352839a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458268:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352838c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c957c expref: 210 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458280:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635283a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c957c expref: 209 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.458299:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:1.0:1789431570.458302:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431570.458304:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:1.0:1789431570.458342:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:14617:x1876351933629824:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 728us (1608us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431570.458349:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296387
00000100:00100000:3.0:1789431570.462493:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.464599:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.464966:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933630336
00000100:00100000:3.0:1789431570.464977:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933630336
00000100:00100000:1.0:1789431570.465113:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933630208
00000100:00100000:1.0:1789431570.465118:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933630208
00000100:00100000:1.0:1789431570.465155:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12570
00000100:00100000:1.0:1789431570.465163:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0776f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:14616:x1876351933630208:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431570.465332:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14388
00000100:00100000:3.0:1789431570.465340:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb58c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:2348:x1876351933630336:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431570.465351:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431570.465375:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635283a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c957c expref: 211 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.465388:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0776f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:14616:x1876351933630208:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 226us (2904us total) trans 4295121199 rc 0/0
00010000:00010000:3.0:1789431570.465393:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00000100:00100000:1.0:1789431570.465395:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12570
00010000:00010000:3.0:1789431570.465398:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431570.465417:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb58c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:2348:x1876351933630336:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 78us (827us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.465423:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14388
00000100:00100000:3.0:1789431570.475259:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.475557:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.483729:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933630720
00000100:00100000:2.0:1789431570.483751:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933630592
00000100:00100000:2.0:1789431570.483757:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933630592
00000100:00100000:2.0:1789431570.483890:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296388
00000100:00100000:1.0:1789431570.483897:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933630720
00000100:00100000:2.0:1789431570.483901:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:14617:x1876351933630592:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.483927:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.483947:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635283a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9583 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.484175:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635283af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.484191:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528362 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9567 expref: 211 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.484200:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635283af lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.484234:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528362 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9567 expref: 211 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.484247:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528362 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9567 expref: 211 pid: 5849 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.484260:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce17f3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894261504:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431570.484871:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce0bd0b540 going to sleep for 11 seconds
00000100:00100000:0.0:1789431570.485384:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296389
00000100:00100000:0.0:1789431570.485399:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:14616:x1876351933630720:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431570.485416:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431570.485430:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c958a expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485483:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635283bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485496:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635283bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485507:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635283bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485521:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635283c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485528:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635283c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485534:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635283c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485790:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635283cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485800:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635283cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485808:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635283cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431570.485836:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00000004:00200000:0.0:1789431570.485841:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431570.485860:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635283cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485871:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635283cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485879:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635283bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485886:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635283bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485893:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635283bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485899:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431570.485904:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635283bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485912:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635283bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485923:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431570.485925:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431570.485930:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635283bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485936:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635283bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485948:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635283c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485959:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635283c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485965:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635283c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485971:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431570.485984:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635283c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485991:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635283c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.485999:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce07190000)
00010000:00010000:0.0:1789431570.486001:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431570.486005:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635283c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.486011:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635283c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.486196:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c958a expref: 213 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.486211:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635283cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c958a expref: 212 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.486218:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:0.0:1789431570.486220:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431570.486223:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3e00, rc 0)
00000100:00100000:0.0:1789431570.486280:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14616:x1876351933630720:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 887us (11029us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431570.486289:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296389
00000100:00100000:2.0:1789431570.497578:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.497626:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894261504:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431570.497657:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635283af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.497739:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933630848
00000100:00100000:3.0:1789431570.497757:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933630848
00010000:00010000:3.0:1789431570.497795:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528362 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9567 expref: 212 pid: 5849 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.497831:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16743
00000100:00100000:3.0:1789431570.497841:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:2348:x1876351933630848:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431570.497855:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431570.497862:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528362 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9567 expref: 212 pid: 5849 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.497873:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528362 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9567 expref: 212 pid: 5849 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.497895:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528362 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9567 expref: 212 pid: 5849 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.497909:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:3.0:1789431570.497914:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635283af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.497924:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635283af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.497932:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635283af lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.497959:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431570.497997:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635283af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.498005:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635283af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.498019:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:2348:x1876351933630848:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 179us (452us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.498030:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16743
00000004:00200000:1.0:1789431570.498033:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00010000:00010000:1.0:1789431570.498199:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635283a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9583 expref: 212 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.498220:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635283af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9583 expref: 211 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.498227:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:1.0:1789431570.498230:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431570.498232:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522400, rc 0)
00000100:00100000:1.0:1789431570.498258:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:14617:x1876351933630592:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 14360us (22701us total) trans 4295121200 rc 0/0
00000100:00100000:1.0:1789431570.498265:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296388
00000100:00100000:3.0:1789431570.499018:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.502712:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.502764:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.502833:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933631232
00000100:00100000:0.0:1789431570.502846:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933631232
00000100:00100000:0.0:1789431570.502895:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933631360
00000100:00100000:0.0:1789431570.502899:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933631360
00000100:00100000:0.0:1789431570.502924:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296390
00000100:00100000:0.0:1789431570.502934:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14616:x1876351933631232:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431570.502959:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431570.502991:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635283d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9591 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.503129:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.503145:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528385 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9575 expref: 213 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.503153:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635283cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c958a expref: 213 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.503161:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283e0 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.503191:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635283cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c958a expref: 213 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.503219:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635283cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c958a expref: 213 pid: 6797 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.503232:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894261632:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431570.503327:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9575 expref: 213 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.503337:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528385 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9575 expref: 213 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.503347:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894261760:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431570.503371:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05eada80 going to sleep for 11 seconds
00000100:00100000:0.0:1789431570.503393:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296391
00000100:00100000:1.0:1789431570.503398:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933630976
00000100:00100000:1.0:1789431570.503404:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933630976
00000100:00100000:0.0:1789431570.503406:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14617:x1876351933631360:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431570.503414:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431570.503424:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635283e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9598 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.503470:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635283ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.503486:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635283af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9583 expref: 215 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.503493:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635283ee lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.503511:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635283af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9583 expref: 215 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.503520:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635283af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9583 expref: 215 pid: 5849 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.503529:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894261888:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431570.503552:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead900 going to sleep for 11 seconds
00010000:00010000:0.0:1789431570.503581:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635283cb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c958a expref: 215 pid: 6797 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.503616:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16744
00000100:00100000:0.0:1789431570.503624:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:2347:x1876351933630976:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431570.503633:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431570.503639:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635283cb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c958a expref: 215 pid: 6797 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.503650:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635283cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c958a expref: 215 pid: 6797 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.503667:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:0.0:1789431570.503671:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.503687:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.503694:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431570.503720:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:2347:x1876351933630976:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 96us (4705us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431570.503726:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16744
00000100:00100000:1.0:1789431570.510169:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894261760:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431570.510460:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.510531:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933631488
00000100:00100000:2.0:1789431570.510539:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933631488
00010000:00010000:2.0:1789431570.510576:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528385 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9575 expref: 215 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.510619:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16745
00000100:00100000:2.0:1789431570.510629:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:2348:x1876351933631488:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431570.510642:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431570.510649:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528385 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9575 expref: 215 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.510662:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9575 expref: 215 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.510705:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528385 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9575 expref: 215 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.510721:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:2.0:1789431570.510726:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.510735:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.510753:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283e0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.510772:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431570.510827:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:2348:x1876351933631488:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 200us (367us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.510835:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16745
00010000:00010000:1.0:1789431570.511270:0:12181:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@00000000e4560691 x1876351894261632) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635283cb lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c958a expref: 213 pid: 6797 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.511287:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635283cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c958a expref: 213 pid: 6797 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.511299:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894261632:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431570.511317:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:1.0:1789431570.511324:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.511333:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.511339:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431570.511359:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00010000:00010000:1.0:1789431570.511507:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635283d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9591 expref: 214 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.511524:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9591 expref: 213 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.511532:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:1.0:1789431570.511535:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431570.511537:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3a00, rc 0)
00000100:00100000:1.0:1789431570.511569:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14616:x1876351933631232:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8636us (8865us total) trans 4295121201 rc 0/0
00000100:00100000:1.0:1789431570.511576:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296390
00000100:00100000:2.0:1789431570.515173:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.515439:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933631616
00000100:00100000:3.0:1789431570.515448:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933631616
00010000:00010000:3.0:1789431570.515487:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635283af lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9583 expref: 213 pid: 5849 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.515528:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16746
00000100:00100000:3.0:1789431570.515539:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:2347:x1876351933631616:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431570.515554:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431570.515560:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635283af lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9583 expref: 213 pid: 5849 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.515573:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635283af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9583 expref: 213 pid: 5849 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.515595:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:3.0:1789431570.515600:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635283ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.515609:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635283ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.515617:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635283ee lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.515636:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431570.516012:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635283af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9583 expref: 213 pid: 5849 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.516031:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894261888:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431570.516087:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635283ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.516097:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635283ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.516103:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635283ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431570.516145:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00000004:00200000:0.0:1789431570.516150:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431570.516170:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635283ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.516202:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635283e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9598 expref: 213 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.516490:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:2347:x1876351933631616:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 951us (1326us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.516500:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16746
00010000:00010000:0.0:1789431570.516566:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635283ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9598 expref: 211 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.516581:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:0.0:1789431570.516583:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431570.516586:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3400, rc 0)
00000100:00100000:0.0:1789431570.516621:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:14617:x1876351933631360:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 13222us (13857us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431570.516628:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296391
00000100:00100000:0.0:1789431570.527468:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.527540:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933631744
00000100:00100000:1.0:1789431570.527552:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933631744
00000100:00100000:1.0:1789431570.527668:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296392
00000100:00100000:1.0:1789431570.527692:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:14616:x1876351933631744:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431570.527716:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431570.527736:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635283fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c959f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.527830:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528403 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.527847:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283e0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9591 expref: 212 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.527857:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528403 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.527891:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9591 expref: 212 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.527905:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9591 expref: 212 pid: 12181 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.527919:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894262016:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431570.528014:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3900 going to sleep for 11 seconds
00000100:00100000:0.0:1789431570.528935:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.531019:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933631872
00000100:00100000:2.0:1789431570.531032:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933631872
00000100:00100000:2.0:1789431570.531131:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296393
00000100:00100000:2.0:1789431570.531143:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14617:x1876351933631872:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.531163:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.531183:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb6352840a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c95a6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.531261:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528411 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.531276:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528411 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.531286:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528411 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.531300:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528418 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.531307:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.531314:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.531544:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352841f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.531554:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352841f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.531561:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352841f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431570.531594:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00000004:00200000:2.0:1789431570.531598:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431570.531616:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352841f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.531626:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352841f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.531634:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528411 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.531641:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528411 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.531647:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528411 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.531654:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.531658:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528411 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.531665:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528411 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.531675:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431570.531688:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.531990:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528411 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.531999:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528411 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.532015:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.532021:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528418 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.532027:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528418 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.532033:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.532036:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528418 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.532042:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528418 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.532092:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90cf13195500)
00010000:00010000:2.0:1789431570.532095:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.532099:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528418 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.532105:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528418 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.532137:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb6352840a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95a6 expref: 215 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.532151:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352841f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95a6 expref: 214 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.532158:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:2.0:1789431570.532160:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431570.532164:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523600, rc 0)
00000100:00100000:2.0:1789431570.532638:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:14617:x1876351933631872:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1496us (3703us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.532648:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296393
00000100:00100000:1.0:1789431570.533521:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894262016:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431570.533548:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528403 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.536758:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.536945:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933632000
00000100:00100000:1.0:1789431570.536955:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933632000
00010000:00010000:1.0:1789431570.536996:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9591 expref: 214 pid: 12181 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.538773:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16747
00000100:00100000:1.0:1789431570.538797:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:2347:x1876351933632000:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431570.538816:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431570.538827:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9591 expref: 214 pid: 12181 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.538843:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9591 expref: 214 pid: 12181 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.538867:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635283e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9591 expref: 214 pid: 12181 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.538885:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:1.0:1789431570.538892:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528403 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.538901:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528403 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.538910:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528403 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.538950:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431570.539014:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:2347:x1876351933632000:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 229us (2270us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431570.539021:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16747
00010000:00010000:0.0:1789431570.539104:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528403 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.539112:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528403 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431570.539155:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00000004:00200000:0.0:1789431570.539159:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431570.539178:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528403 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.539209:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635283fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c959f expref: 213 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.539224:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528403 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c959f expref: 212 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.539231:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:0.0:1789431570.539234:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431570.539236:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:0.0:1789431570.539269:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14616:x1876351933631744:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11593us (11811us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431570.539276:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296392
00000100:00100000:3.0:1789431570.547594:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.548770:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933632128
00000100:00100000:1.0:1789431570.548782:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933632128
00000100:00100000:1.0:1789431570.548850:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14389
00000100:00100000:3.0:1789431570.548855:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.548865:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:2350:x1876351933632128:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431570.548881:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:3.0:1789431570.548892:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431570.548909:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb6352841f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95a6 expref: 212 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.548930:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:1.0:1789431570.548934:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431570.548991:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:2350:x1876351933632128:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 130us (1409us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431570.548998:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14389
00000100:00100000:1.0:1789431570.549024:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933632640
00000100:00100000:1.0:1789431570.549029:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933632640
00000100:00100000:1.0:1789431570.549066:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12571
00000100:00100000:1.0:1789431570.549073:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:14616:x1876351933632640:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431570.549264:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14616:x1876351933632640:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 190us (416us total) trans 4295121202 rc 0/0
00000100:00100000:1.0:1789431570.549271:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12571
00000100:00100000:1.0:1789431570.549305:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933632384
00000100:00100000:1.0:1789431570.549309:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933632384
00000100:00100000:1.0:1789431570.549348:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296394
00000100:00100000:1.0:1789431570.549356:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14617:x1876351933632384:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431570.549394:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431570.549408:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635283ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9598 expref: 212 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.549422:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:1.0:1789431570.549425:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431570.549458:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528426 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.549472:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528426 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.549483:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528426 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431570.549581:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000025a63682 reply state 00000000b61aa443 transno 4295121203 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528426 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.549590:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431570.552780:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14617:x1876351933632384:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 3411us (3874us total) trans 4295121203 rc 0/0
00000100:00100000:1.0:1789431570.552793:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296394
00000100:00100000:0.0:1789431570.554804:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.554851:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933632768
00000100:00100000:1.0:1789431570.554861:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933632768
00010000:00010000:2.0:1789431570.554885:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528426 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.554897:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528426 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.554905:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528426 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.554909:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8434
00010000:00010000:2.0:1789431570.554912:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309a00 already unused, calling callback (ffffffffc211f4f0)
00000100:00100000:1.0:1789431570.554918:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2347:x1876351933632768:12345-192.168.203.4@tcp:2:dbench.0
00010000:00010000:2.0:1789431570.554918:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528426 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.554926:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528426 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.554939:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:2.0:1789431570.554941:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.554946:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528426 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.554952:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528426 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789431570.555170:0:14469:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x51b:0x0] updating lvb size from disk: 74402 -> 74402
00002000:00010000:1.0:1789431570.555174:0:14469:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x51b:0x0] updating lvb mtime from disk: 1789431557 -> 1789431557
00002000:00010000:1.0:1789431570.555177:0:14469:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x51b:0x0] updating lvb atime from disk: 1789431559 -> 1789431560
00002000:00010000:1.0:1789431570.555179:0:14469:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x51b:0x0] updating lvb ctime from disk: 1789431569 -> 1789431570
00002000:00010000:1.0:1789431570.555182:0:14469:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x51b:0x0] updating lvb blocks from disk: 259 -> 259
00000100:00100000:1.0:1789431570.555240:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2347:x1876351933632768:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 323us (444us total) trans 4294970084 rc 0/0
00000100:00100000:1.0:1789431570.555248:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8434
00000100:00100000:3.0:1789431570.560122:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.560342:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933632896
00000100:00100000:1.0:1789431570.560352:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933632896
00000100:00100000:1.0:1789431570.560415:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296395
00000100:00100000:1.0:1789431570.560424:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14617:x1876351933632896:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431570.560446:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431570.560474:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352842d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c95ad expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.560545:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528434 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.560559:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528434 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.560571:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528434 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.560587:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352843b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.560594:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352843b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.560601:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352843b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.562078:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528434 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.562093:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528434 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.562103:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528434 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.562109:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431570.562113:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528434 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.562120:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528434 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.562136:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431570.562139:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431570.562145:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528434 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.562151:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528434 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.562164:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352843b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.562170:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352843b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.562175:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352843b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.562180:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431570.562182:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352843b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.562192:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352843b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.562199:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x6e04e070 (ffff90ce03149900)
00010000:00010000:1.0:1789431570.562201:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431570.562204:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352843b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.562209:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352843b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.562249:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352842d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95ad expref: 213 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.562258:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431570.562260:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431570.562264:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352842d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95ad expref: 213 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.562274:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:1.0:1789431570.562343:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14617:x1876351933632896:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1920us (2229us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431570.562351:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296395
00000100:00100000:2.0:1789431570.563819:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.564607:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933633024
00000100:00100000:1.0:1789431570.564618:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933633024
00000100:00100000:1.0:1789431570.564926:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296396
00000100:00100000:1.0:1789431570.564938:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14616:x1876351933633024:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431570.564964:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431570.564982:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528442 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c95b4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.565046:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528449 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.565089:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528449 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.565101:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528449 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.565771:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528450 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.565783:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.565791:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566036:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528457 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566045:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566076:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431570.566111:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00000004:00200000:2.0:1789431570.566115:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431570.566133:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566145:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566153:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528449 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566161:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528449 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566167:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528449 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566172:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.566177:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528449 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566184:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528449 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566194:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431570.566197:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.566202:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528449 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566208:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528449 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566219:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566224:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528450 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566229:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528450 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566233:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.566236:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528450 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566241:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528450 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566247:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90cf13195500)
00010000:00010000:2.0:1789431570.566249:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.566252:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528450 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566256:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528450 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566290:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528442 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95b4 expref: 214 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566303:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528457 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95b4 expref: 213 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.566310:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:2.0:1789431570.566312:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431570.566314:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522c00, rc 0)
00000100:00100000:2.0:1789431570.566379:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14616:x1876351933633024:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1444us (2565us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.566386:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296396
00000100:00100000:0.0:1789431570.567453:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.567507:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933633152
00000100:00100000:3.0:1789431570.567515:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933633152
00000100:00100000:3.0:1789431570.567564:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296397
00000100:00100000:3.0:1789431570.567573:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14617:x1876351933633152:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431570.567590:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431570.567606:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb6352845e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c95bb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.567659:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528465 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.567671:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.567689:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431570.567718:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008c:0x0]: returning size 16384
00000004:00200000:3.0:1789431570.567721:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431570.567737:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.567767:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb6352845e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95bb expref: 215 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.567785:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95bb expref: 214 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.567792:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431570.567795:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431570.567798:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7aa00, rc 0)
00000100:00100000:3.0:1789431570.567845:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:14617:x1876351933633152:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 272us (395us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.567852:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296397
00000100:00100000:0.0:1789431570.585247:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.585356:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933633280
00000100:00100000:1.0:1789431570.585366:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933633280
00000100:00100000:1.0:1789431570.585429:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12572
00000100:00100000:1.0:1789431570.585440:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:14617:x1876351933633280:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431570.586828:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.586972:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.587017:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933633408
00000100:00100000:3.0:1789431570.587026:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933633408
00000100:00100000:3.0:1789431570.587100:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14390
00000100:00100000:3.0:1789431570.587110:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb5a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:2348:x1876351933633408:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431570.587125:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431570.587148:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528457 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95b4 expref: 216 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.587166:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:3.0:1789431570.587171:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431570.587226:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb5a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:2348:x1876351933633408:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 118us (403us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.587233:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14390
00000100:00100000:1.0:1789431570.588469:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933633664
00000100:00100000:1.0:1789431570.588479:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933633664
00000100:00100000:1.0:1789431570.588531:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296398
00000100:00100000:1.0:1789431570.588541:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14616:x1876351933633664:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431570.588559:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431570.588577:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352846c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c95c2 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.588691:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528473 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.588706:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528403 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c959f expref: 216 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.588716:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528473 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.588749:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528403 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c959f expref: 216 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.588762:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528403 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c959f expref: 216 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.588777:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894262144:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431570.588868:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3240 going to sleep for 11 seconds
00000100:00100000:2.0:1789431570.595612:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14617:x1876351933633280:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 10162us (10362us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.595627:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12572
00000100:00100000:3.0:1789431570.599893:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.600003:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894262144:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431570.600031:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528473 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.600197:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933633792
00000100:00100000:0.0:1789431570.600205:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933633792
00010000:00010000:0.0:1789431570.600251:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528403 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c959f expref: 215 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.600288:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16748
00000100:00100000:0.0:1789431570.600297:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:2348:x1876351933633792:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431570.600312:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431570.600319:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528403 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c959f expref: 215 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.600331:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528403 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c959f expref: 215 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.600353:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528403 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c959f expref: 215 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.600371:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:0.0:1789431570.600376:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528473 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.600385:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528473 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.600393:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528473 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.600422:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431570.600472:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:2348:x1876351933633792:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 176us (587us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431570.600479:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16748
00010000:00010000:1.0:1789431570.600540:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528473 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.600549:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528473 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431570.600568:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00010000:00010000:1.0:1789431570.600724:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308a00/0xd8e438fb6352846c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95c2 expref: 215 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.600750:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528473 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95c2 expref: 214 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.600764:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:1.0:1789431570.600766:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431570.600769:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308c00, rc 0)
00000100:00100000:1.0:1789431570.600795:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:14616:x1876351933633664:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12256us (13823us total) trans 4295121204 rc 0/0
00000100:00100000:1.0:1789431570.600801:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296398
00000100:00100000:3.0:1789431570.608187:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.608331:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933634048
00000100:00100000:2.0:1789431570.608341:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933634048
00000100:00100000:2.0:1789431570.608403:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296399
00000100:00100000:2.0:1789431570.608413:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:14617:x1876351933634048:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.608433:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.608437:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:2.0:1789431570.608461:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528465 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95bb expref: 214 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.608480:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431570.608485:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431570.608499:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528481 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c95c9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.608942:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528488 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.608959:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528488 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.608970:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528488 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.608986:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352848f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.608993:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352848f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.609000:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352848f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:2.0:1789431570.609888:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x51d:0x0], index 0: 0
00010000:00010000:2.0:1789431570.611441:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528496 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.611462:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.611474:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.611510:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528488 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.611518:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528488 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.611526:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528488 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.611531:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.611536:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528488 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.611543:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528488 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.611554:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431570.611557:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.611562:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528488 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.611574:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528488 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431570.611591:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000472df23d reply state 0000000078166096 transno 4295121205 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352848f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.611600:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:2.0:1789431570.611633:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528481 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95c9 expref: 216 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.611648:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528496 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95c9 expref: 215 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.611655:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab6:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:2.0:1789431570.611658:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431570.611660:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522600, rc 0)
00000100:00100000:2.0:1789431570.616158:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14617:x1876351933634048:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7735us (7969us total) trans 4295121205 rc 0/0
00000100:00100000:2.0:1789431570.616171:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296399
00000100:00100000:3.0:1789431570.619632:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.619868:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933634176
00000100:00100000:0.0:1789431570.619880:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933634176
00000100:00100000:0.0:1789431570.619942:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296400
00000100:00100000:0.0:1789431570.619953:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0482bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14616:x1876351933634176:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431570.619977:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431570.619999:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635284a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c95d0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.620125:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635284ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.620142:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528473 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95c2 expref: 217 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.620152:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635284ab lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.620188:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528473 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95c2 expref: 217 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.620203:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528473 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95c2 expref: 217 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.620228:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894262272:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431570.620299:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead900 going to sleep for 11 seconds
00010000:00010000:1.0:1789431570.620421:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352848f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.620430:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352848f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.620438:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352848f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.620445:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431570.620449:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352848f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.620457:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352848f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.620472:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x6e04e070 (ffff90cf13195500)
00010000:00010000:1.0:1789431570.620476:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431570.620480:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352848f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.620487:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352848f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.627612:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894262272:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431570.627640:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635284ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.629303:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.629381:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.629480:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933634432
00000100:00100000:0.0:1789431570.629489:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933634432
00010000:00010000:0.0:1789431570.629527:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528473 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95c2 expref: 217 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.629569:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16749
00000100:00100000:0.0:1789431570.629579:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:2347:x1876351933634432:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431570.629592:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431570.629599:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528473 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95c2 expref: 217 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.629612:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528473 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95c2 expref: 217 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.629633:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528473 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95c2 expref: 217 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.629655:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:0.0:1789431570.629660:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635284ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.629669:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635284ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.629688:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635284ab lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.629724:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933634304
00000100:00100000:1.0:1789431570.629730:0:14500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933634304
00010000:00010000:0.0:1789431570.629754:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431570.629761:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8435
00000100:00100000:1.0:1789431570.629768:0:14500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2348:x1876351933634304:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431570.629780:0:14500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431570.629797:0:14500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa6bbca6/0xd8e438fb635284b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x51d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c95d7 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.629803:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:2347:x1876351933634432:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 226us (507us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431570.629810:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16749
00002000:00010000:1.0:1789431570.629823:0:14500:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x51d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:1.0:1789431570.629839:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51d:0x0].0x0 since=3028s v=(0 0)
00010000:00010000:1.0:1789431570.629844:0:14500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51d:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431570.629851:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6bbca6/0xd8e438fb635284b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95d7 expref: 72 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.629869:0:14500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa6bbca6/0xd8e438fb635284b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95d7 expref: 72 pid: 14500 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.629880:0:14500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308a00, rc 0)
00000100:00100000:1.0:1789431570.629921:0:14500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2348:x1876351933634304:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 153us (538us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431570.629927:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8435
00010000:00010000:2.0:1789431570.630084:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635284ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.630095:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635284ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431570.630136:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00000004:00200000:2.0:1789431570.630143:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431570.630224:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635284ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.630253:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635284a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95d0 expref: 216 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.630267:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635284ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95d0 expref: 215 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.630274:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:3.0:1789431570.630277:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431570.630279:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2000, rc 0)
00000100:00100000:3.0:1789431570.630318:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0482bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14616:x1876351933634176:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10367us (10695us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.630325:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296400
00000100:00100000:0.0:1789431570.643987:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.644021:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.644161:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933634688
00000100:00100000:3.0:1789431570.644170:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933634688
00000100:00100000:3.0:1789431570.644228:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12573
00000100:00100000:3.0:1789431570.644238:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14617:x1876351933634688:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431570.644580:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14617:x1876351933634688:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 343us (607us total) trans 4295121206 rc 0/0
00000100:00100000:3.0:1789431570.644588:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12573
00000100:00100000:2.0:1789431570.645082:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933634816
00000100:00100000:2.0:1789431570.645089:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933634816
00000100:00100000:2.0:1789431570.645132:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296401
00000100:00100000:2.0:1789431570.645141:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14616:x1876351933634816:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.645152:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.645171:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635284b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c95de expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645222:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645235:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645247:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645262:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645270:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645277:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645490:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635284ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645499:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635284ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645505:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635284ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431570.645532:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00000004:00200000:2.0:1789431570.645537:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431570.645552:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635284ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645562:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635284ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645569:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645576:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645582:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645589:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.645593:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645601:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645612:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431570.645615:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.645620:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645625:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645640:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645647:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645653:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645658:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.645661:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645666:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645673:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90cf13195f00)
00010000:00010000:2.0:1789431570.645686:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.645689:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645695:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645724:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635284b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95de expref: 218 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.645737:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635284ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95de expref: 217 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.647320:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:2.0:1789431570.647323:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431570.647327:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522400, rc 0)
00000100:00100000:2.0:1789431570.647402:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14616:x1876351933634816:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2259us (3376us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.647411:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296401
00000100:00100000:0.0:1789431570.653326:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.653770:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933635072
00000100:00100000:1.0:1789431570.653781:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933635072
00000100:00100000:1.0:1789431570.653843:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296402
00000100:00100000:1.0:1789431570.653853:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14616:x1876351933635072:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431570.653905:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:1.0:1789431570.653930:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb635284ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95de expref: 217 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.653952:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635284ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95d0 expref: 216 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.653962:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:1.0:1789431570.653967:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431570.654657:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635284d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.654673:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635284d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.654696:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635284d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431570.654833:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002dba2167 reply state 00000000f18d57a7 transno 4295121207 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635284d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.654843:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431570.654944:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14616:x1876351933635072:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1091us (1626us total) trans 4295121207 rc 0/0
00000100:00100000:1.0:1789431570.654953:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296402
00000100:00100000:3.0:1789431570.663367:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.663504:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933635328
00000100:00100000:1.0:1789431570.663514:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933635328
00000100:00100000:1.0:1789431570.663565:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12574
00000100:00100000:1.0:1789431570.663575:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14617:x1876351933635328:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431570.663824:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14617:x1876351933635328:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 250us (465us total) trans 4295121208 rc 0/0
00000100:00100000:1.0:1789431570.663832:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12574
00000100:00100000:0.0:1789431570.667169:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:2.0:1789431570.667257:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635284d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.667270:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635284d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.667278:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635284d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.667284:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.667353:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635284d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.667363:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635284d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.667441:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:2.0:1789431570.667444:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.667451:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635284d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.667457:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635284d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.667639:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933635456
00000100:00100000:3.0:1789431570.667649:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933635456
00000100:00100000:3.0:1789431570.667718:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8436
00000100:00100000:3.0:1789431570.667729:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2347:x1876351933635456:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:3.0:1789431570.667986:0:8217:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x51c:0x0] updating lvb size from disk: 74402 -> 74402
00002000:00010000:3.0:1789431570.667990:0:8217:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x51c:0x0] updating lvb mtime from disk: 1789431557 -> 1789431557
00002000:00010000:3.0:1789431570.667993:0:8217:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x51c:0x0] updating lvb atime from disk: 1789431559 -> 1789431560
00002000:00010000:3.0:1789431570.667995:0:8217:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x51c:0x0] updating lvb ctime from disk: 1789431569 -> 1789431570
00002000:00010000:3.0:1789431570.667997:0:8217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x51c:0x0] updating lvb blocks from disk: 259 -> 259
00000100:00100000:3.0:1789431570.668168:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2347:x1876351933635456:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 439us (1007us total) trans 4294970085 rc 0/0
00000100:00100000:3.0:1789431570.668175:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8436
00000100:00100000:1.0:1789431570.674392:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.674459:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933635712
00000100:00100000:3.0:1789431570.674470:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933635712
00000100:00100000:3.0:1789431570.674524:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12575
00000100:00100000:3.0:1789431570.674533:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14617:x1876351933635712:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431570.675236:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14617:x1876351933635712:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 701us (849us total) trans 4295121209 rc 0/0
00000100:00100000:3.0:1789431570.675245:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12575
00000100:00100000:1.0:1789431570.681136:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.681643:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933635968
00000100:00100000:2.0:1789431570.681653:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933635968
00000100:00100000:2.0:1789431570.681972:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296403
00000100:00100000:2.0:1789431570.681984:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14617:x1876351933635968:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431570.682046:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431570.682097:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528496 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95c9 expref: 218 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.682116:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab6:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:2.0:1789431570.682127:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431570.682148:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635284dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.682163:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635284dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.682173:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635284dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.682187:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.682195:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.682202:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.682333:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10ab6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.682342:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.682350:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431570.683607:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1252, 64 off88320
00010000:00010000:2.0:1789431570.683699:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635284f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.683712:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635284f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.683725:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635284f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.683734:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635284f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10ab6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.683740:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635284f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10ab6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.683747:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635284f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.683769:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431570.683790:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.683797:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10ab6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.683808:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.684128:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.684133:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.684141:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10ab6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.684153:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab6:0x0].0x0 (ffff90cf13195900)
00010000:00010000:2.0:1789431570.684156:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431570.684161:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ea lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10ab6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.684167:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ea lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10ab6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.684186:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635284dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.684191:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635284dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.684197:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635284dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.684202:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.684263:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635284dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.684274:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635284dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.684283:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431570.684286:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.684300:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635284dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.684306:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635284dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431570.684318:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000774e3c7d reply state 00000000880bd4fc transno 4295121210 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.684327:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431570.684549:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14617:x1876351933635968:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2563us (3419us total) trans 4295121210 rc 0/0
00000100:00100000:2.0:1789431570.684557:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296403
00010000:00010000:1.0:1789431570.684646:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431570.684662:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635284f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.684670:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523c00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431570.684673:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635284f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.684695:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635284f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.684705:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab6:0x0].0x0 (ffff90cf13195900)
00010000:00010000:1.0:1789431570.684707:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431570.684710:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635284f1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10ab6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.684716:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635284f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.684733:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431570.684734:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431570.684736:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431570.691602:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.691624:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.691632:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.691639:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431570.691643:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.691652:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.691668:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x6e04e070 (ffff90cf13195f00)
00010000:00010000:1.0:1789431570.691671:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431570.691687:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.691693:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb635284e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.697450:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.698039:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933636096
00000100:00100000:3.0:1789431570.698233:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933636096
00000100:00100000:2.0:1789431570.698454:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296404
00000100:00100000:2.0:1789431570.698465:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14617:x1876351933636096:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.698489:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.698592:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635284f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c95e5 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.698751:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.698832:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.698847:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.698863:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528506 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.698871:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.698878:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.699958:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352850d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.699975:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352850d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.699984:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352850d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431570.700019:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00000004:00200000:2.0:1789431570.700024:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431570.700043:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352850d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.700655:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352850d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.700666:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.700686:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.700693:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.700700:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.700704:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.700712:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.700725:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431570.700727:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.700732:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.700738:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635284ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.700751:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.701803:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.701989:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933636224
00000100:00100000:0.0:1789431570.701999:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933636224
00000100:00100000:0.0:1789431570.702076:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296405
00000100:00100000:0.0:1789431570.702087:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14616:x1876351933636224:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431570.702115:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431570.702133:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63528514 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c95ec expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702195:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352851b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702209:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352851b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702220:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352851b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702235:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528522 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702243:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702250:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702448:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352851b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702457:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352851b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702464:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352851b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702470:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431570.702474:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352851b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702481:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352851b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702497:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431570.702500:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431570.702505:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352851b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702591:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352851b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702606:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702612:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528522 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702618:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528522 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702624:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431570.702628:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528522 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702634:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528522 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702642:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x6e04e070 (ffff90ce07190000)
00010000:00010000:0.0:1789431570.702644:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431570.702647:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528522 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702653:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528522 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702699:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63528514 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95ec expref: 221 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702709:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431570.702712:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431570.702715:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb63528514 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95ec expref: 221 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.702725:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3e00, rc 0)
00010000:00010000:2.0:1789431570.702994:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528506 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.703000:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528506 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.703004:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.703007:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528506 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.703013:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528506 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.703022:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90cf13195c00)
00010000:00010000:2.0:1789431570.703024:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.703027:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528506 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.703032:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528506 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.703406:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14616:x1876351933636224:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1318us (1607us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431570.703415:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296405
00010000:00010000:2.0:1789431570.703487:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635284f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95e5 expref: 220 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.703504:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352850d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95e5 expref: 219 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.703523:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:2.0:1789431570.703525:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431570.703528:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522200, rc 0)
00000100:00100000:2.0:1789431570.703555:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14617:x1876351933636096:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 5092us (6116us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.703562:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296404
00000100:00100000:1.0:1789431570.715103:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.715240:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933636352
00000100:00100000:3.0:1789431570.715251:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933636352
00000100:00100000:3.0:1789431570.715375:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296406
00000100:00100000:3.0:1789431570.715386:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14616:x1876351933636352:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431570.715406:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431570.715426:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528529 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c95f3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.715495:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528530 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.715509:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.715521:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431570.715554:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008d:0x0]: returning size 16384
00000004:00200000:3.0:1789431570.715558:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431570.715576:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.715601:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528529 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95f3 expref: 221 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.715620:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95f3 expref: 220 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.715629:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431570.715632:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431570.715636:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a000, rc 0)
00000100:00100000:3.0:1789431570.715754:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14616:x1876351933636352:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 368us (705us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.715761:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296406
00000100:00100000:0.0:1789431570.725582:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.727279:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933636608
00000100:00100000:1.0:1789431570.727293:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933636608
00000100:00100000:1.0:1789431570.727360:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296407
00000100:00100000:1.0:1789431570.727369:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14617:x1876351933636608:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431570.727388:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431570.727409:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528537 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c95fa expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.727501:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352853e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.727515:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352850d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95e5 expref: 221 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.727523:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352853e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.727554:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352850d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95e5 expref: 221 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.727567:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352850d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95e5 expref: 221 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.727579:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1c3e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894262400:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431570.727803:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3b3f3240 going to sleep for 11 seconds
00000100:00100000:1.0:1789431570.733982:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1c3e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894262400:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431570.734011:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352853e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.735381:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.735521:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933636864
00000100:00100000:1.0:1789431570.735531:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933636864
00000100:00100000:1.0:1789431570.735589:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12576
00000100:00100000:1.0:1789431570.735599:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0776e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14616:x1876351933636864:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431570.739169:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.740885:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933636736
00000100:00100000:1.0:1789431570.740899:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933636736
00010000:00010000:1.0:1789431570.740946:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352850d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95e5 expref: 224 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.741033:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16750
00000100:00100000:1.0:1789431570.741045:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:2348:x1876351933636736:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431570.741091:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431570.741099:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352850d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95e5 expref: 224 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.741113:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352850d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95e5 expref: 224 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.741134:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb6352850d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95e5 expref: 224 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.741151:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:1.0:1789431570.741156:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352853e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.741167:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352853e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.741174:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352853e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.741199:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431570.741269:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:2348:x1876351933636736:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 217us (2100us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431570.741280:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16750
00010000:00010000:3.0:1789431570.741442:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352853e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.741452:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352853e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431570.741470:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00010000:00010000:3.0:1789431570.741615:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528537 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95fa expref: 224 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.741631:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352853e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95fa expref: 223 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.741639:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:3.0:1789431570.741642:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431570.741644:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:3.0:1789431570.741671:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14617:x1876351933636608:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 14303us (16098us total) trans 4295121211 rc 0/0
00000100:00100000:3.0:1789431570.741688:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296407
00010000:00010000:2.0:1789431570.742660:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431570.747164:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0776e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14616:x1876351933636864:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 11556us (11778us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.747178:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12576
00000100:00100000:2.0:1789431570.750041:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.750166:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933636992
00000100:00100000:0.0:1789431570.750176:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933636992
00000100:00100000:0.0:1789431570.750239:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296408
00000100:00100000:0.0:1789431570.750249:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14617:x1876351933636992:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431570.750284:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431570.750304:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352854c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9601 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.750384:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528553 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.750398:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352853e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95fa expref: 222 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.750409:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528553 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.750441:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352853e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95fa expref: 222 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.750455:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352853e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95fa expref: 222 pid: 6797 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.750468:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce156b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894262528:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431570.750549:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead900 going to sleep for 11 seconds
00000100:00100000:2.0:1789431570.753744:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce156b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894262528:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431570.753776:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528553 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.756891:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.756975:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933637120
00000100:00100000:3.0:1789431570.756986:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933637120
00010000:00010000:3.0:1789431570.757027:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352853e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95fa expref: 223 pid: 6797 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.757104:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16751
00000100:00100000:3.0:1789431570.757114:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:2347:x1876351933637120:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431570.757130:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431570.757136:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352853e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95fa expref: 223 pid: 6797 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.757149:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352853e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95fa expref: 223 pid: 6797 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.757169:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352853e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95fa expref: 223 pid: 6797 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.757184:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:3.0:1789431570.757189:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528553 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.757199:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.757207:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528553 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.757227:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431570.757503:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.757513:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431570.757559:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00000004:00200000:2.0:1789431570.757573:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431570.757595:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.757628:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb6352854c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9601 expref: 223 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.757645:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9601 expref: 222 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.757653:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:2.0:1789431570.757656:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431570.757658:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3400, rc 0)
00000100:00100000:2.0:1789431570.757721:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14617:x1876351933636992:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7473us (7688us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.757729:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296408
00000100:00100000:3.0:1789431570.758015:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:2347:x1876351933637120:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 902us (1132us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.758024:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16751
00000100:00100000:2.0:1789431570.760474:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.760638:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933637376
00000100:00100000:3.0:1789431570.760647:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933637376
00000100:00100000:3.0:1789431570.760989:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296409
00000100:00100000:3.0:1789431570.761000:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14616:x1876351933637376:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431570.761025:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431570.761028:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431570.761084:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528530 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c95f3 expref: 221 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.761102:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431570.761107:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431570.761120:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb6352855a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9608 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.761908:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528561 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.761926:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528561 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.761935:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528561 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.761950:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528568 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.761956:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528568 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.761962:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528568 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:3.0:1789431570.762553:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x51d:0x0], index 1: 0
00010000:00010000:3.0:1789431570.762789:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb6352856f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.762800:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb6352856f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.762808:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb6352856f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.762839:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528561 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.762847:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528561 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.762855:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528561 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.762862:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431570.762866:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528561 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.762874:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528561 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.762885:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431570.762888:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431570.762893:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528561 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.762899:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528561 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431570.762911:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008fd5487a reply state 000000000016416f transno 4295121212 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528568 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.762921:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431570.762955:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb6352855a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9608 expref: 223 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.762970:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb6352856f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9608 expref: 222 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.762977:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab7:0x0].0x0 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431570.762979:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431570.762982:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b000, rc 0)
00000100:00100000:3.0:1789431570.763045:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14616:x1876351933637376:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2047us (2580us total) trans 4295121212 rc 0/0
00000100:00100000:3.0:1789431570.763094:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296409
00010000:00010000:2.0:1789431570.768600:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528568 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.768617:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528568 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.768626:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528568 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.768633:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.768637:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528568 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.768645:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528568 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.768661:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x6e04e070 (ffff90cf18b78d00)
00010000:00010000:2.0:1789431570.768664:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.768668:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528568 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.768683:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528568 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.770154:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.770571:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933637632
00000100:00100000:0.0:1789431570.770580:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933637632
00000100:00100000:0.0:1789431570.770636:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12577
00000100:00100000:0.0:1789431570.770646:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14617:x1876351933637632:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431570.770890:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14617:x1876351933637632:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 245us (743us total) trans 4295121213 rc 0/0
00000100:00100000:0.0:1789431570.770897:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12577
00000100:00100000:1.0:1789431570.772438:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.772512:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933637760
00000100:00100000:3.0:1789431570.772521:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933637760
00000100:00100000:3.0:1789431570.772578:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8437
00000100:00100000:3.0:1789431570.772589:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2348:x1876351933637760:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431570.772609:0:14471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431570.772634:0:14471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb6352857d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x51d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c960f expref: -99 pid: 14471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431570.772663:0:14471:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x51d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431570.772700:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51d:0x0].0x0 since=3028s v=(0 0)
00010000:00010000:3.0:1789431570.772705:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51d:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431570.772714:0:14471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb6352857d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c960f expref: 70 pid: 14471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.772737:0:14471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb6352857d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c960f expref: 70 pid: 14471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.772751:0:14471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b400, rc 0)
00000100:00100000:3.0:1789431570.772806:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2348:x1876351933637760:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 220us (376us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.772814:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8437
00000100:00100000:1.0:1789431570.779147:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.779482:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933637888
00000100:00100000:0.0:1789431570.779492:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933637888
00000100:00100000:0.0:1789431570.779549:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296410
00000100:00100000:0.0:1789431570.779560:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14617:x1876351933637888:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431570.779582:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431570.779602:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528584 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9616 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.779663:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352858b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.779690:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352858b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.779710:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352858b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.779726:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528592 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.779733:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.779740:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.779834:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528599 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.779844:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.779851:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431570.779883:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00000004:00200000:0.0:1789431570.779887:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431570.779904:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.779919:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.779927:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352858b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.779934:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352858b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.779941:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352858b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.779947:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431570.779951:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352858b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.779959:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352858b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.779971:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431570.779974:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431570.779979:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352858b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.779984:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb6352858b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.779997:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.780004:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528592 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.780010:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.780014:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431570.780017:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.780022:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528592 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.780030:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90ce07190000)
00010000:00010000:0.0:1789431570.780032:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431570.780035:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528592 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.780041:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528592 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.780874:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528584 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9616 expref: 225 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.780892:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528599 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9616 expref: 224 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.780899:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:0.0:1789431570.780901:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431570.780904:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3200, rc 0)
00000100:00100000:1.0:1789431570.781803:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14617:x1876351933637888:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2237us (2658us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431570.781813:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296410
00000100:00100000:0.0:1789431570.782286:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.782485:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933638144
00000100:00100000:3.0:1789431570.782495:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933638144
00000100:00100000:3.0:1789431570.782546:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12578
00000100:00100000:3.0:1789431570.782556:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14616:x1876351933638144:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431570.782891:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14616:x1876351933638144:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 335us (612us total) trans 4295121214 rc 0/0
00000100:00100000:3.0:1789431570.782899:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12578
00000100:00100000:3.0:1789431570.791465:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.791662:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933638272
00000100:00100000:2.0:1789431570.791672:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933638272
00000100:00100000:2.0:1789431570.791780:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14391
00000100:00100000:2.0:1789431570.791792:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:2347:x1876351933638272:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431570.791808:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431570.791833:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528599 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9616 expref: 225 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.791856:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:2.0:1789431570.791861:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431570.791921:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:2347:x1876351933638272:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 131us (465us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.791928:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14391
00000100:00100000:3.0:1789431570.793705:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.794626:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933638400
00000100:00100000:0.0:1789431570.794636:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933638400
00000100:00100000:0.0:1789431570.794709:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296411
00000100:00100000:0.0:1789431570.794720:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14617:x1876351933638400:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431570.794743:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431570.794764:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635285a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c961d expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.794826:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.794840:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.794851:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.794864:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.794872:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.794878:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.794928:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.794936:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.794943:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.794950:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431570.794954:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.794961:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.794972:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431570.794975:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431570.794980:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.794987:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.794998:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.795004:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.795009:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.795014:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431570.795016:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.795022:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.795033:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x6e04e070 (ffff90ce07190000)
00010000:00010000:0.0:1789431570.795036:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431570.795038:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.795043:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.795118:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635285a0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c961d expref: 225 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.795127:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431570.795129:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431570.795132:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635285a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c961d expref: 225 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.795141:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2000, rc 0)
00000100:00100000:0.0:1789431570.795194:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14617:x1876351933638400:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 476us (1503us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431570.795202:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296411
00000100:00100000:1.0:1789431570.803632:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.803771:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933638656
00000100:00100000:0.0:1789431570.803781:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933638656
00000100:00100000:0.0:1789431570.803836:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12579
00000100:00100000:0.0:1789431570.803846:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14616:x1876351933638656:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431570.804259:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14616:x1876351933638656:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 412us (635us total) trans 4295121215 rc 0/0
00000100:00100000:0.0:1789431570.804271:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12579
00000100:00100000:1.0:1789431570.808733:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.808886:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933638912
00000100:00100000:3.0:1789431570.808904:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933638912
00000100:00100000:3.0:1789431570.808981:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12580
00000100:00100000:3.0:1789431570.808994:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14616:x1876351933638912:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431570.810976:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+226:14616:x1876351933638912:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 1970us (2238us total) trans 4295121216 rc 0/0
00000100:00100000:3.0:1789431570.810990:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12580
00000100:00100000:1.0:1789431570.817439:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.817544:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933639040
00000100:00100000:2.0:1789431570.817553:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933639040
00000100:00100000:2.0:1789431570.817613:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296412
00000100:00100000:2.0:1789431570.817622:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+226:14617:x1876351933639040:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.817643:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.817662:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635285b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9624 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.817731:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635285bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.817745:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635285bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.817756:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635285bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431570.817789:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008c:0x0]: returning size 16384
00000004:00200000:2.0:1789431570.817793:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431570.817810:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635285bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.817833:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635285b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9624 expref: 228 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.817851:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635285bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9624 expref: 227 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.817859:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431570.817862:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:2.0:1789431570.817866:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522600, rc 0)
00000100:00100000:2.0:1789431570.817921:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:14617:x1876351933639040:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 300us (493us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.817928:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296412
00000100:00100000:1.0:1789431570.818431:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.818541:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933639296
00000100:00100000:3.0:1789431570.818547:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933639296
00000100:00100000:3.0:1789431570.818585:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296413
00000100:00100000:3.0:1789431570.818594:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:14616:x1876351933639296:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431570.818628:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431570.818646:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb6352856f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9608 expref: 227 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.818658:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab7:0x0].0x0 (ffff90cf18b78f00)
00010000:00010000:3.0:1789431570.818666:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431570.818690:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635285c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.818701:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635285c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.818708:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635285c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.818722:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635285ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.818729:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635285ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.818736:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635285ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.818831:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635285d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10ab7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.818843:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635285d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.818850:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635285d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431570.819633:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1250, 64 off88256
00000004:00080000:2.0:1789431570.819642:0:6797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3028850592978ns, next at 3029850590923ns, rc = 0
00010000:00010000:2.0:1789431570.819706:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635285d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819717:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635285d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819726:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635285d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819734:0:6797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635285d8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10ab7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819741:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635285d8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10ab7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819746:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635285d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819772:0:6797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431570.819789:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635285d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819795:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635285d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10ab7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819801:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635285d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819807:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.819811:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635285d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819819:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635285d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10ab7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819827:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab7:0x0].0x0 (ffff90cf18b78d00)
00010000:00010000:2.0:1789431570.819830:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431570.819834:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635285d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10ab7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819839:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb635285d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10ab7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819854:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635285c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819860:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635285c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819869:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635285c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819873:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.819876:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635285c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819880:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635285c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819886:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431570.819888:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.819890:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635285c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.819895:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb635285c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431570.819902:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000093e830a6 reply state 0000000082c9bbaf transno 4295121217 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635285ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.819909:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431570.819990:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14616:x1876351933639296:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1395us (1558us total) trans 4295121217 rc 0/0
00000100:00100000:2.0:1789431570.819998:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296413
00010000:00010000:3.0:1789431570.821764:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431570.821775:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635285d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.821786:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431570.821789:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635285d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.821798:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635285d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.821812:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab7:0x0].0x0 (ffff90cf18b78d00)
00010000:00010000:3.0:1789431570.821815:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431570.821819:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635285d8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10ab7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.821825:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635285d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.821847:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431570.821849:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431570.821851:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431570.822120:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635285ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.822129:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635285ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.822141:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635285ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.822147:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.822151:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635285ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.822157:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635285ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.822166:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x6e04e070 (ffff90cf18b78400)
00010000:00010000:2.0:1789431570.822168:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.822171:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635285ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.822177:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635285ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.826725:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.828948:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933639552
00000100:00100000:0.0:1789431570.828962:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933639552
00000100:00100000:0.0:1789431570.829123:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296414
00000100:00100000:0.0:1789431570.829133:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:14616:x1876351933639552:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431570.829156:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431570.829178:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635285df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c962b expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829236:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.829247:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431570.829251:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829332:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829350:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829357:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829363:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829457:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635285f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829469:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635285f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829476:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635285f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431570.829507:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00000004:00200000:0.0:1789431570.829511:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431570.829529:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635285f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829540:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635285f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829548:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829555:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829561:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829567:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431570.829571:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829578:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829587:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431570.829591:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431570.829596:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829601:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635285e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829613:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829619:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829624:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829629:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431570.829632:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829638:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829645:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce07190000)
00010000:00010000:0.0:1789431570.829647:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431570.829650:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829656:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635285ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829758:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635285df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c962b expref: 229 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829773:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635285f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c962b expref: 228 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.829781:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:0.0:1789431570.829783:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431570.829785:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3e00, rc 0)
00000100:00100000:0.0:1789431570.829845:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14616:x1876351933639552:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 714us (3129us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431570.829852:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296414
00000100:00100000:3.0:1789431570.830163:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933639424
00000100:00100000:3.0:1789431570.830171:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933639424
00000100:00100000:3.0:1789431570.830209:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12581
00000100:00100000:3.0:1789431570.830219:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14617:x1876351933639424:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:2.0:1789431570.852385:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14617:x1876351933639424:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 22157us (23127us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.853613:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12581
00000100:00100000:1.0:1789431570.857425:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.858341:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933639680
00000100:00100000:2.0:1789431570.858352:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933639680
00000100:00100000:2.0:1789431570.859323:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296415
00000100:00100000:2.0:1789431570.859339:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14617:x1876351933639680:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.859358:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.859378:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635285fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9632 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859444:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528602 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859460:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528602 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859471:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528602 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859484:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528609 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859490:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859495:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859546:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528602 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859553:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528602 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859559:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528602 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859564:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.859568:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528602 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859578:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528602 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859588:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431570.859591:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.859595:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528602 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859600:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528602 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859611:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859617:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528609 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859622:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528609 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859626:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.859628:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528609 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859633:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528609 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859638:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x6e04e070 (ffff90cf13195c00)
00010000:00010000:2.0:1789431570.859640:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.859643:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528609 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859648:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528609 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859685:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635285fb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9632 expref: 229 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859695:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431570.859697:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.859700:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635285fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9632 expref: 229 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.859710:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523a00, rc 0)
00000100:00100000:2.0:1789431570.859767:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14617:x1876351933639680:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 434us (2516us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431570.859774:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296415
00000100:00100000:1.0:1789431570.866300:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.866399:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933639936
00000100:00100000:2.0:1789431570.866409:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933639936
00000100:00100000:2.0:1789431570.866502:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296416
00000100:00100000:2.0:1789431570.866512:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14616:x1876351933639936:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.866531:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.866551:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63528610 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9639 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.866653:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528617 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.866668:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635285f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c962b expref: 229 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.866747:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528617 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.866782:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635285f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c962b expref: 229 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.866795:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635285f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c962b expref: 229 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.866809:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce17f3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894262656:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431570.866990:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce0bd0b480 going to sleep for 11 seconds
00000100:00100000:0.0:1789431570.873279:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.879197:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933640192
00000100:00100000:1.0:1789431570.879214:0:5860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933640192
00000100:00100000:1.0:1789431570.881027:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 524
00000100:00100000:1.0:1789431570.881063:0:5860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14617:x1876351933640192:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431570.881121:0:5860:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:1.0:1789431570.881149:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528553 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9601 expref: 230 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.881169:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:1.0:1789431570.881180:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb635285bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9624 expref: 229 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.881192:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431570.881195:0:5860:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431570.881221:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352861e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.881233:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352861e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.881242:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352861e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.881255:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528625 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.881261:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528625 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.881267:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528625 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.881277:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352862c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.881283:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352862c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.881289:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352862c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.881414:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528633 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.881424:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528633 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.881431:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528633 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431570.882042:0:5860:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b54d8b48 reply state 000000002e506c76 transno 4295121218 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528633 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.882092:0:5860:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:1.0:1789431570.882099:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352861e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.882105:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352861e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.882111:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352861e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.882117:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431570.882121:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352861e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.882127:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352861e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.882138:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431570.882140:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431570.882144:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352861e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.882154:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352861e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431570.882164:0:5860:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b54d8b48 reply state 000000002e506c76 transno 4295121218 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528625 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.882170:0:5860:0:(service.c:179:ptlrpc_save_lock()) nlocks 1
00000004:00010000:1.0:1789431570.882173:0:5860:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b54d8b48 reply state 000000002e506c76 transno 4295121218 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352862c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.882178:0:5860:0:(service.c:179:ptlrpc_save_lock()) nlocks 2
00000100:00100000:1.0:1789431570.882267:0:5860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14617:x1876351933640192:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1227us (8994us total) trans 4295121218 rc 0/0
00000100:00100000:1.0:1789431570.882275:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 524
00000100:00100000:0.0:1789431570.882626:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.882649:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933640320
00000100:00100000:0.0:1789431570.882656:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933640320
00010000:00010000:0.0:1789431570.882697:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635285f4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c962b expref: 230 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.882720:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16752
00000100:00100000:0.0:1789431570.882728:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:2348:x1876351933640320:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431570.882737:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431570.882743:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635285f4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c962b expref: 230 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.882753:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635285f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c962b expref: 230 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.882773:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:0.0:1789431570.882777:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528617 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.882786:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528617 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.882793:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528617 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.882808:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431570.882835:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:2348:x1876351933640320:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 107us (211us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431570.882842:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16752
00010000:00010000:3.0:1789431570.883596:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3e00/0xd8e438fb635285f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c962b expref: 229 pid: 12775 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.883614:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894262656:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431570.883636:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528617 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.883645:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528617 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.883651:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528617 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431570.883668:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00010000:00010000:3.0:1789431570.883806:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63528610 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9639 expref: 230 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.883823:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528617 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9639 expref: 229 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.883829:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:3.0:1789431570.883832:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431570.883834:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523600, rc 0)
00000100:00100000:3.0:1789431570.883882:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14616:x1876351933639936:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 17372us (17590us total) trans 4295121219 rc 0/0
00000100:00100000:3.0:1789431570.883889:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296416
00010000:00010000:2.0:1789431570.891774:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352862c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.891793:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352862c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.891801:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352862c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.891808:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.891813:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352862c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.891820:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352862c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.891837:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90ce03149700)
00010000:00010000:2.0:1789431570.891841:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.891847:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352862c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.891854:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb6352862c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.891875:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528625 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.891883:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528625 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.891889:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528625 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.891894:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.891897:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528625 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.891902:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528625 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.891909:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x6e04e070 (ffff90ce03149500)
00010000:00010000:2.0:1789431570.891912:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.891915:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528625 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.891922:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528625 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.891934:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528633 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.891941:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528633 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.891946:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528633 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.891952:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.891955:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528633 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.892019:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528633 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.892029:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:2.0:1789431570.892032:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:2.0:1789431570.892035:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528633 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.892041:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528633 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.893022:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.893135:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933640448
00000100:00100000:2.0:1789431570.893150:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933640448
00000100:00100000:2.0:1789431570.893197:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296417
00000100:00100000:2.0:1789431570.893206:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14617:x1876351933640448:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.893226:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.893243:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528641 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9640 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893310:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528648 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893323:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528648 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893333:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528648 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893347:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352864f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893354:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352864f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893360:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352864f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893486:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528648 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893494:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528648 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893500:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528648 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893506:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.893510:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528648 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893520:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528648 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893529:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431570.893532:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.893535:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528648 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893541:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528648 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893556:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352864f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893562:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352864f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893567:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352864f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893572:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.893576:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352864f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893581:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352864f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893588:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90cf13195c00)
00010000:00010000:2.0:1789431570.893591:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.893594:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352864f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893599:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352864f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893639:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528641 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9640 expref: 229 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893650:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431570.893652:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.893655:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528641 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9640 expref: 229 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.893664:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523a00, rc 0)
00000100:00100000:2.0:1789431570.893861:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14617:x1876351933640448:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 655us (845us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431570.893868:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296417
00000100:00100000:0.0:1789431570.895578:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.895667:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933640576
00000100:00100000:3.0:1789431570.895702:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933640576
00000100:00100000:3.0:1789431570.895781:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296418
00000100:00100000:3.0:1789431570.895795:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14616:x1876351933640576:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431570.895832:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431570.895861:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528656 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9647 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.895969:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb6352865d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.896152:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528617 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9639 expref: 229 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.896163:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb6352865d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.896779:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528617 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9639 expref: 229 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.896800:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528617 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9639 expref: 229 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.896817:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf04828700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894262784:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431570.896940:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf055966c0 going to sleep for 11 seconds
00000100:00100000:2.0:1789431570.899485:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.900541:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933640704
00000100:00100000:1.0:1789431570.900556:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933640704
00000100:00100000:1.0:1789431570.900637:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296419
00000100:00100000:1.0:1789431570.900649:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14617:x1876351933640704:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431570.900670:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431570.900706:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528664 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c964e expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.900777:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352866b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.900790:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352866b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.900803:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352866b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431570.900839:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008c:0x0]: returning size 16384
00000004:00200000:1.0:1789431570.900844:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431570.900865:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352866b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.900880:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf04828700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894262784:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431570.900892:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528664 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c964e expref: 232 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.900918:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352866b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c964e expref: 231 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.900920:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb6352865d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.900954:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431570.900958:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431570.900962:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309a00, rc 0)
00000100:00100000:1.0:1789431570.901033:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14617:x1876351933640704:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 386us (1561us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431570.901041:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296419
00000100:00100000:2.0:1789431570.902710:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.903064:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933640832
00000100:00100000:1.0:1789431570.903080:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933640832
00010000:00010000:1.0:1789431570.903125:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528617 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9639 expref: 231 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.903163:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16753
00000100:00100000:1.0:1789431570.903173:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb5b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:2348:x1876351933640832:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431570.903188:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431570.903195:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528617 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9639 expref: 231 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.903208:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528617 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9639 expref: 231 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.903229:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528617 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9639 expref: 231 pid: 5847 timeout: 3128 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.903243:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:1.0:1789431570.903249:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb6352865d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.903259:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb6352865d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.903266:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb6352865d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.903297:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431570.903339:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb6352865d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.903354:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb6352865d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431570.903372:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb5b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:2348:x1876351933640832:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 198us (679us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431570.903381:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16753
00000004:00200000:2.0:1789431570.903423:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00000004:00200000:2.0:1789431570.903430:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431570.903459:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb6352865d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.903507:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528656 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9647 expref: 230 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.903531:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb6352865d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9647 expref: 229 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.903541:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:2.0:1789431570.903544:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431570.903548:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7aa00, rc 0)
00000100:00100000:2.0:1789431570.905126:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14616:x1876351933640576:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9321us (9541us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.905139:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296418
00000100:00100000:2.0:1789431570.906503:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431570.906597:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933640960
00000100:00100000:1.0:1789431570.906624:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933640960
00000100:00100000:1.0:1789431570.906706:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12582
00000100:00100000:1.0:1789431570.906717:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0776e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14617:x1876351933640960:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431570.913103:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.913520:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933641216
00000100:00100000:3.0:1789431570.913534:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933641216
00000100:00100000:3.0:1789431570.913742:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12583
00000100:00100000:3.0:1789431570.913758:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14616:x1876351933641216:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431570.913983:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0776e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14617:x1876351933640960:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 7259us (7482us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431570.913996:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12582
00000100:00100000:3.0:1789431570.914099:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14616:x1876351933641216:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 296us (962us total) trans 4295121220 rc 0/0
00000100:00100000:3.0:1789431570.914110:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12583
00000100:00100000:0.0:1789431570.919249:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.919395:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933641344
00000100:00100000:2.0:1789431570.919409:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933641344
00000100:00100000:2.0:1789431570.919483:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296420
00000100:00100000:2.0:1789431570.919495:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2a7ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14616:x1876351933641344:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.919523:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.919551:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528672 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9655 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.919633:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528679 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.919652:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528679 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.919666:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528679 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.919695:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528680 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.919703:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.919710:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.919847:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528687 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.919856:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.919863:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431570.919902:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00000004:00200000:2.0:1789431570.919907:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431570.919929:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.919941:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.919953:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528679 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.919960:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528679 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.919966:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528679 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.919972:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.919990:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528679 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.919998:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528679 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.920011:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431570.920015:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.920021:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528679 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.920027:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528679 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.920041:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.920081:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528680 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.920091:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528680 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.920098:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.920102:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528680 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.920109:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528680 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.920117:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90cf13195c00)
00010000:00010000:2.0:1789431570.920120:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.920123:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528680 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.920128:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528680 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.920163:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb63528672 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9655 expref: 232 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.920179:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528687 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9655 expref: 231 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.920187:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:2.0:1789431570.920189:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431570.920192:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523800, rc 0)
00000100:00100000:0.0:1789431570.920361:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2a7ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14616:x1876351933641344:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 865us (1122us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431570.920370:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296420
00000100:00100000:0.0:1789431570.924362:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.924487:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933641472
00000100:00100000:3.0:1789431570.924501:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933641472
00000100:00100000:3.0:1789431570.924584:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14392
00000100:00100000:3.0:1789431570.924606:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:2349:x1876351933641472:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431570.924627:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431570.924658:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528687 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9655 expref: 231 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.924690:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:3.0:1789431570.924698:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431570.924847:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:2349:x1876351933641472:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 253us (501us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.924855:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14392
00000100:00100000:1.0:1789431570.933127:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.933821:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.935540:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933641856
00000100:00100000:2.0:1789431570.935559:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933641856
00000100:00100000:2.0:1789431570.935628:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933641728
00000100:00100000:2.0:1789431570.935631:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933641728
00000100:00100000:2.0:1789431570.935668:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296421
00000100:00100000:2.0:1789431570.935841:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14616:x1876351933641856:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.935874:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.935901:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb6352868e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9663 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.935985:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528695 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936003:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936017:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936035:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352869c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936043:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352869c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936069:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352869c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936138:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936146:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528695 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936154:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528695 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936165:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.936170:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528695 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936178:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528695 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936193:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431570.936196:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.936202:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528695 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936368:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528695 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936384:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352869c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936391:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352869c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936398:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352869c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936404:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.936407:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352869c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936414:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352869c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936428:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x6e04e070 (ffff90cf13195c00)
00010000:00010000:2.0:1789431570.936431:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.936434:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352869c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936440:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352869c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936478:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb6352868e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9663 expref: 232 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936488:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431570.936491:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.936495:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb6352868e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9663 expref: 232 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.936505:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523a00, rc 0)
00000100:00100000:1.0:1789431570.936709:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296422
00000100:00100000:1.0:1789431570.936723:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14617:x1876351933641728:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431570.936736:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431570.936751:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635286a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c965c expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.936807:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14616:x1876351933641856:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1113us (3694us total) trans 0 rc 301/301
00010000:00010000:1.0:1789431570.936812:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635286aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.936816:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296421
00010000:00010000:1.0:1789431570.936823:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635286aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.936832:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635286aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.936846:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635286b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.936853:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635286b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.936859:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635286b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.936896:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635286aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.936902:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635286aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.936912:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635286aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.936917:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431570.936920:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635286aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.936926:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635286aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.936933:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431570.936935:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431570.936938:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635286aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.936943:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635286aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.936953:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635286b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.936958:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635286b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.936963:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635286b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.936967:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431570.936969:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635286b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.936978:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635286b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.936986:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90ce03149a00)
00010000:00010000:1.0:1789431570.936988:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431570.936991:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635286b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.936997:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635286b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.937025:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635286a3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c965c expref: 231 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.937033:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431570.937036:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:1.0:1789431570.937040:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635286a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c965c expref: 231 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431570.937090:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309c00, rc 0)
00000100:00100000:1.0:1789431570.937119:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14617:x1876351933641728:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 400us (3302us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431570.937125:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296422
00000100:00100000:0.0:1789431570.946950:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.951511:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.951924:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933641984
00000100:00100000:2.0:1789431570.951940:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933641984
00000100:00100000:2.0:1789431570.952011:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933642240
00000100:00100000:2.0:1789431570.952015:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933642240
00000100:00100000:2.0:1789431570.952067:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296423
00000100:00100000:2.0:1789431570.952080:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14616:x1876351933641984:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.952106:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00000100:00100000:3.0:1789431570.952127:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296424
00010000:00010000:2.0:1789431570.952135:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635286b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c966a expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.952139:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14617:x1876351933642240:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431570.952147:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431570.952150:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431570.952177:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352866b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c964e expref: 232 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.952208:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431570.952215:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431570.952224:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635286bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9671 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.952235:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635286c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.952251:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635286c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.952263:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635286c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431570.952312:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008d:0x0]: returning size 16384
00000004:00200000:2.0:1789431570.952316:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431570.952339:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635286c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.952347:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.952356:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.952363:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523a00/0xd8e438fb635286b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c966a expref: 233 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.952364:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.952379:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635286c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c966a expref: 232 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.952380:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635286d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.952388:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431570.952388:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635286d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.952391:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:2.0:1789431570.952393:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522c00, rc 0)
00010000:00010000:3.0:1789431570.952395:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635286d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.952472:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14616:x1876351933641984:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 395us (5537us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.952479:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296423
00000004:00080000:2.0:1789431570.953274:0:12181:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x51e:0x0], index 0: 0
00010000:00010000:2.0:1789431570.953479:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635286db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.953493:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635286db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.953506:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635286db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.953631:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.953640:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286cd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.953647:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.953654:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431570.953659:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.953668:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.953689:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431570.953692:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431570.953698:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286cd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.953705:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431570.953718:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000b59cb5f reply state 00000000641d149a transno 4295121221 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635286d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431570.953728:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431570.953766:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635286bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9671 expref: 233 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.953782:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635286db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9671 expref: 232 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.953790:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:3.0:1789431570.953792:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431570.953794:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522200, rc 0)
00000100:00100000:3.0:1789431570.953856:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14617:x1876351933642240:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1719us (2361us total) trans 4295121221 rc 0/0
00000100:00100000:3.0:1789431570.953865:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296424
00010000:00010000:2.0:1789431570.959341:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635286d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.959366:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635286d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.959376:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635286d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.959383:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.959389:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635286d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.959398:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635286d4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.959420:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90cf18b78d00)
00010000:00010000:2.0:1789431570.959423:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.959430:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635286d4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.959436:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635286d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.963742:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431570.964336:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.964425:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933642496
00000100:00100000:3.0:1789431570.964440:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933642496
00000100:00100000:3.0:1789431570.964523:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8438
00000100:00100000:3.0:1789431570.964534:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2347:x1876351933642496:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431570.964560:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431570.964589:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb635286e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x51e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9678 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789431570.964626:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x51e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1789431570.964654:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51e:0x0].0x0 since=3028s v=(0 0)
00010000:00010000:3.0:1789431570.964659:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431570.964672:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb635286e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9678 expref: 73 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.964713:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb635286e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9678 expref: 73 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.964729:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7bc00, rc 0)
00000100:00100000:3.0:1789431570.964807:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2347:x1876351933642496:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 275us (1080us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431570.964815:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8438
00000100:00100000:2.0:1789431570.965818:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933642368
00000100:00100000:2.0:1789431570.965830:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933642368
00000100:00100000:2.0:1789431570.965936:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12584
00000100:00100000:2.0:1789431570.965947:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14616:x1876351933642368:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431570.972227:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431570.973790:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933642624
00000100:00100000:3.0:1789431570.973811:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933642624
00000100:00100000:2.0:1789431570.974045:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8439
00000100:00100000:2.0:1789431570.974086:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:14617:x1876351933642624:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431570.974112:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431570.974140:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000183af3e7/0xd8e438fb635286f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x51e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c967f expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.974182:0:14497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb635286e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x51e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9678 expref: 74 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.974320:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51e:0x0].0x0 since=1s v=(0 0)
00010000:00010000:2.0:1789431570.974326:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431570.974334:0:14497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000183af3e7/0xd8e438fb635286f0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x51e:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c967f expref: 74 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.974380:0:14497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb635286e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9678 expref: 74 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.974397:0:14497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb635286e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x51e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9678 expref: 74 pid: 6698 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.974420:0:14497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce17f3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14497:1876351894262912:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431570.974668:0:14497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce0bd0bb40 going to sleep for 11 seconds
00000100:00100000:2.0:1789431570.978146:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14616:x1876351933642368:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 12186us (13798us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.978163:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12584
00000100:00100000:1.0:1789431570.983746:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.983820:0:14497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:14497:1876351894262912:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431570.983872:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000183af3e7/0xd8e438fb635286f0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x51e:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c967f expref: 74 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.983901:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523a00, rc 0)
00000100:00100000:1.0:1789431570.983923:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.983974:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:14617:x1876351933642624:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9891us (11762us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431570.983995:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8439
00000100:00100000:3.0:1789431570.984392:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933642880
00000100:00100000:3.0:1789431570.984402:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933642880
00000100:00100000:3.0:1789431570.984467:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296425
00000100:00100000:3.0:1789431570.984479:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14616:x1876351933642880:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431570.984502:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431570.984529:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635286f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9686 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984606:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984625:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984640:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984658:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528705 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984666:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984681:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984758:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984766:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984773:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984780:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431570.984785:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984794:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286fe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984807:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431570.984811:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431570.984817:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984823:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb635286fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984840:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984847:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528705 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984853:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528705 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984859:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431570.984861:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528705 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984867:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528705 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984886:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x6e04e070 (ffff90cf18b78500)
00010000:00010000:3.0:1789431570.984889:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431570.984892:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528705 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984900:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528705 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984937:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635286f7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9686 expref: 233 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984947:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431570.984949:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431570.984953:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb635286f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9686 expref: 233 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431570.984961:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7be00, rc 0)
00000100:00100000:3.0:1789431570.985015:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14616:x1876351933642880:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 537us (1091us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431570.985023:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296425
00000100:00100000:0.0:1789431570.987860:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933642752
00000100:00100000:0.0:1789431570.987883:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933642752
00010000:00010000:0.0:1789431570.987953:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb635286e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x51e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9678 expref: 74 pid: 6698 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.988090:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16754
00000100:00100000:0.0:1789431570.988103:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+74:2348:x1876351933642752:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431570.988123:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431570.988156:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb635286e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x51e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9678 expref: 74 pid: 6698 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.988173:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb635286e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9678 expref: 74 pid: 6698 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.988276:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037d3d30f/0xd8e438fb635286e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x51e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9678 expref: 74 pid: 6698 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.988302:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431570.988306:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431570.988315:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000183af3e7/0xd8e438fb635286f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c967f expref: 73 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.988327:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000183af3e7/0xd8e438fb635286f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x51e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c967f expref: 73 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431570.988378:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000183af3e7/0xd8e438fb635286f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x51e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c967f expref: 73 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431570.988396:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5834:1876351894263040:192.168.203.4@tcp:105:
00000100:00100000:0.0:1789431570.988689:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead240 going to sleep for 11 seconds
00000100:00100000:1.0:1789431570.989029:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431570.989140:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933643136
00000100:00100000:2.0:1789431570.989148:0:14483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933643136
00000100:00100000:2.0:1789431570.989223:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 525
00000100:00100000:2.0:1789431570.989233:0:14483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14616:x1876351933643136:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431570.989294:0:14483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431570.989318:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb6352865d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9647 expref: 232 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.989336:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:2.0:1789431570.989348:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb635286c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c966a expref: 231 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.989358:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431570.989362:0:14483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431570.989394:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352870c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.989408:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352870c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.989420:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352870c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.989437:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528713 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.989462:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528713 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.989469:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528713 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.989483:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352871a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.989491:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352871a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.989498:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352871a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.990126:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528721 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.990140:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528721 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.990148:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528721 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431570.990986:0:14483:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004de1596f reply state 00000000350a93ba transno 4295121222 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528721 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.991000:0:14483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:2.0:1789431570.991008:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352870c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.991015:0:14483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352870c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.991022:0:14483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352870c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.991028:0:14483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431570.991033:0:14483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352870c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.991041:0:14483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352870c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.991078:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431570.991082:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431570.991088:0:14483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352870c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431570.991098:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352870c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431570.991112:0:14483:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004de1596f reply state 00000000350a93ba transno 4295121222 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528713 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.991119:0:14483:0:(service.c:179:ptlrpc_save_lock()) nlocks 1
00000004:00010000:2.0:1789431570.991123:0:14483:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004de1596f reply state 00000000350a93ba transno 4295121222 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352871a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431570.991130:0:14483:0:(service.c:179:ptlrpc_save_lock()) nlocks 2
00000100:00100000:2.0:1789431571.001567:0:14483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14616:x1876351933643136:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 12317us (12522us total) trans 4295121222 rc 0/0
00000100:00100000:2.0:1789431571.001583:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 525
00000100:00100000:0.0:1789431571.006836:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.006960:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.007077:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933643520
00000100:00100000:3.0:1789431571.007090:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933643520
00000100:00100000:3.0:1789431571.007161:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12585
00000100:00100000:3.0:1789431571.007173:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14617:x1876351933643520:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431571.007241:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5834:1876351894263040:192.168.203.4@tcp:105:
00010000:00010000:2.0:1789431571.007273:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431571.007338:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2348:x1876351933642752:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 19239us (23676us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431571.007349:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16754
00000100:00100000:3.0:1789431571.009720:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14617:x1876351933643520:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 2533us (2744us total) trans 4295121223 rc 0/0
00000100:00100000:3.0:1789431571.009735:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12585
00000100:00100000:3.0:1789431571.009782:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933643264
00000100:00100000:3.0:1789431571.009791:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933643264
00000100:00100000:3.0:1789431571.009844:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296426
00000100:00100000:3.0:1789431571.009854:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14616:x1876351933643264:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431571.010001:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431571.010032:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528728 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c968d expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010132:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb6352872f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010151:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb6352872f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010165:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb6352872f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010178:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528736 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010188:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352871a lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010196:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528736 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010228:0:12775:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352871a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010240:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528736 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010339:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352871a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010350:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352871a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010358:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352871a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010365:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431571.010369:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352871a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010378:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352871a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010393:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90cf13195f00)
00010000:00010000:1.0:1789431571.010397:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431571.010400:0:3298:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528736 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010408:0:3298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010415:0:3298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528736 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010446:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352871a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010453:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb6352871a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010467:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528713 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010475:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528713 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010480:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528713 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010485:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431571.010487:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528713 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010493:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528713 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010500:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x6e04e070 (ffff90cf13195800)
00010000:00010000:1.0:1789431571.010502:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431571.010506:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528713 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010511:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528713 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010528:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528721 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010534:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528721 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010540:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528721 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010544:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431571.010547:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528721 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010552:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528721 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010559:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:1.0:1789431571.010561:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:1.0:1789431571.010564:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528721 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.010569:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528721 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010727:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010735:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010802:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb6352872f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010810:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb6352872f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010815:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb6352872f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010820:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.010823:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb6352872f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010828:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb6352872f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010836:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431571.010838:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.010842:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb6352872f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010847:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb6352872f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010858:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.010864:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528736 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.011022:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528736 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.011031:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.011035:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528736 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.011042:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528736 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.011080:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90cf13195f00)
00010000:00010000:3.0:1789431571.011083:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.011087:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528736 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.011093:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528736 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.011133:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528728 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c968d expref: 233 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.011144:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431571.011147:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.011150:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528728 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c968d expref: 233 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.011159:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7be00, rc 0)
00000100:00100000:3.0:1789431571.011227:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14616:x1876351933643264:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1373us (4405us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431571.011236:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296426
00000100:00100000:0.0:1789431571.022459:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.022552:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.022555:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933643776
00000100:00100000:2.0:1789431571.022568:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933643776
00000100:00100000:1.0:1789431571.022620:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933643904
00000100:00100000:1.0:1789431571.022626:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933643904
00000100:00100000:2.0:1789431571.022656:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296427
00000100:00100000:1.0:1789431571.022663:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296428
00000100:00100000:2.0:1789431571.022668:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14617:x1876351933643776:12345-192.168.203.4@tcp:101:dbench.0
00000100:00100000:1.0:1789431571.022669:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14616:x1876351933643904:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431571.022715:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431571.022748:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352873d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c969b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.022848:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528744 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.022867:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.022893:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431571.022945:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008d:0x0]: returning size 16384
00000004:00200000:1.0:1789431571.022949:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431571.022974:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.023005:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb6352873d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c969b expref: 235 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.023026:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528744 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c969b expref: 234 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.023037:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431571.023040:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431571.023045:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:1.0:1789431571.023169:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14616:x1876351933643904:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 499us (616us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431571.023178:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296428
00010000:00010000:2.0:1789431571.027146:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431571.027300:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352874b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9694 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.027465:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528752 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.027488:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635286db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9671 expref: 234 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.027498:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528752 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.027545:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635286db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9671 expref: 234 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.027567:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635286db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9671 expref: 234 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.027584:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894263168:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431571.027714:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead840 going to sleep for 11 seconds
00000100:00100000:0.0:1789431571.029024:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.033540:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933644032
00000100:00100000:3.0:1789431571.033556:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933644032
00000100:00100000:3.0:1789431571.033615:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12586
00000100:00100000:3.0:1789431571.033627:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14616:x1876351933644032:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:2.0:1789431571.037791:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894263168:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431571.037837:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528752 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431571.041035:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.041273:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933644160
00000100:00100000:0.0:1789431571.041384:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933644160
00010000:00010000:0.0:1789431571.041500:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635286db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9671 expref: 236 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.041592:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16755
00000100:00100000:0.0:1789431571.041604:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:2350:x1876351933644160:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431571.041622:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431571.041629:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635286db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9671 expref: 236 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.041642:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635286db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9671 expref: 236 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.041669:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635286db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9671 expref: 236 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.041762:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:0.0:1789431571.041770:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528752 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.041782:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528752 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.041791:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528752 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.041830:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431571.041966:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:2350:x1876351933644160:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 364us (948us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.041974:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16755
00010000:00010000:0.0:1789431571.042083:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528752 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.042092:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528752 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431571.042116:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00010000:00010000:0.0:1789431571.042382:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352874b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9694 expref: 236 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.042399:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528752 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9694 expref: 235 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.042406:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:0.0:1789431571.042409:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431571.042411:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3c00, rc 0)
00000100:00100000:0.0:1789431571.042494:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14617:x1876351933643776:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 19776us (20000us total) trans 4295121224 rc 0/0
00000100:00100000:0.0:1789431571.042503:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296427
00000100:00100000:2.0:1789431571.042571:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14616:x1876351933644032:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 8946us (13556us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431571.042581:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12586
00000100:00100000:0.0:1789431571.047232:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.047531:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933644288
00000100:00100000:2.0:1789431571.047544:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933644288
00000100:00100000:2.0:1789431571.047891:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296429
00000100:00100000:2.0:1789431571.047904:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14617:x1876351933644288:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431571.047940:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431571.047971:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528760 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c96a2 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.048124:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528767 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.048142:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528752 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9694 expref: 235 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.048153:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528767 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.048206:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528752 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9694 expref: 235 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.048222:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528752 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9694 expref: 235 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.048238:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce17f3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894263296:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431571.048350:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce0bd0bb40 going to sleep for 11 seconds
00000100:00100000:2.0:1789431571.052154:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894263296:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431571.052278:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528767 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.055418:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.055534:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431571.055730:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933644672
00000100:00100000:1.0:1789431571.055745:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933644672
00000100:00100000:3.0:1789431571.055764:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933644416
00000100:00100000:3.0:1789431571.055769:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933644416
00010000:00010000:3.0:1789431571.055803:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528752 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9694 expref: 237 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431571.055820:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296430
00000100:00100000:1.0:1789431571.055832:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+237:14616:x1876351933644672:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431571.055855:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00000100:00100000:3.0:1789431571.055884:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16756
00000100:00100000:3.0:1789431571.055893:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+237:2347:x1876351933644416:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431571.055911:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431571.055918:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528752 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9694 expref: 237 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.055933:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528752 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9694 expref: 237 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.055956:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352876e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c96a9 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.055959:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528752 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9694 expref: 237 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.056046:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:1.0:1789431571.056073:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528775 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056092:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528775 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056105:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528775 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056123:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352877c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056130:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352877c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056137:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352877c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.056174:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528767 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.056184:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.056198:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528767 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.056239:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431571.056271:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528775 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056278:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528775 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056297:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528775 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056304:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00000100:00100000:3.0:1789431571.056306:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+237:2347:x1876351933644416:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 413us (905us total) trans 0 rc 0/0
00010000:00010000:1.0:1789431571.056309:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528775 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.056314:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16756
00010000:00010000:1.0:1789431571.056319:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528775 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056332:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431571.056335:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431571.056340:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528775 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056346:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528775 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056358:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352877c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056363:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352877c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056368:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352877c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056373:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431571.056376:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352877c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056382:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352877c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056389:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce03149a00)
00010000:00010000:1.0:1789431571.056391:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431571.056394:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352877c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056400:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb6352877c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056562:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352876e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96a9 expref: 236 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056577:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431571.056580:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:1.0:1789431571.056584:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352876e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96a9 expref: 236 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.056594:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308c00, rc 0)
00000100:00100000:1.0:1789431571.056624:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14616:x1876351933644672:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 794us (1090us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431571.056631:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296430
00010000:00010000:2.0:1789431571.059091:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.059115:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431571.059184:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00000004:00200000:2.0:1789431571.059191:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431571.059478:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.059535:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528760 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96a2 expref: 235 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.059559:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528767 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96a2 expref: 234 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.059569:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:2.0:1789431571.059572:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431571.059577:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522c00, rc 0)
00000100:00100000:2.0:1789431571.059966:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14617:x1876351933644288:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12060us (12744us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431571.059977:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296429
00000100:00100000:0.0:1789431571.069186:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.069255:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933644928
00000100:00100000:2.0:1789431571.069269:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933644928
00000100:00100000:2.0:1789431571.069350:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296431
00000100:00100000:2.0:1789431571.069361:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14616:x1876351933644928:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431571.069388:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431571.069392:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:2.0:1789431571.069427:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528744 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c969b expref: 234 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.069461:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431571.069468:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431571.069487:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63528783 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c96b0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.069638:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb6352878a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.069656:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb6352878a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.069667:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb6352878a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.069833:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528791 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.069843:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.069852:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:2.0:1789431571.071348:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x51e:0x0], index 1: 0
00010000:00010000:2.0:1789431571.071919:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528798 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.071940:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.071954:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.071999:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb6352878a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.072008:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb6352878a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.072015:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb6352878a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.072022:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431571.072028:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb6352878a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.072037:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb6352878a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.072076:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431571.072080:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431571.072087:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb6352878a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.072100:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb6352878a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431571.072119:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e29693b9 reply state 000000009638cd91 transno 4295121225 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.072130:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:2.0:1789431571.072173:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63528783 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96b0 expref: 236 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.072190:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528798 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96b0 expref: 235 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.072198:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:2.0:1789431571.072201:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431571.072214:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522200, rc 0)
00000100:00100000:2.0:1789431571.072321:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14616:x1876351933644928:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2960us (3148us total) trans 4295121225 rc 0/0
00000100:00100000:2.0:1789431571.072332:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296431
00000100:00100000:3.0:1789431571.083328:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431571.083780:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933645056
00000100:00100000:1.0:1789431571.083796:0:14461:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933645056
00002000:00100000:1.0:1789431571.083881:0:14461:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x51e:0x0] (0->74833)  req@ffff90cf04829880 x1876351933645056/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:42/0 lens 488/0 e 0 to 0 dl 1789431582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431571.083894:0:14461:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf04829880 with x1876351933645056 ext(0->74833)
00002000:00010000:1.0:1789431571.083902:0:14461:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf04829880
00000100:00100000:1.0:1789431571.083940:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1583
00000100:00100000:1.0:1789431571.083953:0:14461:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2349:x1876351933645056:12345-192.168.203.4@tcp:4:dbench.0
00010000:00010000:2.0:1789431571.084350:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.084364:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528791 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.084374:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528791 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.084382:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431571.084388:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528791 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.084398:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528791 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.084419:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90cf13195900)
00010000:00010000:2.0:1789431571.084422:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431571.084428:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528791 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.084434:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528791 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00080000:3.0:1789431571.084564:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1789431571.085334:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.086405:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933645184
00000100:00100000:2.0:1789431571.086420:0:14464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933645184
00000100:00100000:2.0:1789431571.086511:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8440
00000100:00100000:2.0:1789431571.086524:0:14464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2348:x1876351933645184:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431571.086548:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431571.086576:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d1ee5d3/0xd8e438fb635287a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x51e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c96b7 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789431571.086613:0:14464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x51e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:2.0:1789431571.086640:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51e:0x0].0x0 since=3029s v=(0 0)
00010000:00010000:2.0:1789431571.086646:0:14464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431571.086657:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d1ee5d3/0xd8e438fb635287a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96b7 expref: 71 pid: 14464 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.086699:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d1ee5d3/0xd8e438fb635287a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96b7 expref: 71 pid: 14464 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.086714:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523600, rc 0)
00000100:00100000:2.0:1789431571.086783:0:14464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2348:x1876351933645184:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 262us (1455us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431571.086791:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8440
00000100:00100000:2.0:1789431571.091651:0:14461:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+75:2349:x1876351933645056:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 7686us (8324us total) trans 4294969684 rc 0/0
00000100:00100000:2.0:1789431571.091669:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1583
00002000:00100000:2.0:1789431571.091697:0:14461:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x51e:0x0] (0->74833)  req@ffff90cf04829880 x1876351933645056/t4294969684(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:42/0 lens 488/448 e 0 to 0 dl 1789431582 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1789431571.091709:0:14461:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf04829880 with x1876351933645056 ext(0->74833)
00002000:00010000:2.0:1789431571.091717:0:14461:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf04829880
00000100:00100000:3.0:1789431571.099015:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.100870:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.101961:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933645312
00000100:00100000:0.0:1789431571.101978:0:14505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933645312
00000100:00100000:0.0:1789431571.102125:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8441
00000100:00100000:0.0:1789431571.102139:0:14505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:14616:x1876351933645312:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431571.102163:0:14505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431571.102189:0:14505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045a58ac0/0xd8e438fb635287ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x51e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c96be expref: -99 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.102241:0:14505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d1ee5d3/0xd8e438fb635287a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x51e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96b7 expref: 72 pid: 14464 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.102252:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431571.102257:0:14505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431571.102263:0:14505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045a58ac0/0xd8e438fb635287ad lrc: 4/0,0 mode: --/PW res: [0x280000400:0x51e:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96be expref: 72 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.102307:0:14505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d1ee5d3/0xd8e438fb635287a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96b7 expref: 72 pid: 14464 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.102323:0:14505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d1ee5d3/0xd8e438fb635287a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x51e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96b7 expref: 72 pid: 14464 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.102339:0:14505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:14505:1876351894263424:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431571.102494:0:14505:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead840 going to sleep for 11 seconds
00000100:00100000:2.0:1789431571.102640:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933645440
00000100:00100000:2.0:1789431571.102646:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933645440
00000100:00100000:2.0:1789431571.102710:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296432
00000100:00100000:2.0:1789431571.102719:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14617:x1876351933645440:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:3.0:1789431571.118292:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.118525:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933645568
00000100:00100000:0.0:1789431571.118535:0:14505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:14505:1876351894263424:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431571.118538:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933645568
00010000:00010000:0.0:1789431571.118593:0:14505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000045a58ac0/0xd8e438fb635287ad lrc: 3/0,0 mode: --/PW res: [0x280000400:0x51e:0x0].0x0 rrc: 4 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96be expref: 73 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.118594:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d1ee5d3/0xd8e438fb635287a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x51e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96b7 expref: 73 pid: 14464 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.118667:0:14505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3e00, rc 0)
00000100:00100000:3.0:1789431571.118690:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16757
00000100:00100000:3.0:1789431571.118702:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+73:2348:x1876351933645568:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431571.118715:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431571.118741:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d1ee5d3/0xd8e438fb635287a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x51e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96b7 expref: 73 pid: 14464 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.118756:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d1ee5d3/0xd8e438fb635287a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96b7 expref: 73 pid: 14464 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.118781:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d1ee5d3/0xd8e438fb635287a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x51e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96b7 expref: 73 pid: 14464 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.118945:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431571.118950:0:14498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431571.118962:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000045a58ac0/0xd8e438fb635287ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96be expref: 72 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.119045:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045a58ac0/0xd8e438fb635287ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x51e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96be expref: 72 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.119099:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:14616:x1876351933645312:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 16912us (20049us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.119130:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8441
00010000:00010000:3.0:1789431571.119171:0:14498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000045a58ac0/0xd8e438fb635287ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x51e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96be expref: 71 pid: 14505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.119189:0:14498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac75c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:14498:1876351894263552:192.168.203.4@tcp:105:
00000100:00100000:3.0:1789431571.119256:0:14498:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf05596000 going to sleep for 11 seconds
00000100:00100000:3.0:1789431571.132260:0:14498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac75c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:14498:1876351894263552:192.168.203.4@tcp:105:
00010000:00010000:3.0:1789431571.133520:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431571.133603:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2348:x1876351933645568:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 14897us (15325us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.133617:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16757
00000100:00100000:0.0:1789431571.145488:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431571.146620:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933645824
00000100:00100000:1.0:1789431571.146638:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933645824
00000100:00100000:1.0:1789431571.146734:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12587
00000100:00100000:1.0:1789431571.146747:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0776c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14616:x1876351933645824:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431571.148723:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0776c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+237:14616:x1876351933645824:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 1964us (3239us total) trans 4295121226 rc 0/0
00000100:00100000:1.0:1789431571.148740:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12587
00000100:00100000:2.0:1789431571.155343:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431571.155488:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933646080
00000100:00100000:1.0:1789431571.155507:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933646080
00000100:00100000:1.0:1789431571.155595:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296433
00000100:00100000:1.0:1789431571.155606:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+237:14616:x1876351933646080:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431571.155635:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431571.155663:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635287b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c96c5 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.156029:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.156078:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528798 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96b0 expref: 238 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.156089:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287bb lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.156136:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528798 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96b0 expref: 238 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.156153:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528798 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96b0 expref: 238 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431571.156168:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894263680:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431571.156278:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3ba39600 going to sleep for 11 seconds
00000100:00100000:0.0:1789431571.159988:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431571.160166:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894263680:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431571.160208:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.161353:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933646208
00000100:00100000:2.0:1789431571.161366:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933646208
00010000:00010000:2.0:1789431571.161419:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528798 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96b0 expref: 239 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.161510:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16758
00000100:00100000:2.0:1789431571.161522:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+239:2347:x1876351933646208:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431571.161545:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431571.161554:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528798 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96b0 expref: 239 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.161570:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528798 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96b0 expref: 239 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.161597:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528798 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96b0 expref: 239 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.161618:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:2.0:1789431571.161624:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.161636:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.161646:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287bb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.161793:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431571.161862:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+238:2347:x1876351933646208:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 342us (1890us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431571.161882:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16758
00010000:00010000:0.0:1789431571.162019:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.162031:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431571.162076:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00000001:00080000:1.0:1789431571.162822:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121224 is committed
00000001:00080000:1.0:1789431571.162866:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4295121225 is committed
00000004:00080000:1.0:1789431571.162965:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 371 committed
00000100:00100000:3.0:1789431571.163415:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2a7e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894263808:0@lo:6:osp-syn-1-0.0
00000100:00100000:3.0:1789431571.163496:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789431571.163576:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894263808
00000100:00100000:3.0:1789431571.163585:0:14472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894263808
00000100:00100000:3.0:1789431571.163661:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8442
00000100:00100000:3.0:1789431571.163682:0:14472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3313:x1876351894263808:12345-0@lo:6:osp-syn-1-0.0
00002000:00080000:3.0:1789431571.163712:0:14472:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1309 count 1
00010000:00010000:3.0:1789431571.163738:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb635287c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x51d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.163761:0:14472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb6352857d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x51d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c960f expref: 70 pid: 14471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.163770:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51d:0x0].0x0 since=1s v=(0 0)
00010000:00010000:3.0:1789431571.163776:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51d:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789431571.163780:0:14472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb635287c9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x51d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.163812:0:14472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb6352857d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c960f expref: 70 pid: 14471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.163826:0:14472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb6352857d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x51d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c960f expref: 70 pid: 14471 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.163837:0:14472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1ac77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14472:1876351894263936:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431571.163896:0:14472:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf05596000 going to sleep for 11 seconds
00000100:00100000:1.0:1789431571.165578:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933645440:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 62846us (64707us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431571.165594:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296432
00010000:00010000:0.0:1789431571.165852:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635287b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96c5 expref: 199 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.165960:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96c5 expref: 198 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.165971:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:0.0:1789431571.165974:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431571.165979:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309a00, rc 0)
00000100:00100000:0.0:1789431571.166009:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14616:x1876351933646080:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10406us (10676us total) trans 4295121227 rc 0/0
00000100:00100000:0.0:1789431571.166016:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296433
00000100:00080000:2.0:1789431571.166318:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1789431571.172404:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.172610:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933646336
00000100:00100000:2.0:1789431571.172624:0:14491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933646336
00000100:00100000:2.0:1789431571.172700:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8443
00000100:00100000:2.0:1789431571.172713:0:14491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+75:2348:x1876351933646336:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:0.0:1789431571.173027:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.173069:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933646464
00000100:00100000:0.0:1789431571.173074:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933646464
00000100:00100000:0.0:1789431571.173114:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296434
00000100:00100000:0.0:1789431571.173124:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14616:x1876351933646464:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431571.173144:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431571.173172:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635287d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c96cc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.173271:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635287d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.173289:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287bb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96c5 expref: 199 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.173299:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635287d7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.173341:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96c5 expref: 199 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.173355:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96c5 expref: 199 pid: 6797 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.173371:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894264064:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431571.173472:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead840 going to sleep for 11 seconds
00000100:00100000:3.0:1789431571.183636:0:14472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1ac77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14472:1876351894263936:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431571.183665:0:14472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb635287c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x51d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.183974:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.184169:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.184214:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894264064:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431571.184239:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635287d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.184428:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933646592
00000100:00100000:2.0:1789431571.184437:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933646592
00010000:00010000:2.0:1789431571.184474:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb6352857d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x51d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c960f expref: 71 pid: 14471 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.184499:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933646720
00000100:00100000:2.0:1789431571.184502:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933646720
00010000:00010000:2.0:1789431571.184514:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96c5 expref: 200 pid: 6797 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.184532:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16759
00000100:00100000:2.0:1789431571.184597:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb58850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2347:x1876351933646592:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431571.184613:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:3.0:1789431571.184613:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16760
00010000:00010000:2.0:1789431571.184618:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb6352857d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x51d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c960f expref: 71 pid: 14471 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.184621:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:2349:x1876351933646720:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431571.184629:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431571.184631:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb6352857d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c960f expref: 71 pid: 14471 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.184634:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96c5 expref: 200 pid: 6797 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.184643:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96c5 expref: 200 pid: 6797 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.184656:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96c5 expref: 200 pid: 6797 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.184678:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431571.184684:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635287d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.184695:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635287d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.184713:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635287d7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.184736:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431571.184757:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f7fd317/0xd8e438fb6352857d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x51d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c960f expref: 71 pid: 14471 timeout: 3129 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.184771:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51d:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431571.184776:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51d:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789431571.184780:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb635287c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x51d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.184784:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:2349:x1876351933646720:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 164us (617us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.184792:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16760
00010000:00010000:2.0:1789431571.184795:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb635287c9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x51d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.184817:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431571.184823:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635287d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.184830:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635287d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.184836:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb58850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2347:x1876351933646592:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 297us (863us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431571.184841:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16759
00000004:00200000:3.0:1789431571.184874:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00000004:00200000:3.0:1789431571.184878:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431571.184899:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635287d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.184930:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635287d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96cc expref: 199 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.184945:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635287d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96cc expref: 198 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.184952:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431571.184956:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431571.184959:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3200, rc 0)
00000100:00100000:3.0:1789431571.184992:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14616:x1876351933646464:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11869us (11966us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.185000:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296434
00010000:00010000:3.0:1789431571.186900:0:14472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb635287c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x51d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.186918:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb635287c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x51d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.186930:0:14472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb635287c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x51d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.186942:0:14472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb635287c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.186967:0:14472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:3.0:1789431571.187412:0:14472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3313:x1876351894263808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23738us (23912us total) trans 4294970086 rc 0/0
00000100:00100000:3.0:1789431571.187421:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8442
00010000:00010000:3.0:1789431571.187457:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431571.187463:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb635287c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.187471:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431571.187475:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb635287c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.187484:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb635287c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x51d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.187501:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb635287c9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x51d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.187509:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013cff579/0xd8e438fb635287c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x51d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.187526:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431571.187529:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431571.187530:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789431571.187563:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294970078 gen 2
00000004:00080000:3.0:1789431571.187569:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2e82a680, transno 4294970076
00000004:00080000:3.0:1789431571.187579:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2e828700, transno 4294970077
00000004:00080000:3.0:1789431571.187582:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2e82ad80, transno 4294970078
00000100:00100000:3.0:1789431571.187589:0:3313:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search  req@ffff90ce2a7e9180 x1876351894263808/t4294970086(4294970086) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789431587 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295
00000004:00080000:3.0:1789431571.187599:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce2a7e9180/2, rc 0, transno 4294970086
00000100:00100000:3.0:1789431571.187604:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2a7e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894263808:0@lo:6:osp-syn-1-0.0
00000004:00080000:3.0:1789431571.187753:0:8062:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 1 in progress, 0 in flight, 3 done
00000100:00100000:0.0:1789431571.199823:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431571.199924:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933646848
00000100:00100000:1.0:1789431571.199935:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933646848
00002000:00100000:1.0:1789431571.199983:0:14439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x51e:0x0] (0->74833)  req@ffff90cf3b3b2680 x1876351933646848/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:42/0 lens 488/0 e 0 to 0 dl 1789431582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431571.199994:0:14439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3b3b2680 with x1876351933646848 ext(0->74833)
00002000:00010000:1.0:1789431571.200000:0:14439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3b3b2680
00000100:00100000:1.0:1789431571.200029:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1584
00000100:00100000:1.0:1789431571.200039:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2348:x1876351933646848:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:1.0:1789431571.216021:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2348:x1876351933646848:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 15973us (16197us total) trans 4294970087 rc 0/0
00000100:00100000:1.0:1789431571.216036:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1584
00002000:00100000:1.0:1789431571.216068:0:14439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x51e:0x0] (0->74833)  req@ffff90cf3b3b2680 x1876351933646848/t4294970087(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:42/0 lens 488/448 e 0 to 0 dl 1789431582 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1789431571.216080:0:14439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3b3b2680 with x1876351933646848 ext(0->74833)
00002000:00010000:1.0:1789431571.216087:0:14439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3b3b2680
00000001:00080000:1.0:1789431571.232157:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969679 is committed
00000001:00080000:1.0:1789431571.232186:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969680 is committed
00000001:00080000:1.0:1789431571.232630:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969684 is committed
00000001:00080000:1.0:1789431571.232641:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969683 is committed
00000100:00100000:2.0:1789431571.234661:0:14491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+66:2348:x1876351933646336:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 61932us (62780us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431571.234688:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8443
00000100:00100000:0.0:1789431571.234716:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431571.235085:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933646976
00000100:00100000:1.0:1789431571.235100:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933646976
00000100:00100000:1.0:1789431571.235169:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296435
00000100:00100000:1.0:1789431571.235180:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14616:x1876351933646976:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:1.0:1789431571.235349:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14616:x1876351933646976:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 169us (641us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431571.235356:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296435
00000100:00100000:2.0:1789431571.246593:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.246658:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.246751:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933647232
00000100:00100000:0.0:1789431571.246767:0:14502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933647232
00000100:00100000:1.0:1789431571.246867:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933647104
00000100:00100000:0.0:1789431571.246875:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8444
00000100:00100000:1.0:1789431571.246880:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933647104
00000100:00100000:0.0:1789431571.246892:0:14502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2350:x1876351933647232:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:1.0:1789431571.246944:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296436
00000100:00100000:1.0:1789431571.246957:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933647104:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431571.246979:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431571.247007:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635287de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c96d3 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.247118:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635287e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.247136:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635287e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.247150:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635287e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.247173:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.247180:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.247187:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.248591:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635287f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.248765:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635287f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.248776:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635287f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431571.248834:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00000004:00200000:1.0:1789431571.248840:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431571.248868:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635287f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.248880:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635287f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.248894:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635287e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.248902:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635287e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.248915:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635287e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.248922:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431571.248927:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635287e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.248936:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635287e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.248948:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431571.248951:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431571.248957:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635287e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.248963:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635287e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.248979:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.248985:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.249496:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.249503:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431571.249507:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.249519:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.249533:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90ce03149c00)
00010000:00010000:1.0:1789431571.249536:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431571.249539:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.249546:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635287ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.250704:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635287de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96d3 expref: 200 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.250737:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635287f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96d3 expref: 199 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.250746:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:1.0:1789431571.250749:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431571.250752:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308c00, rc 0)
00000100:00100000:1.0:1789431571.250846:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933647104:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 3889us (4267us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431571.250857:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296436
00000100:00100000:3.0:1789431571.259990:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.260489:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933647488
00000100:00100000:2.0:1789431571.260508:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933647488
00000100:00100000:2.0:1789431571.260578:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296437
00000100:00100000:2.0:1789431571.260590:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933647488:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431571.260642:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431571.260668:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb635287f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96d3 expref: 199 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.260703:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528767 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96a2 expref: 198 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.260714:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90cf13195c00)
00010000:00010000:2.0:1789431571.260724:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431571.260769:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635287fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.260782:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635287fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.260803:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635287fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431571.261028:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000daeaa9c3 reply state 0000000079457310 transno 4295121228 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635287fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.261038:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:2.0:1789431571.261162:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933647488:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 574us (1187us total) trans 4295121228 rc 0/0
00000100:00100000:2.0:1789431571.261170:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296437
00010000:00010000:3.0:1789431571.264109:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635287fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.264132:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635287fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.264140:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635287fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.264147:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.264153:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635287fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.264162:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635287fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.264182:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90cf13195400)
00010000:00010000:3.0:1789431571.264185:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.264192:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635287fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.264198:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb635287fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431571.268991:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.269693:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933647616
00000100:00100000:3.0:1789431571.269710:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933647616
00000100:00100000:3.0:1789431571.269798:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296438
00000100:00100000:3.0:1789431571.269815:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+198:14617:x1876351933647616:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431571.269851:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431571.269884:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528801 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c96da expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.271200:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528801 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96da expref: 199 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.271235:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7be00/0xd8e438fb63528801 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96da expref: 199 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.271262:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:0.0:1789431571.271265:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00010000:0.0:1789431571.271269:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7be00, rc 0)
00000100:00100000:0.0:1789431571.271350:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933647616:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1541us (2374us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.271359:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296438
00000100:00100000:3.0:1789431571.278279:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.280195:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933647744
00000100:00100000:2.0:1789431571.280210:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933647744
00000100:00100000:2.0:1789431571.280280:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8445
00000100:00100000:2.0:1789431571.280292:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1ac77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+66:2348:x1876351933647744:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:2.0:1789431571.280525:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x51e:0x0] updating lvb size from disk: 0 -> 74834
00002000:00010000:2.0:1789431571.280529:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x51e:0x0] updating lvb mtime from disk: 0 -> 1789431558
00002000:00010000:2.0:1789431571.280532:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x51e:0x0] updating lvb atime from disk: 0 -> 1789431560
00002000:00010000:2.0:1789431571.280534:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x51e:0x0] updating lvb ctime from disk: 0 -> 1789431570
00002000:00010000:2.0:1789431571.280535:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x51e:0x0] updating lvb blocks from disk: 1 -> 259
00000100:00100000:2.0:1789431571.280605:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1ac77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2348:x1876351933647744:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 315us (2339us total) trans 4294969685 rc 0/0
00000100:00100000:2.0:1789431571.280613:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8445
00000100:00100000:1.0:1789431571.285557:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.285667:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933648000
00000100:00100000:0.0:1789431571.285686:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933648000
00000100:00100000:0.0:1789431571.287209:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296439
00000100:00100000:0.0:1789431571.287226:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933648000:12345-192.168.203.4@tcp:55:dbench.0
00010000:00010000:0.0:1789431571.287294:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528808 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.287311:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528808 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.287323:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528808 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.287348:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528808 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.287355:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528808 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.287362:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528808 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.287368:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431571.287373:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528808 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.287380:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528808 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.287392:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:0.0:1789431571.287395:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:0.0:1789431571.287400:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528808 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.287406:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528808 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.287477:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933648000:12345-192.168.203.4@tcp:55:dbench.0 Request processed in 258us (1926us total) trans 0 rc -22/-22
00000100:00100000:0.0:1789431571.287486:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296439
00000100:00100000:1.0:1789431571.312482:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.312929:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933648128
00000100:00100000:3.0:1789431571.312940:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933648128
00002000:00100000:3.0:1789431571.312988:0:14449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x51e:0x0] (0->4095)  req@ffff90cf37e3df80 x1876351933648128/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:42/0 lens 4584/0 e 0 to 0 dl 1789431582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431571.313000:0:14449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e3df80 with x1876351933648128 ext(0->4095)
00002000:00010000:3.0:1789431571.313005:0:14449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf37e3df80
00000100:00100000:3.0:1789431571.313039:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1585
00000100:00100000:3.0:1789431571.313074:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2349:x1876351933648128:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:3.0:1789431571.313536:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2349:x1876351933648128:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 486us (1061us total) trans 4294969686 rc 0/0
00000100:00100000:3.0:1789431571.313544:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1585
00002000:00100000:3.0:1789431571.313552:0:14449:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x51e:0x0] (0->4095)  req@ffff90cf37e3df80 x1876351933648128/t4294969686(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:42/0 lens 4584/448 e 0 to 0 dl 1789431582 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431571.313560:0:14449:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e3df80 with x1876351933648128 ext(0->4095)
00002000:00010000:3.0:1789431571.313564:0:14449:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf37e3df80
00000001:00080000:0.0:1789431571.321994:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970087 is committed
00000001:00080000:0.0:1789431571.322020:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970086 is committed
00000100:00100000:0.0:1789431571.323161:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.323252:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933648256
00000100:00100000:3.0:1789431571.323262:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933648256
00000100:00100000:3.0:1789431571.323321:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296440
00000100:00100000:3.0:1789431571.323332:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933648256:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:3.0:1789431571.323457:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14617:x1876351933648256:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 126us (302us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.323463:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296440
00000100:00100000:2.0:1789431571.325079:0:14502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2350:x1876351933647232:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 78162us (78389us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431571.325091:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8444
00000100:00100000:0.0:1789431571.338510:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.338605:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.338774:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933648384
00000100:00100000:3.0:1789431571.338784:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933648384
00000100:00100000:3.0:1789431571.338843:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8446
00000100:00100000:3.0:1789431571.338855:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2348:x1876351933648384:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:2.0:1789431571.342092:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933648512
00000100:00100000:2.0:1789431571.342111:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933648512
00000100:00100000:2.0:1789431571.342177:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296441
00000100:00100000:2.0:1789431571.342187:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+199:14616:x1876351933648512:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431571.342207:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431571.342226:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352880f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c96e1 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342285:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528816 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342300:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528816 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342312:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528816 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342325:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352881d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342333:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352881d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342340:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352881d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342555:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342568:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342576:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431571.342611:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00000004:00200000:2.0:1789431571.342616:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431571.342635:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342645:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342651:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528816 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342658:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528816 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342664:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528816 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342680:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431571.342685:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528816 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342693:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528816 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342704:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431571.342707:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431571.342712:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528816 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342718:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528816 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342730:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352881d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342736:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352881d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342741:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352881d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342747:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431571.342750:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352881d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342755:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352881d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342762:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90cf13195c00)
00010000:00010000:2.0:1789431571.342764:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431571.342767:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352881d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342772:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb6352881d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342798:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352880f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96e1 expref: 201 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342811:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96e1 expref: 200 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.342818:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:2.0:1789431571.342820:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431571.342822:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522e00, rc 0)
00000100:00100000:2.0:1789431571.342893:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14616:x1876351933648512:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 706us (4286us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431571.342900:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296441
00000100:00100000:1.0:1789431571.358353:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431571.358396:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.358481:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933648896
00000100:00100000:2.0:1789431571.358491:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933648896
00000100:00100000:2.0:1789431571.358549:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296442
00000100:00100000:2.0:1789431571.358559:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14616:x1876351933648896:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:2.0:1789431571.358608:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431571.358633:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635287d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96cc expref: 200 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.358651:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:2.0:1789431571.358655:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431571.358712:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352882b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.358726:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528824 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96e1 expref: 199 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.358734:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352882b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.358769:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96e1 expref: 199 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.358782:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528824 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96e1 expref: 199 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.358796:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce17f3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894264192:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431571.358885:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3e6d1780 going to sleep for 11 seconds
00000100:00100000:3.0:1789431571.359174:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933648640
00000100:00100000:3.0:1789431571.359179:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933648640
00010000:00010000:3.0:1789431571.359202:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528824 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96e1 expref: 200 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.359231:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16761
00000100:00100000:3.0:1789431571.359239:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:2347:x1876351933648640:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431571.359248:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431571.359253:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528824 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96e1 expref: 200 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.359265:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528824 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96e1 expref: 200 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.359279:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431571.359283:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352882b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.359290:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352882b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.359297:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352882b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.359312:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431571.359350:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:2347:x1876351933648640:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 112us (1006us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.359357:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16761
00010000:00010000:3.0:1789431571.364220:0:12775:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@00000000f8c5dd42 x1876351894264192) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528824 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96e1 expref: 199 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.364244:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528824 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96e1 expref: 199 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.364261:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce17f3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894264192:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431571.364284:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431571.364293:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352882b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.364302:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352882b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.364309:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352882b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431571.364464:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000972e08b reply state 000000000a07ffbd transno 4295121229 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352882b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.364471:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431571.364582:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14616:x1876351933648896:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 6023us (6183us total) trans 4295121229 rc 0/0
00000100:00100000:3.0:1789431571.364592:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296442
00000100:00100000:2.0:1789431571.381518:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.381550:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933649024
00000100:00100000:2.0:1789431571.381560:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933649024
00000100:00100000:2.0:1789431571.381607:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296443
00000100:00100000:2.0:1789431571.381616:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14616:x1876351933649024:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431571.381638:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431571.381657:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528832 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c96e8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.381726:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528832 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96e8 expref: 201 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.381740:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523800/0xd8e438fb63528832 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96e8 expref: 201 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.381760:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:2.0:1789431571.381763:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00010000:2.0:1789431571.381768:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523800, rc 0)
00000100:00100000:2.0:1789431571.381814:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:14616:x1876351933649024:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 199us (305us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431571.381820:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296443
00010000:00010000:3.0:1789431571.381992:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352882b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.382001:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352882b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.382009:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352882b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.382016:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.382020:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352882b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.382028:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352882b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.382040:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431571.382042:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.382046:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352882b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.382288:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb6352882b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.393714:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.393831:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933649152
00000100:00100000:0.0:1789431571.393841:0:14499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933649152
00000100:00100000:0.0:1789431571.393918:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8447
00000100:00100000:0.0:1789431571.393929:0:14499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce17f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2348:x1876351933649152:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:0.0:1789431571.394185:0:14499:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x51e:0x0] updating lvb size from disk: 0 -> 74834
00002000:00010000:0.0:1789431571.394190:0:14499:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x51e:0x0] updating lvb mtime from disk: 0 -> 1789431558
00002000:00010000:0.0:1789431571.394192:0:14499:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x51e:0x0] updating lvb atime from disk: 0 -> 1789431560
00002000:00010000:0.0:1789431571.394194:0:14499:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x51e:0x0] updating lvb ctime from disk: 0 -> 1789431570
00002000:00010000:0.0:1789431571.394196:0:14499:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x51e:0x0] updating lvb blocks from disk: 1 -> 259
00000100:00100000:0.0:1789431571.394250:0:14499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce17f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2348:x1876351933649152:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 323us (546us total) trans 4294970088 rc 0/0
00000100:00100000:0.0:1789431571.394259:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8447
00000100:00100000:2.0:1789431571.411442:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.411561:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933649408
00000100:00100000:3.0:1789431571.411576:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933649408
00000100:00100000:3.0:1789431571.411685:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296444
00000100:00100000:3.0:1789431571.411708:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce20fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14616:x1876351933649408:12345-192.168.203.4@tcp:55:dbench.0
00010000:00010000:3.0:1789431571.411825:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528839 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.411853:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.411871:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.411921:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.411931:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528839 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.411939:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528839 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.411948:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.411954:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528839 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.411964:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528839 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.411983:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431571.411986:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:3.0:1789431571.411994:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528839 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.412002:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528839 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.412177:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce20fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14616:x1876351933649408:12345-192.168.203.4@tcp:55:dbench.0 Request processed in 478us (746us total) trans 0 rc -22/-22
00000100:00100000:3.0:1789431571.412186:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296444
00000100:00100000:3.0:1789431571.424356:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.424587:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933649536
00000100:00100000:0.0:1789431571.424606:0:14532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933649536
00002000:00100000:0.0:1789431571.424693:0:14532:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x51e:0x0] (0->4095)  req@ffff90cf37e96300 x1876351933649536/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:42/0 lens 4584/0 e 0 to 0 dl 1789431582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431571.424707:0:14532:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e96300 with x1876351933649536 ext(0->4095)
00002000:00010000:0.0:1789431571.424715:0:14532:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf37e96300
00000100:00100000:0.0:1789431571.424761:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1586
00000100:00100000:0.0:1789431571.424774:0:14532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2348:x1876351933649536:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:0.0:1789431571.426173:0:14532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2348:x1876351933649536:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 1386us (1810us total) trans 4294970089 rc 0/0
00000100:00100000:0.0:1789431571.426449:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1586
00002000:00100000:0.0:1789431571.426471:0:14532:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x51e:0x0] (0->4095)  req@ffff90cf37e96300 x1876351933649536/t4294970089(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:42/0 lens 4584/448 e 0 to 0 dl 1789431582 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1789431571.426483:0:14532:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf37e96300 with x1876351933649536 ext(0->4095)
00002000:00010000:0.0:1789431571.426492:0:14532:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf37e96300
00000100:00100000:3.0:1789431571.430543:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431571.430627:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933649664
00000100:00100000:1.0:1789431571.430638:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933649664
00000100:00100000:1.0:1789431571.430701:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296445
00000100:00100000:1.0:1789431571.430711:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14616:x1876351933649664:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:1.0:1789431571.431239:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14616:x1876351933649664:12345-192.168.203.4@tcp:44:dbench.0 Request processed in 528us (705us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431571.431248:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296445
00000001:00080000:1.0:1789431571.434846:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969685 is committed
00000001:00080000:1.0:1789431571.434868:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969686 is committed
00000100:00100000:0.0:1789431571.435020:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+66:2348:x1876351933648384:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 96163us (96515us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.435030:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8446
00000100:00100000:3.0:1789431571.438695:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431571.438838:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933649792
00000100:00100000:1.0:1789431571.438849:0:14501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933649792
00000100:00100000:1.0:1789431571.438906:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8448
00000100:00100000:1.0:1789431571.438917:0:14501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2348:x1876351933649792:12345-192.168.203.4@tcp:16:dbench.0
00000100:00100000:0.0:1789431571.444407:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.445022:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933650048
00000100:00100000:3.0:1789431571.445032:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933650048
00000100:00100000:3.0:1789431571.445110:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12588
00000100:00100000:3.0:1789431571.445121:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+200:14617:x1876351933650048:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431571.445453:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:14617:x1876351933650048:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 333us (1052us total) trans 4295121230 rc 0/0
00000100:00100000:3.0:1789431571.445461:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12588
00000100:00100000:2.0:1789431571.453940:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.454081:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933650176
00000100:00100000:0.0:1789431571.454091:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933650176
00000100:00100000:0.0:1789431571.454146:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296446
00000100:00100000:0.0:1789431571.454156:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+201:14617:x1876351933650176:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431571.454180:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431571.454199:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63528840 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c96ef expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.454421:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528847 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.454436:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528847 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.454447:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528847 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.454463:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352884e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.454471:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352884e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.454477:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352884e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.454900:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528855 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.454910:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.454917:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431571.454949:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00000004:00200000:0.0:1789431571.454953:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431571.454971:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.454983:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.454991:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528847 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.454997:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528847 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.455278:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528847 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.455286:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431571.455290:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528847 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.455298:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528847 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.455309:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431571.455312:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431571.455317:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528847 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.455324:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528847 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.455335:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352884e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.455340:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352884e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.455346:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352884e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.455351:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431571.455354:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352884e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.455363:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352884e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.455370:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90ce07190000)
00010000:00010000:0.0:1789431571.455373:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431571.455376:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352884e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.455382:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb6352884e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.455416:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63528840 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96ef expref: 203 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.455429:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528855 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96ef expref: 202 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.455437:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:0.0:1789431571.455439:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431571.455442:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3200, rc 0)
00000100:00100000:0.0:1789431571.455512:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:14617:x1876351933650176:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1350us (1573us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.455520:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296446
00000100:00100000:3.0:1789431571.467120:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.467156:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933650432
00000100:00100000:3.0:1789431571.467165:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933650432
00000100:00100000:3.0:1789431571.467228:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296447
00000100:00100000:3.0:1789431571.467239:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+202:14617:x1876351933650432:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431571.467265:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431571.467297:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352885c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c96f6 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.467392:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528863 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.467405:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528855 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96ef expref: 203 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.467413:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528863 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.467444:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528855 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96ef expref: 203 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.467458:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528855 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96ef expref: 203 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.467471:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e97100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894264320:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431571.467547:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065eb40 going to sleep for 11 seconds
00000100:00100000:0.0:1789431571.474550:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.474644:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e97100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894264320:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431571.474697:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528863 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.475250:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933650560
00000100:00100000:3.0:1789431571.475260:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933650560
00010000:00010000:3.0:1789431571.475581:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528855 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96ef expref: 204 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.475632:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16762
00000100:00100000:3.0:1789431571.475642:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:2347:x1876351933650560:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431571.475655:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431571.475661:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528855 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96ef expref: 204 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.475683:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528855 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96ef expref: 204 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.475712:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528855 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96ef expref: 204 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.475728:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:3.0:1789431571.475732:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528863 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.475741:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528863 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.475748:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528863 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.475769:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431571.475816:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:2347:x1876351933650560:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 176us (1276us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.475822:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16762
00010000:00010000:3.0:1789431571.475848:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528863 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.475855:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528863 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431571.475872:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00010000:00010000:3.0:1789431571.476006:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352885c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96f6 expref: 204 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.476021:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528863 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96f6 expref: 203 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.476028:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:3.0:1789431571.476030:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431571.476033:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b600, rc 0)
00000100:00100000:3.0:1789431571.476085:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14617:x1876351933650432:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8849us (8976us total) trans 4295121231 rc 0/0
00000100:00100000:3.0:1789431571.476092:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296447
00000100:00100000:3.0:1789431571.480972:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.484501:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933650688
00000100:00100000:0.0:1789431571.484515:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933650688
00000100:00100000:0.0:1789431571.484578:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296448
00000100:00100000:0.0:1789431571.484588:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14617:x1876351933650688:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431571.484612:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431571.484631:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63528871 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c96fd expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.484728:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528878 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.484743:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528863 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96f6 expref: 204 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.484751:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528878 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.484784:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528863 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96f6 expref: 204 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.484797:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528863 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96f6 expref: 204 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.484810:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894264448:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431571.484895:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf37387000 going to sleep for 11 seconds
00000100:00100000:3.0:1789431571.489198:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.489239:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933650816
00000100:00100000:3.0:1789431571.489247:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933650816
00010000:00010000:3.0:1789431571.489292:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528863 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96f6 expref: 205 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.489328:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16763
00000100:00100000:3.0:1789431571.489338:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:2348:x1876351933650816:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431571.489356:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431571.489362:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528863 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96f6 expref: 205 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.489373:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528863 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96f6 expref: 205 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.489395:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:3.0:1789431571.489401:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528878 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.489411:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.489420:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528878 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.489438:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431571.489483:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:2348:x1876351933650816:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 147us (295us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.489490:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16763
00010000:00010000:0.0:1789431571.489924:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528863 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96f6 expref: 204 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.489943:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894264448:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431571.489964:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.489976:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.489983:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431571.490029:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00000004:00200000:0.0:1789431571.490034:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431571.490097:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.490129:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63528871 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96fd expref: 204 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.490143:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528878 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96fd expref: 203 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.490150:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:0.0:1789431571.490153:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431571.490156:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2000, rc 0)
00000100:00100000:0.0:1789431571.490194:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14617:x1876351933650688:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 5608us (9230us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.490212:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296448
00000100:00100000:3.0:1789431571.496194:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.496316:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933650944
00000100:00100000:0.0:1789431571.496326:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933650944
00000100:00100000:0.0:1789431571.496383:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296449
00000100:00100000:0.0:1789431571.496394:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14617:x1876351933650944:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431571.496417:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431571.496438:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352887f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9704 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496500:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528886 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496514:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528886 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496525:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528886 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496541:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352888d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496548:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352888d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496554:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352888d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496794:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528894 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496805:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496812:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431571.496843:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00000004:00200000:0.0:1789431571.496849:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431571.496865:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496875:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496884:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528886 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496891:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528886 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496897:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528886 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496903:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431571.496907:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528886 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496913:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528886 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496925:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431571.496928:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431571.496932:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528886 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496938:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528886 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496949:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352888d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496959:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352888d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496965:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352888d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496970:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431571.496973:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352888d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496978:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352888d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496985:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90ce07190000)
00010000:00010000:0.0:1789431571.496988:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431571.496990:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352888d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.496996:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb6352888d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.497027:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352887f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9704 expref: 205 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.497041:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528894 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9704 expref: 204 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.497076:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:0.0:1789431571.497080:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431571.497083:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2200, rc 0)
00000100:00100000:0.0:1789431571.497135:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:14617:x1876351933650944:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 744us (950us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.497143:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296449
00000100:00100000:0.0:1789431571.504921:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.504957:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933651200
00000100:00100000:0.0:1789431571.504966:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933651200
00000100:00100000:0.0:1789431571.505015:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296450
00000100:00100000:0.0:1789431571.505025:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:14617:x1876351933651200:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:0.0:1789431571.505100:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:0.0:1789431571.505126:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528894 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9704 expref: 204 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.505146:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528878 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c96fd expref: 203 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.505155:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:0.0:1789431571.505160:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431571.505198:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352889b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.505216:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352889b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.505226:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352889b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431571.505370:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e855968a reply state 000000004673e8be transno 4295121232 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352889b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.505384:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431571.505470:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:14617:x1876351933651200:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 445us (556us total) trans 4295121232 rc 0/0
00000100:00100000:0.0:1789431571.505476:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296450
00000100:00100000:3.0:1789431571.511585:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431571.511617:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352889b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.511628:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352889b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.511636:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352889b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.511643:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.511648:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352889b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.511657:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352889b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.511681:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:3.0:1789431571.511684:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.511696:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352889b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.511703:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb6352889b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.512776:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933651328
00000100:00100000:2.0:1789431571.512788:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933651328
00000100:00100000:2.0:1789431571.512841:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8449
00000100:00100000:2.0:1789431571.512851:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+66:2348:x1876351933651328:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:2.0:1789431571.514107:0:14497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x51e:0x0] updating lvb size from disk: 74834 -> 74834
00002000:00010000:2.0:1789431571.514114:0:14497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x51e:0x0] updating lvb mtime from disk: 1789431558 -> 1789431558
00002000:00010000:2.0:1789431571.514116:0:14497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x51e:0x0] updating lvb atime from disk: 1789431560 -> 1789431550
00002000:00010000:2.0:1789431571.514118:0:14497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x51e:0x0] updating lvb ctime from disk: 1789431570 -> 1789431571
00002000:00010000:2.0:1789431571.514120:0:14497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x51e:0x0] updating lvb blocks from disk: 259 -> 259
00000100:00100000:2.0:1789431571.514181:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2348:x1876351933651328:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 1329us (2602us total) trans 4294969687 rc 0/0
00000100:00100000:2.0:1789431571.514190:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8449
00000100:00100000:0.0:1789431571.517774:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.518646:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933651584
00000100:00100000:3.0:1789431571.518659:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933651584
00000100:00100000:3.0:1789431571.518727:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12589
00000100:00100000:3.0:1789431571.518737:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+203:14617:x1876351933651584:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431571.518954:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:14617:x1876351933651584:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 218us (1188us total) trans 4295121233 rc 0/0
00000100:00100000:3.0:1789431571.518962:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12589
00000100:00100000:3.0:1789431571.524220:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431571.524491:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933651712
00000100:00100000:1.0:1789431571.524502:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933651712
00000100:00100000:1.0:1789431571.524555:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296451
00000100:00100000:1.0:1789431571.524566:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+204:14617:x1876351933651712:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431571.524591:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431571.524611:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635288a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c970b expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.524687:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635288a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.524761:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635288a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.524776:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635288a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.524792:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635288b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.524799:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635288b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.524805:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635288b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525036:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635288b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525045:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635288b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525095:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635288b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431571.525466:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00000004:00200000:1.0:1789431571.525472:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431571.525495:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635288b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525508:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635288b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525517:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635288a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525528:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635288a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525535:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635288a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525541:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431571.525546:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635288a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525555:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635288a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525567:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431571.525570:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431571.525575:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635288a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525582:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb635288a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525595:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635288b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525602:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635288b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525608:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635288b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525614:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431571.525617:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635288b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525624:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635288b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525631:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90ce03149a00)
00010000:00010000:1.0:1789431571.525633:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431571.525636:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635288b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525642:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb635288b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525693:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb635288a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c970b expref: 206 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525707:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635288b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c970b expref: 205 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.525714:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:1.0:1789431571.525716:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431571.525719:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309a00, rc 0)
00000100:00100000:1.0:1789431571.525782:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14617:x1876351933651712:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1217us (1581us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431571.525790:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296451
00000100:00100000:3.0:1789431571.533888:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.534973:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933651968
00000100:00100000:0.0:1789431571.534987:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933651968
00000100:00100000:0.0:1789431571.536633:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296452
00000100:00100000:0.0:1789431571.536655:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+205:14617:x1876351933651968:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431571.539850:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431571.539884:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb635288be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9712 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.539994:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb635288c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.540012:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635288b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c970b expref: 206 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.540022:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb635288c5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.540096:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635288b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c970b expref: 206 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.540113:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635288b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c970b expref: 206 pid: 6797 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.540134:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894264576:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431571.540229:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf37387000 going to sleep for 11 seconds
00000100:00100000:1.0:1789431571.544080:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2348:x1876351933649792:12345-192.168.203.4@tcp:16:dbench.0 Request processed in 105131us (105375us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431571.544093:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8448
00000001:00080000:0.0:1789431571.544192:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970089 is committed
00000100:00100000:3.0:1789431571.552637:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.552696:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.552805:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894264576:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431571.552831:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb635288c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431571.552904:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933652096
00000100:00100000:1.0:1789431571.552912:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933652096
00010000:00010000:1.0:1789431571.552949:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635288b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c970b expref: 207 pid: 6797 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431571.552987:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16764
00000100:00100000:1.0:1789431571.552995:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:2347:x1876351933652096:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431571.553010:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431571.553017:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635288b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c970b expref: 207 pid: 6797 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.553028:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635288b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c970b expref: 207 pid: 6797 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.553086:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635288b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c970b expref: 207 pid: 6797 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.553101:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:1.0:1789431571.553106:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb635288c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.553115:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb635288c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.553122:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb635288c5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.553141:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431571.553189:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:2347:x1876351933652096:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 194us (500us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431571.553197:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16764
00010000:00010000:0.0:1789431571.553411:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb635288c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.553418:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb635288c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431571.553437:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00010000:00010000:0.0:1789431571.553574:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb635288be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9712 expref: 207 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.553590:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb635288c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9712 expref: 206 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.553598:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:0.0:1789431571.553601:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431571.553604:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce2b507800, rc 0)
00000100:00100000:0.0:1789431571.553645:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14617:x1876351933651968:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 17000us (19767us total) trans 4295121234 rc 0/0
00000100:00100000:0.0:1789431571.553657:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296452
00000100:00100000:2.0:1789431571.555936:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933652352
00000100:00100000:2.0:1789431571.555950:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933652352
00000100:00100000:2.0:1789431571.556005:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12590
00000100:00100000:2.0:1789431571.556015:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+206:14616:x1876351933652352:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:2.0:1789431571.556381:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14616:x1876351933652352:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 367us (3754us total) trans 4295121235 rc 0/0
00000100:00100000:2.0:1789431571.556389:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12590
00000100:00100000:1.0:1789431571.562107:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.562182:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933652608
00000100:00100000:0.0:1789431571.562192:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933652608
00000100:00100000:0.0:1789431571.562262:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296453
00000100:00100000:0.0:1789431571.562272:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce156b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+207:14616:x1876351933652608:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431571.562298:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431571.562319:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb635288d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9720 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562381:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635288da lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562396:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635288da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562407:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635288da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562423:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635288e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562429:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635288e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562434:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635288e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562664:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635288e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562682:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635288e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562768:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635288e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431571.562803:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00000004:00200000:0.0:1789431571.562807:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431571.562825:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635288e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562836:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635288e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562844:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635288da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562850:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635288da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562857:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635288da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562863:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431571.562867:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635288da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562874:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635288da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562884:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431571.562887:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431571.562892:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635288da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562902:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635288da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562915:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635288e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562920:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635288e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562926:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635288e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562930:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431571.562933:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635288e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562939:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635288e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562945:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce07190000)
00010000:00010000:0.0:1789431571.562948:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431571.562951:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635288e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562955:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635288e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.562985:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb635288d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9720 expref: 209 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.563003:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635288e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9720 expref: 208 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.563011:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:0.0:1789431571.563014:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431571.563016:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3400, rc 0)
00000100:00100000:0.0:1789431571.563119:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce156b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14616:x1876351933652608:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 849us (1021us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.563126:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296453
00000100:00100000:3.0:1789431571.567993:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431571.568086:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933652480
00000100:00100000:1.0:1789431571.568096:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933652480
00000100:00100000:1.0:1789431571.568149:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296454
00000100:00100000:1.0:1789431571.568159:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+208:14617:x1876351933652480:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431571.568178:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431571.568197:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635288ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9719 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.568286:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635288f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.568301:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb635288c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9712 expref: 209 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.568309:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635288f6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.568342:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb635288c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9712 expref: 209 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.568355:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb635288c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9712 expref: 209 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431571.568369:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b2c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894264704:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431571.568452:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf11f8b540 going to sleep for 11 seconds
00000100:00100000:3.0:1789431571.570985:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b2c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894264704:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431571.571014:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635288f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.572983:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.573074:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933652864
00000100:00100000:0.0:1789431571.573084:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933652864
00000100:00100000:0.0:1789431571.573144:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296455
00000100:00100000:0.0:1789431571.573153:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:14616:x1876351933652864:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431571.573173:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431571.573194:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635288fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9727 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.573297:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528904 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.573310:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635288e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9720 expref: 211 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.573319:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528904 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.573353:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635288e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9720 expref: 211 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.573366:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635288e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9720 expref: 211 pid: 5849 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.573379:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894264832:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431571.573462:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf37387840 going to sleep for 11 seconds
00000100:00100000:0.0:1789431571.575957:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894264832:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431571.575985:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528904 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.578809:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431571.578901:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933652992
00000100:00100000:1.0:1789431571.578911:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933652992
00010000:00010000:1.0:1789431571.578951:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb635288c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9712 expref: 212 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431571.578990:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16765
00000100:00100000:1.0:1789431571.578999:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:2347:x1876351933652992:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431571.579013:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431571.579019:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb635288c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9712 expref: 212 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.579032:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb635288c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9712 expref: 212 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.579093:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb635288c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9712 expref: 212 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.579111:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:1.0:1789431571.579117:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635288f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.579127:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635288f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.579134:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635288f6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.579159:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431571.579211:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:2347:x1876351933652992:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 213us (410us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431571.579219:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16765
00010000:00010000:0.0:1789431571.579291:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635288f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.579300:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635288f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431571.579344:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00000004:00200000:0.0:1789431571.579348:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431571.579369:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635288f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.579401:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb635288ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9719 expref: 211 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.579416:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635288f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9719 expref: 210 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.579424:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:0.0:1789431571.579427:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431571.579430:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:0.0:1789431571.579454:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:14617:x1876351933652480:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11298us (11473us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.579461:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296454
00000100:00100000:2.0:1789431571.583242:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.583311:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933653120
00000100:00100000:0.0:1789431571.583321:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933653120
00010000:00010000:0.0:1789431571.583364:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635288e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9720 expref: 210 pid: 5849 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.583405:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16766
00000100:00100000:0.0:1789431571.583415:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb59450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:2347:x1876351933653120:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431571.583429:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431571.583437:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635288e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9720 expref: 210 pid: 5849 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.583449:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635288e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9720 expref: 210 pid: 5849 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.583471:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635288e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9720 expref: 210 pid: 5849 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.583487:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:0.0:1789431571.583493:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528904 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.583502:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528904 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.583513:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528904 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.583545:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431571.583598:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb59450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:2347:x1876351933653120:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 184us (366us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.583605:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16766
00010000:00010000:1.0:1789431571.583713:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528904 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.583722:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528904 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431571.583742:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00010000:00010000:1.0:1789431571.583884:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb635288fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9727 expref: 210 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.583899:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528904 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9727 expref: 209 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.583906:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:1.0:1789431571.583908:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431571.583910:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2000, rc 0)
00000100:00100000:1.0:1789431571.583934:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:14616:x1876351933652864:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10783us (10959us total) trans 4295121236 rc 0/0
00000100:00100000:1.0:1789431571.583941:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296455
00000100:00100000:2.0:1789431571.588485:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.588573:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933653248
00000100:00100000:0.0:1789431571.588583:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933653248
00000100:00100000:0.0:1789431571.588640:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296456
00000100:00100000:0.0:1789431571.588651:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+209:14616:x1876351933653248:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431571.588684:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431571.588712:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528912 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c972e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.588793:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528919 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.588807:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528904 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9727 expref: 210 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.588816:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528919 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.588847:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528904 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9727 expref: 210 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.588860:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528904 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9727 expref: 210 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.588873:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894264960:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431571.588950:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf37387000 going to sleep for 11 seconds
00000100:00100000:2.0:1789431571.591739:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.591908:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894264960:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431571.591934:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528919 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.591989:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933653376
00000100:00100000:3.0:1789431571.591997:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933653376
00000100:00100000:3.0:1789431571.592074:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296457
00000100:00100000:3.0:1789431571.592085:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:14617:x1876351933653376:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431571.592103:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431571.592122:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528920 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9735 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592183:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528927 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592197:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528927 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592219:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528927 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592235:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352892e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592242:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352892e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592248:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352892e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592496:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528935 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592505:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592513:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431571.592546:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00000004:00200000:3.0:1789431571.592550:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431571.592569:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592580:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592588:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528927 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592594:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528927 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592600:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528927 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592605:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.592609:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528927 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592616:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528927 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592627:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431571.592630:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.592635:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528927 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592640:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528927 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592651:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352892e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592657:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352892e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592663:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352892e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592667:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.592679:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352892e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592871:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352892e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592881:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x6e04e070 (ffff90ce2d731c00)
00010000:00010000:3.0:1789431571.592883:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.592887:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352892e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592893:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352892e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592926:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528920 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9735 expref: 213 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592939:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528935 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9735 expref: 212 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.592946:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:3.0:1789431571.592948:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431571.592950:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a400, rc 0)
00000100:00100000:3.0:1789431571.593013:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14617:x1876351933653376:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 929us (1282us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.593021:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296457
00000100:00100000:2.0:1789431571.596296:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.596413:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933653504
00000100:00100000:3.0:1789431571.596422:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933653504
00010000:00010000:3.0:1789431571.596460:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528904 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9727 expref: 212 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.596497:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16767
00000100:00100000:3.0:1789431571.596507:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:2348:x1876351933653504:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431571.596520:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431571.596526:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528904 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9727 expref: 212 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.596538:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528904 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9727 expref: 212 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.596564:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528904 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9727 expref: 212 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.596579:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431571.596583:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528919 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.596592:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.596600:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528919 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.596703:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431571.596757:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+211:2348:x1876351933653504:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 251us (476us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.596763:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16767
00010000:00010000:0.0:1789431571.597878:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.597890:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431571.597937:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00000004:00200000:0.0:1789431571.597942:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431571.597964:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.598000:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528912 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c972e expref: 211 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.598019:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528919 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c972e expref: 210 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.598027:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:0.0:1789431571.598030:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431571.598033:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3c00, rc 0)
00000100:00100000:0.0:1789431571.598263:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:14616:x1876351933653248:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9613us (9785us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.598273:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296456
00000100:00100000:2.0:1789431571.603618:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.603734:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933653760
00000100:00100000:0.0:1789431571.603744:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933653760
00000100:00100000:0.0:1789431571.603794:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296458
00000100:00100000:0.0:1789431571.603803:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+210:14617:x1876351933653760:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431571.603822:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431571.603842:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352893c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c973c expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.603935:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528943 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.603950:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528935 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9735 expref: 211 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.603959:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528943 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.603990:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528935 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9735 expref: 211 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.604004:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528935 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9735 expref: 211 pid: 12775 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.604017:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b3b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894265088:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431571.604114:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf37387000 going to sleep for 11 seconds
00000100:00100000:1.0:1789431571.606345:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.606456:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933653888
00000100:00100000:3.0:1789431571.606465:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933653888
00000100:00100000:3.0:1789431571.606522:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296459
00000100:00100000:3.0:1789431571.606533:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14616:x1876351933653888:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431571.606551:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431571.606571:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352894a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9743 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.606631:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528951 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.606649:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528951 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.606659:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528951 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.606685:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528958 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.606700:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.606707:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.606935:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352895f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.606945:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352895f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.606953:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352895f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431571.606986:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00000004:00200000:3.0:1789431571.606991:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431571.607010:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352895f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.607021:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352895f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.607032:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528951 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.607038:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528951 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.607044:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528951 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.607085:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.607090:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528951 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.607097:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528951 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.607108:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431571.607110:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.607115:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528951 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.607121:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528951 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.607133:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.607139:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528958 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.607144:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528958 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.607150:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.607153:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528958 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.607159:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528958 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.607166:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce2d731c00)
00010000:00010000:3.0:1789431571.607169:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.607171:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528958 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.607177:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528958 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.607207:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352894a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9743 expref: 214 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.607221:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352895f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9743 expref: 213 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.607228:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431571.607230:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431571.607233:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a200, rc 0)
00000100:00100000:3.0:1789431571.609157:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14616:x1876351933653888:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2613us (2808us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.609169:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296459
00000100:00100000:2.0:1789431571.610378:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.610478:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b3b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894265088:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431571.610505:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528943 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431571.610966:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933654016
00000100:00100000:1.0:1789431571.610974:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933654016
00010000:00010000:1.0:1789431571.611012:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528935 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9735 expref: 213 pid: 12775 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431571.611120:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16768
00000100:00100000:1.0:1789431571.611131:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:2347:x1876351933654016:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431571.611145:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431571.611152:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528935 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9735 expref: 213 pid: 12775 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.611164:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528935 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9735 expref: 213 pid: 12775 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.611183:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528935 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9735 expref: 213 pid: 12775 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.611199:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:1.0:1789431571.611214:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528943 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.611223:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528943 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.611230:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528943 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.611254:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431571.611301:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:2347:x1876351933654016:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 172us (928us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431571.611308:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16768
00010000:00010000:2.0:1789431571.611362:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528943 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.611369:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528943 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431571.611389:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00010000:00010000:2.0:1789431571.611535:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb6352893c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c973c expref: 213 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.611551:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528943 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c973c expref: 212 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.611558:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:2.0:1789431571.611561:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431571.611563:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3200, rc 0)
00000100:00100000:2.0:1789431571.611586:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14617:x1876351933653760:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7785us (7977us total) trans 4295121237 rc 0/0
00000100:00100000:2.0:1789431571.611593:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296458
00000100:00100000:2.0:1789431571.615397:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.615619:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933654144
00000100:00100000:3.0:1789431571.615630:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933654144
00000100:00100000:2.0:1789431571.615767:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296460
00000100:00100000:2.0:1789431571.615778:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14617:x1876351933654144:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431571.615805:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431571.615824:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352896d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c974a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.615900:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528974 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.615913:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528943 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c973c expref: 213 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.615921:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528974 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.615953:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528943 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c973c expref: 213 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.615967:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528943 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c973c expref: 213 pid: 6797 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.615981:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e90000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894265216:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431571.616484:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead900 going to sleep for 11 seconds
00000100:00100000:3.0:1789431571.620815:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e90000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894265216:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431571.620846:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528974 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.623873:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.623982:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.624913:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.624941:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933654656
00000100:00100000:3.0:1789431571.624949:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933654656
00000100:00100000:3.0:1789431571.624994:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296461
00000100:00100000:3.0:1789431571.625002:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:14616:x1876351933654656:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431571.625069:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431571.625096:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528919 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c972e expref: 214 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.625114:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431571.625120:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431571.625158:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352897b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.625171:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352895f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9743 expref: 213 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.625181:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352897b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.625332:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352895f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9743 expref: 213 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.625351:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352895f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9743 expref: 213 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.625364:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894265344:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431571.625454:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf2041f6c0 going to sleep for 11 seconds
00000100:00100000:2.0:1789431571.625832:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933654272
00000100:00100000:2.0:1789431571.625839:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933654272
00010000:00010000:2.0:1789431571.625866:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528943 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c973c expref: 214 pid: 6797 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.625891:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933654400
00000100:00100000:2.0:1789431571.625895:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933654400
00010000:00010000:2.0:1789431571.625909:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352895f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9743 expref: 215 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.625926:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16769
00000100:00100000:2.0:1789431571.625933:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:2348:x1876351933654272:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431571.625942:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431571.625947:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528943 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c973c expref: 215 pid: 6797 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.625959:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528943 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c973c expref: 215 pid: 6797 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.625973:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528943 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c973c expref: 215 pid: 6797 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.625984:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:2.0:1789431571.625989:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528974 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.625996:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.626003:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528974 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.626043:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16770
00010000:00010000:2.0:1789431571.626099:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431571.626132:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:2348:x1876351933654272:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 199us (2269us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431571.626139:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16769
00000100:00100000:3.0:1789431571.626815:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:2347:x1876351933654400:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431571.626828:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431571.626836:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352895f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9743 expref: 213 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.626848:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352895f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9743 expref: 213 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.626863:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431571.626867:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352897b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.626876:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352897b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.626882:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352897b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.626895:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431571.626937:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:2347:x1876351933654400:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 131us (2955us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.626945:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16770
00010000:00010000:3.0:1789431571.626980:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.626987:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431571.627024:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00000004:00200000:3.0:1789431571.627029:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431571.627062:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.627092:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb6352896d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c974a expref: 213 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.627108:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528974 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c974a expref: 212 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.627116:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:3.0:1789431571.627118:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431571.627120:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522c00, rc 0)
00000100:00100000:3.0:1789431571.627143:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14617:x1876351933654144:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11368us (11757us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.627149:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296460
00010000:00010000:1.0:1789431571.632441:0:5848:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@0000000076d64a9a x1876351894265344) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352895f lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9743 expref: 211 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.632465:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352895f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9743 expref: 211 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431571.632481:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894265344:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431571.632503:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:1.0:1789431571.632511:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352897b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.632520:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352897b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.632526:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352897b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431571.632691:0:5848:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001389df03 reply state 00000000b27ea3c4 transno 4295121238 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352897b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431571.632699:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431571.632803:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14616:x1876351933654656:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 7800us (7891us total) trans 4295121238 rc 0/0
00000100:00100000:1.0:1789431571.632825:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296461
00000100:00100000:2.0:1789431571.636088:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.638192:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933654912
00000100:00100000:3.0:1789431571.638206:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933654912
00000100:00100000:3.0:1789431571.638260:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12591
00000100:00100000:3.0:1789431571.638270:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14617:x1876351933654912:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431571.638518:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14617:x1876351933654912:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 249us (2439us total) trans 4295121239 rc 0/0
00000100:00100000:3.0:1789431571.638527:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12591
00010000:00010000:3.0:1789431571.640603:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352897b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.640618:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352897b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.640625:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352897b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.640630:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.640634:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352897b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.640642:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352897b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.640658:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431571.640661:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.640665:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352897b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.640680:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352897b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.649235:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.649368:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431571.649753:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933655040
00000100:00100000:1.0:1789431571.649763:0:14482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933655040
00000100:00100000:1.0:1789431571.649866:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8450
00000100:00100000:1.0:1789431571.649877:0:14482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2347:x1876351933655040:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:1.0:1789431571.650164:0:14482:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x51e:0x0] updating lvb size from disk: 74834 -> 74834
00002000:00010000:1.0:1789431571.650169:0:14482:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x51e:0x0] updating lvb mtime from disk: 1789431558 -> 1789431558
00002000:00010000:1.0:1789431571.650172:0:14482:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x51e:0x0] updating lvb atime from disk: 1789431560 -> 1789431550
00002000:00010000:1.0:1789431571.650174:0:14482:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x51e:0x0] updating lvb ctime from disk: 1789431570 -> 1789431571
00002000:00010000:1.0:1789431571.650178:0:14482:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x51e:0x0] updating lvb blocks from disk: 259 -> 259
00000100:00100000:1.0:1789431571.650435:0:14482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2347:x1876351933655040:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 559us (1065us total) trans 4294970090 rc 0/0
00000100:00100000:1.0:1789431571.650443:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8450
00000100:00100000:3.0:1789431571.650557:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933655168
00000100:00100000:3.0:1789431571.650562:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933655168
00000100:00100000:3.0:1789431571.650598:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296462
00000100:00100000:3.0:1789431571.650605:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+212:14617:x1876351933655168:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431571.650623:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431571.650642:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528982 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9751 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.650721:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528989 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.650735:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528989 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.650747:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528989 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.650760:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528990 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.650767:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.650774:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651004:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528997 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651025:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651034:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431571.651083:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab3:0x0]: returning size 74402
00000004:00200000:3.0:1789431571.651088:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431571.651108:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651119:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651126:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528989 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651133:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528989 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651140:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528989 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651146:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.651150:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528989 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651158:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528989 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651170:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431571.651172:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.651182:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528989 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651188:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528989 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651210:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651220:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528990 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651225:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528990 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651230:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.651232:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528990 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651238:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528990 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651245:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x6e04e070 (ffff90ce2d731c00)
00010000:00010000:3.0:1789431571.651247:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.651251:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528990 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651257:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528990 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651286:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528982 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9751 expref: 214 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651298:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528997 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9751 expref: 213 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.651305:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:3.0:1789431571.651307:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431571.651310:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b600, rc 0)
00000100:00100000:3.0:1789431571.651343:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14617:x1876351933655168:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 739us (2118us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.651350:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296462
00000100:00100000:2.0:1789431571.657244:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.657544:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933655424
00000100:00100000:3.0:1789431571.657554:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933655424
00000100:00100000:3.0:1789431571.657610:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12592
00000100:00100000:3.0:1789431571.657620:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14616:x1876351933655424:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431571.657872:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:14616:x1876351933655424:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 253us (644us total) trans 4295121240 rc 0/0
00000100:00100000:3.0:1789431571.657880:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12592
00000100:00100000:2.0:1789431571.664680:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.664802:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933655680
00000100:00100000:3.0:1789431571.664822:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933655680
00000100:00100000:3.0:1789431571.664885:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296463
00000100:00100000:3.0:1789431571.664895:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:14617:x1876351933655680:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431571.664957:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0
00010000:00010000:3.0:1789431571.664983:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528997 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9751 expref: 214 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.665007:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528974 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c974a expref: 213 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.665229:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528212 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c94fe expref: 212 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.665239:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce03149600)
00010000:00010000:3.0:1789431571.665252:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431571.665272:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352899e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.665534:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352899e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.665547:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352899e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.665565:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635289a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.665573:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635289a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.665579:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635289a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.669923:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431571.671388:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635289ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.671410:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635289ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.671423:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635289ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:0.0:1789431571.672428:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1251, 64 off88320
00010000:00010000:0.0:1789431571.672493:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635289b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.672506:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635289b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.672515:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635289b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.672522:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635289b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.672528:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635289b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.672535:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635289b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.672550:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1789431571.672572:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635289ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.672579:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635289ac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.672585:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635289ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.672590:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431571.672594:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635289ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.672601:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635289ac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.672611:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce07190000)
00010000:00010000:0.0:1789431571.672614:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:0.0:1789431571.672618:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635289ac lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.672624:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb635289ac lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10ab3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.672642:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352899e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.672648:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352899e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.672653:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352899e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.672658:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431571.672661:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352899e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.672679:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352899e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.672779:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1789431571.672787:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635289b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.672794:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2e00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:1.0:1789431571.672797:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635289b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.672803:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635289b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.672814:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab3:0x0].0x0 (ffff90ce07190000)
00010000:00010000:1.0:1789431571.672816:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:1.0:1789431571.672819:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635289b3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.672824:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb635289b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.672840:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431571.672842:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1789431571.672844:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1789431571.672890:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431571.672893:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431571.672897:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352899e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.672903:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb6352899e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431571.673776:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003db97443 reply state 000000001efeff0a transno 4295121241 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635289a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.673791:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:0.0:1789431571.673952:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14617:x1876351933655680:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 9055us (9288us total) trans 4295121241 rc 0/0
00000100:00100000:0.0:1789431571.673961:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296463
00000100:00100000:0.0:1789431571.673993:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933655808
00000100:00100000:0.0:1789431571.674000:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933655808
00000100:00100000:0.0:1789431571.674071:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296464
00000100:00100000:0.0:1789431571.674080:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14616:x1876351933655808:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431571.674100:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431571.674115:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635289ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9758 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674167:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635289c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674179:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635289c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674189:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635289c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674276:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635289c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674285:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635289c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674293:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635289c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674505:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635289cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674515:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635289cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674522:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635289cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431571.674555:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00000004:00200000:0.0:1789431571.674558:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431571.674576:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635289cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674586:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635289cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674597:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635289c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674603:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635289c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674610:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635289c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674615:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431571.674618:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635289c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674624:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635289c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674635:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431571.674638:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431571.674642:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635289c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674649:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb635289c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674659:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635289c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674664:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635289c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674681:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635289c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674695:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431571.674698:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635289c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674703:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635289c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674709:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce07190900)
00010000:00010000:0.0:1789431571.674711:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431571.674714:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635289c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674719:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb635289c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674747:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb635289ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9758 expref: 215 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674760:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635289cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9758 expref: 214 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.674766:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:0.0:1789431571.674768:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431571.674770:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2000, rc 0)
00000100:00100000:0.0:1789431571.674800:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:14616:x1876351933655808:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 721us (4888us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.674806:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296464
00010000:00010000:3.0:1789431571.686997:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635289a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.687181:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635289a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.687189:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635289a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.687196:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.687262:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635289a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.687272:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635289a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.687289:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x6e04e070 (ffff90ce2d731c00)
00010000:00010000:3.0:1789431571.687292:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.687297:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635289a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.687303:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635289a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.699543:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.702169:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933656064
00000100:00100000:3.0:1789431571.702184:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933656064
00000100:00100000:3.0:1789431571.702910:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296465
00000100:00100000:3.0:1789431571.702923:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+213:14616:x1876351933656064:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431571.702947:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431571.702967:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635289d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c975f expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.703133:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635289dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.703151:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635289cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9758 expref: 214 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.703160:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635289dd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.703789:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635289cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9758 expref: 214 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.703812:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635289cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9758 expref: 214 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.703826:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894265472:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431571.703932:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e780 going to sleep for 11 seconds
00000100:00100000:3.0:1789431571.712463:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894265472:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431571.712495:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635289dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.723406:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.723647:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933656192
00000100:00100000:0.0:1789431571.723863:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933656192
00000100:00100000:0.0:1789431571.723929:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296466
00000100:00100000:0.0:1789431571.723940:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14617:x1876351933656192:12345-192.168.203.4@tcp:41:dbench.0
00000004:00000024:0.0:1789431571.723995:0:12775:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7644119040 avail 7587495936
00000100:00100000:0.0:1789431571.726479:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.726625:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933656320
00000100:00100000:3.0:1789431571.726634:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933656320
00010000:00010000:3.0:1789431571.726681:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635289cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9758 expref: 216 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.726811:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16771
00000100:00100000:3.0:1789431571.726822:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:2349:x1876351933656320:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431571.726837:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431571.726845:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635289cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9758 expref: 216 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.726962:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635289cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9758 expref: 216 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.726984:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb635289cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9758 expref: 216 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.727005:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431571.727010:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635289dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.727020:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635289dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.727028:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635289dd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.727086:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431571.727128:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:2349:x1876351933656320:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 308us (659us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.727134:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16771
00010000:00010000:2.0:1789431571.727188:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635289dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.727196:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635289dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431571.727223:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00010000:00010000:2.0:1789431571.727372:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb635289d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c975f expref: 216 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.727388:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635289dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c975f expref: 215 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.727395:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:2.0:1789431571.727397:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431571.727399:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b600, rc 0)
00000100:00100000:2.0:1789431571.727423:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14616:x1876351933656064:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 24503us (27890us total) trans 4295121242 rc 0/0
00000100:00100000:2.0:1789431571.727430:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296465
00000100:00100000:1.0:1789431571.728226:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+214:14617:x1876351933656192:12345-192.168.203.4@tcp:41:dbench.0 Request processed in 4284us (4827us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431571.728237:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296466
00000100:00100000:0.0:1789431571.737418:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.740498:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.740871:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933656448
00000100:00100000:3.0:1789431571.740883:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933656448
00000100:00100000:3.0:1789431571.740973:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933656576
00000100:00100000:3.0:1789431571.740977:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933656576
00000100:00100000:2.0:1789431571.741931:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296467
00000100:00100000:2.0:1789431571.741948:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14616:x1876351933656448:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431571.741972:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431571.741995:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635289eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9766 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.742110:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635289f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.742125:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635289dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c975f expref: 216 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.742134:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635289f2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.742166:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635289dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c975f expref: 216 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.742181:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635289dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c975f expref: 216 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.742193:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894265600:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431571.742453:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead240 going to sleep for 11 seconds
00000100:00100000:3.0:1789431571.747903:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296468
00000100:00100000:3.0:1789431571.747925:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14617:x1876351933656576:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431571.747947:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431571.747967:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635289f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c976d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748034:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a00 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748064:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748078:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748094:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xb34b640c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748101:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xb34b640c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748107:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xb34b640c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748160:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748167:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a00 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748174:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748179:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.748183:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748190:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a00 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748211:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431571.748215:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.748221:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748227:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748239:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xb34b640c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748245:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xb34b640c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748251:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xb34b640c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748256:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.748259:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xb34b640c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748265:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xb34b640c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748272:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xb34b640c (ffff90ce2d731c00)
00010000:00010000:3.0:1789431571.748275:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.748278:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xb34b640c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748295:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xb34b640c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748327:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635289f9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c976d expref: 217 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748342:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431571.748344:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.748347:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb635289f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c976d expref: 217 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.748356:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b000, rc 0)
00000100:00100000:3.0:1789431571.748416:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14617:x1876351933656576:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 500us (7926us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431571.748423:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296468
00000100:00100000:3.0:1789431571.748577:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.748626:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894265600:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431571.748648:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635289f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.757615:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933656704
00000100:00100000:0.0:1789431571.757630:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933656704
00010000:00010000:0.0:1789431571.757915:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635289dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c975f expref: 216 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.757956:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16772
00000100:00100000:0.0:1789431571.757978:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:2348:x1876351933656704:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431571.757993:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431571.758000:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635289dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c975f expref: 216 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.758012:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635289dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c975f expref: 216 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.758036:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb635289dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c975f expref: 216 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.758072:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:0.0:1789431571.758079:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635289f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.758088:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635289f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.758097:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635289f2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.758124:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431571.758177:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:2348:x1876351933656704:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 212us (9599us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.758184:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16772
00010000:00010000:3.0:1789431571.760004:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635289f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.760105:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431571.760139:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635289f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431571.760189:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00000004:00200000:3.0:1789431571.760195:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431571.760218:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635289f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.760223:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933656832
00000100:00100000:0.0:1789431571.760232:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933656832
00010000:00010000:3.0:1789431571.760259:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb635289eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9766 expref: 216 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.760388:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296469
00000100:00100000:0.0:1789431571.760400:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14617:x1876351933656832:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431571.760417:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431571.760434:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528a0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9774 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.760487:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528a15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.760500:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528a15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.760510:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528a15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431571.760531:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008c:0x0]: returning size 16384
00000004:00200000:0.0:1789431571.760534:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431571.760544:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528a15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.760561:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528a0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9774 expref: 217 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.760576:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528a15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9774 expref: 216 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.760583:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431571.760586:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:0.0:1789431571.760590:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2200, rc 0)
00000100:00100000:0.0:1789431571.760641:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14617:x1876351933656832:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 245us (542us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.760648:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296469
00010000:00010000:3.0:1789431571.760690:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635289f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9766 expref: 215 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.760699:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431571.760702:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431571.760705:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522800, rc 0)
00000100:00100000:3.0:1789431571.760730:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14616:x1876351933656448:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 18788us (23322us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.760737:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296467
00010000:00010000:2.0:1789431571.766796:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789431571.774778:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.774828:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.775805:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933656960
00000100:00100000:2.0:1789431571.775817:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933656960
00000100:00100000:2.0:1789431571.775879:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296470
00000100:00100000:2.0:1789431571.775891:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+215:14616:x1876351933656960:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431571.775912:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431571.775933:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c977b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.775996:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528a23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.776023:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528a23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.776035:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528a23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.776273:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.776283:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.776292:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.776613:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528a31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.776621:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933657088
00010000:00010000:2.0:1789431571.776623:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528a31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.776628:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933657088
00000100:00100000:3.0:1789431571.776719:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12593
00000100:00100000:3.0:1789431571.776729:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0776f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14617:x1876351933657088:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431571.782315:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0776f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14617:x1876351933657088:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 5577us (7474us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431571.782329:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12593
00010000:00010000:2.0:1789431571.783080:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528a31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431571.783186:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00000004:00200000:2.0:1789431571.783191:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431571.783208:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528a31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.783224:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528a31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.783233:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528a23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.783240:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528a23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.783247:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528a23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.783254:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431571.783257:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528a23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.783264:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528a23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.783275:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431571.783287:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431571.783292:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528a23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.783298:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528a23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.783323:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.783330:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.783336:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.783341:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431571.783343:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.783349:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.783357:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x6e04e070 (ffff90cf13195a00)
00010000:00010000:2.0:1789431571.783359:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431571.783362:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.783367:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.783410:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c977b expref: 217 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.783425:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528a31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c977b expref: 216 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.783433:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:2.0:1789431571.783435:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431571.783438:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522600, rc 0)
00000100:00100000:2.0:1789431571.783491:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+216:14616:x1876351933656960:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7602us (8721us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431571.783499:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296470
00000100:00100000:0.0:1789431571.825098:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.825152:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.825212:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933657216
00000100:00100000:2.0:1789431571.825222:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933657216
00000100:00100000:2.0:1789431571.825263:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933657472
00000100:00100000:2.0:1789431571.825266:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933657472
00000100:00100000:3.0:1789431571.825294:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296471
00000100:00100000:2.0:1789431571.825305:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296472
00000100:00100000:3.0:1789431571.825306:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14617:x1876351933657216:12345-192.168.203.4@tcp:101:dbench.0
00000100:00100000:2.0:1789431571.825321:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14616:x1876351933657472:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431571.825334:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431571.825334:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431571.825353:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9789 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825353:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528a3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9782 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825420:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a46 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825434:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.825435:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.825445:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528a31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c977b expref: 219 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825446:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.825454:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a4d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825460:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xcee77dda bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825466:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xcee77dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825472:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xcee77dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.825483:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528a31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c977b expref: 219 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.825495:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528a31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c977b expref: 219 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.825507:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e93100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894265728:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431571.825519:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825525:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825531:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825536:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.825539:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825546:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825556:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431571.825559:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.825564:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825570:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825582:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xcee77dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.825585:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead900 going to sleep for 11 seconds
00010000:00010000:3.0:1789431571.825588:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xcee77dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825594:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xcee77dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825600:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.825603:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xcee77dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825609:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xcee77dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825626:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xcee77dda (ffff90ce2d731c00)
00010000:00010000:3.0:1789431571.825629:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.825632:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xcee77dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825637:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xcee77dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825665:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528a3f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9782 expref: 219 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825682:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431571.825684:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.825688:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528a3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9782 expref: 219 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.825699:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b000, rc 0)
00000100:00100000:3.0:1789431571.825730:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14617:x1876351933657216:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 427us (641us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431571.825736:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296471
00000100:00100000:0.0:1789431571.842164:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.842289:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933657600
00000100:00100000:3.0:1789431571.842300:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933657600
00000100:00100000:3.0:1789431571.842360:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296473
00000100:00100000:3.0:1789431571.842371:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14617:x1876351933657600:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431571.842392:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431571.842413:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528a5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9790 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.842481:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a62 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.842495:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.842506:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.842518:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.842523:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.842533:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.842642:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528a70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.842652:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528a70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.842659:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528a70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431571.842683:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.842708:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933657728
00000100:00100000:3.0:1789431571.842712:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933657728
00010000:00010000:3.0:1789431571.842730:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528a31 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c977b expref: 220 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.842758:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16773
00000100:00100000:3.0:1789431571.842766:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb59850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:2347:x1876351933657728:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431571.842775:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431571.842785:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528a31 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c977b expref: 220 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.842797:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528a31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c977b expref: 220 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.842814:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:3.0:1789431571.842818:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.842826:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.842830:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528a31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c977b expref: 220 pid: 5847 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.842832:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a4d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.842845:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e93100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894265728:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431571.842849:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431571.842874:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.842882:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.842892:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.842901:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb59850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:2347:x1876351933657728:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 136us (217us total) trans 0 rc 0/0
00000004:00200000:0.0:1789431571.842906:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00000100:00100000:3.0:1789431571.842907:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16773
00000004:00200000:3.0:1789431571.842950:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10097:0x0]: returning size 260096
00000004:00200000:3.0:1789431571.842954:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431571.842973:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528a70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.842984:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528a70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.842991:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.842998:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a62 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.843004:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.843010:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.843014:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.843024:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a62 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.843032:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431571.843035:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431571.843036:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9789 expref: 220 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.843039:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.843045:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528a62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.843072:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.843079:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.843082:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9789 expref: 219 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.843086:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.843090:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:3.0:1789431571.843091:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431571.843092:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431571.843094:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.843095:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522400, rc 0)
00010000:00010000:3.0:1789431571.843099:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.843106:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xc3d50206 (ffff90ce2d731c00)
00010000:00010000:3.0:1789431571.843108:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.843111:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.843117:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14616:x1876351933657472:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 17807us (17965us total) trans 4295121243 rc 0/0
00010000:00010000:3.0:1789431571.843118:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528a69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.843124:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296472
00010000:00010000:3.0:1789431571.843140:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528a5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9790 expref: 219 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.843150:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528a70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9790 expref: 218 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.843156:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10097:0x0].0x0 (ffff90ce15f16f00)
00010000:00010000:3.0:1789431571.843158:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431571.843160:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7bc00, rc 0)
00000100:00100000:3.0:1789431571.843190:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14617:x1876351933657600:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 822us (1037us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.843196:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296473
00000100:00100000:0.0:1789431571.852009:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.852084:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.852157:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933657856
00000100:00100000:3.0:1789431571.852166:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933657856
00000100:00100000:3.0:1789431571.852228:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14393
00000100:00100000:3.0:1789431571.852236:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:2350:x1876351933657856:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431571.852250:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431571.852273:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528a70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9790 expref: 218 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.852300:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10097:0x0].0x0 (ffff90ce15f16f00)
00010000:00010000:3.0:1789431571.852305:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431571.852346:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:2350:x1876351933657856:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 111us (345us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.852354:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14393
00000100:00100000:1.0:1789431571.855033:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933657984
00000100:00100000:1.0:1789431571.855086:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933657984
00000100:00100000:1.0:1789431571.855152:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296474
00000100:00100000:1.0:1789431571.855161:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+217:14616:x1876351933657984:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431571.855185:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431571.855205:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528a7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9797 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.855287:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528a85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.855302:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a4d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9789 expref: 218 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.855311:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528a85 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.855346:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9789 expref: 218 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.855361:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a4d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9789 expref: 218 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431571.855375:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b2c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894265856:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431571.855449:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf11f8b780 going to sleep for 11 seconds
00000100:00100000:0.0:1789431571.866555:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.866651:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933658240
00000100:00100000:2.0:1789431571.866661:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933658240
00000100:00100000:2.0:1789431571.866727:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296475
00000100:00100000:2.0:1789431571.866737:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14617:x1876351933658240:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431571.866757:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431571.866778:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528a8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c979e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.866885:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.866900:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e200/0xd8e438fb63512f80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2db0 expref: 220 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.866908:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a93 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.866940:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e200/0xd8e438fb63512f80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2db0 expref: 220 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.866952:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e200/0xd8e438fb63512f80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2db0 expref: 220 pid: 5849 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.866965:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e90380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894265984:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431571.867092:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05eada80 going to sleep for 11 seconds
00000100:00100000:1.0:1789431571.872692:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.872886:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e90380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894265984:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431571.872914:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.872992:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933658368
00000100:00100000:0.0:1789431571.873000:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933658368
00010000:00010000:0.0:1789431571.873045:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a4d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9789 expref: 221 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.873106:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16774
00000100:00100000:0.0:1789431571.873114:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:2347:x1876351933658368:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431571.873130:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431571.873136:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a4d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9789 expref: 221 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.873147:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a4d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9789 expref: 221 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.873167:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:0.0:1789431571.873172:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528a85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.873181:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.873188:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528a85 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.873214:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431571.873265:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:2347:x1876351933658368:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 151us (604us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.873272:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16774
00010000:00010000:3.0:1789431571.874076:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528a4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9789 expref: 220 pid: 12181 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.874093:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b2c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894265856:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431571.874108:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.874116:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.874121:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431571.874161:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00000004:00200000:3.0:1789431571.874165:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431571.874183:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.874222:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528a7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9797 expref: 220 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.874236:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528a85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9797 expref: 219 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.874243:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:3.0:1789431571.874246:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431571.874248:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309c00, rc 0)
00000100:00100000:3.0:1789431571.874293:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14616:x1876351933657984:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 19132us (22207us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.874301:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296474
00000100:00100000:1.0:1789431571.879227:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.879309:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933658496
00000100:00100000:0.0:1789431571.879320:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933658496
00010000:00010000:0.0:1789431571.879361:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e200/0xd8e438fb63512f80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2db0 expref: 219 pid: 5849 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.879400:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16775
00000100:00100000:0.0:1789431571.879409:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:2348:x1876351933658496:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431571.879426:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431571.879432:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e200/0xd8e438fb63512f80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2db0 expref: 219 pid: 5849 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.879443:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e200/0xd8e438fb63512f80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2db0 expref: 219 pid: 5849 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.879464:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3bb2e200/0xd8e438fb63512f80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2db0 expref: 219 pid: 5849 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.879479:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10097:0x0].0x0 (ffff90ce15f16f00)
00010000:00010000:0.0:1789431571.879485:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.879494:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.879501:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a93 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.879531:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431571.879588:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:2348:x1876351933658496:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 180us (371us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.879595:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16775
00010000:00010000:2.0:1789431571.879776:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.879786:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431571.879806:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10097:0x0]: returning size 260096
00010000:00010000:2.0:1789431571.879950:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528a8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c979e expref: 219 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.879966:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c979e expref: 218 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.879974:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10097:0x0].0x0 (ffff90ce15f16f00)
00010000:00010000:2.0:1789431571.879977:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431571.879979:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522e00, rc 0)
00000100:00100000:2.0:1789431571.880004:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14617:x1876351933658240:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 13269us (13459us total) trans 4295121244 rc 0/0
00000100:00100000:2.0:1789431571.880011:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296475
00000100:00100000:0.0:1789431571.891690:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.891733:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.891829:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933658752
00000100:00100000:3.0:1789431571.891838:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933658752
00000100:00100000:3.0:1789431571.891898:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12594
00000100:00100000:3.0:1789431571.891908:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+218:14616:x1876351933658752:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431571.892169:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14616:x1876351933658752:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 262us (486us total) trans 4295121245 rc 0/0
00000100:00100000:3.0:1789431571.892176:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12594
00000100:00100000:1.0:1789431571.892354:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933658880
00000100:00100000:1.0:1789431571.892360:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933658880
00000100:00100000:1.0:1789431571.892395:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296476
00000100:00100000:1.0:1789431571.892403:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14617:x1876351933658880:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431571.892517:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431571.892541:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528aa1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10097:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c97a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.892604:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528aa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.892618:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a93 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c979e expref: 220 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.892627:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528aa8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.892656:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c979e expref: 220 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.892680:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c979e expref: 220 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431571.892694:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b2c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894266112:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431571.892743:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf11f8b780 going to sleep for 11 seconds
00000100:00100000:3.0:1789431571.905102:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b2c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894266112:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431571.905129:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528aa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431571.905188:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.905287:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933659008
00000100:00100000:2.0:1789431571.905294:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933659008
00010000:00010000:2.0:1789431571.905331:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c979e expref: 221 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431571.905367:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16776
00000100:00100000:2.0:1789431571.905377:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:2347:x1876351933659008:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431571.905390:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431571.905398:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c979e expref: 221 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.905418:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c979e expref: 221 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.905438:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528a93 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c979e expref: 221 pid: 5848 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.905453:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10097:0x0].0x0 (ffff90ce15f16f00)
00010000:00010000:2.0:1789431571.905457:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528aa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.905466:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.905473:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528aa8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.905503:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431571.905551:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:2347:x1876351933659008:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 176us (885us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431571.905559:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16776
00010000:00010000:1.0:1789431571.905990:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.905999:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431571.906044:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10097:0x0]: returning size 260096
00000004:00200000:1.0:1789431571.906087:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431571.906113:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.906143:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528aa1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10097:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97a5 expref: 220 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.906159:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97a5 expref: 219 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.906167:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10097:0x0].0x0 (ffff90ce15f16f00)
00010000:00010000:1.0:1789431571.906169:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431571.906172:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309600, rc 0)
00000100:00100000:1.0:1789431571.906208:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14617:x1876351933658880:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 13806us (14475us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431571.906216:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296476
00000100:00100000:1.0:1789431571.915297:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.915432:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933659136
00000100:00100000:2.0:1789431571.915442:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933659136
00000100:00100000:2.0:1789431571.915505:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296477
00000100:00100000:2.0:1789431571.915516:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14616:x1876351933659136:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431571.915540:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431571.915561:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528aaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c97ac expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.915621:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ab6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.915636:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.915647:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.915660:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528abd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.915676:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528abd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.915692:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528abd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.915924:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ac4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.915934:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.915941:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431571.915973:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab5:0x0]: returning size 74402
00000004:00200000:2.0:1789431571.915978:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431571.915996:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.916012:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.916019:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.916026:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ab6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.916031:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ab6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.916037:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431571.916041:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ab6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.916089:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ab6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.916102:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431571.916106:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431571.916110:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ab6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.916117:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ab6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.916129:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528abd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.916135:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528abd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.916142:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528abd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.916147:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431571.916150:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528abd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.916156:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528abd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.916163:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x6e04e070 (ffff90cf13195a00)
00010000:00010000:2.0:1789431571.916165:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431571.916167:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528abd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.916173:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528abd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.916199:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528aaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97ac expref: 221 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.916213:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97ac expref: 220 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.916220:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:2.0:1789431571.916223:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431571.916225:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523600, rc 0)
00000100:00100000:2.0:1789431571.916275:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14616:x1876351933659136:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 761us (1001us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431571.916293:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296477
00000100:00100000:0.0:1789431571.920577:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431571.921171:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933659392
00000100:00100000:1.0:1789431571.921181:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933659392
00000100:00100000:1.0:1789431571.921250:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12595
00000100:00100000:1.0:1789431571.921260:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:14617:x1876351933659392:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431571.921984:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14617:x1876351933659392:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 722us (1411us total) trans 4295121246 rc 0/0
00000100:00100000:1.0:1789431571.921994:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12595
00000100:00100000:1.0:1789431571.927775:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.927855:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933659648
00000100:00100000:3.0:1789431571.927865:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933659648
00000100:00100000:3.0:1789431571.927917:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296478
00000100:00100000:3.0:1789431571.927927:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14617:x1876351933659648:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431571.927952:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431571.928164:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528acb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c97b3 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.928241:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528ad2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.928255:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528ad2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.928269:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528ad2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.928296:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528ad9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.928303:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.928310:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.931655:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528ae0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.931689:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.931703:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431571.932880:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10097:0x0]: returning size 260096
00000004:00200000:2.0:1789431571.932888:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431571.932918:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.932933:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.932943:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528ad2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.932951:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528ad2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.932965:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528ad2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.932971:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431571.932976:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528ad2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.932983:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528ad2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.932995:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431571.932998:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431571.933002:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528ad2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.933008:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528ad2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.933026:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.933031:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528ad9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.933036:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.933040:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431571.933043:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.933099:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528ad9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.933107:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xc3d50206 (ffff90ce2d731c00)
00010000:00010000:2.0:1789431571.933109:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431571.933113:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528ad9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.933119:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528ad9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.933159:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528acb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97b3 expref: 223 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.933173:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97b3 expref: 222 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.933185:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10097:0x0].0x0 (ffff90ce15f16f00)
00010000:00010000:2.0:1789431571.933187:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431571.933189:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b400, rc 0)
00000100:00100000:2.0:1789431571.937838:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14617:x1876351933659648:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9901us (10060us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431571.937851:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296478
00000100:00100000:1.0:1789431571.940450:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431571.940501:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431571.940533:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933659904
00000100:00100000:1.0:1789431571.940543:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933659904
00000100:00100000:1.0:1789431571.940592:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296479
00000100:00100000:1.0:1789431571.940601:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14616:x1876351933659904:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431571.940650:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:1.0:1789431571.940685:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528a85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9797 expref: 222 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.940706:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb6352825f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9513 expref: 221 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.940774:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:1.0:1789431571.940780:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431571.940853:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ae7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.940869:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ae7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.940878:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ae7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.940894:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528aee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.940906:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528aee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.940913:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528aee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.941121:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933659520
00000100:00100000:0.0:1789431571.941128:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933659520
00000100:00100000:0.0:1789431571.941169:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14394
00000100:00100000:0.0:1789431571.941180:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:2348:x1876351933659520:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431571.941191:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431571.941205:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ac4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97ac expref: 221 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.941218:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90cf13195300)
00010000:00010000:0.0:1789431571.941226:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431571.941287:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+220:2348:x1876351933659520:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 109us (846us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.941295:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14394
00010000:00010000:1.0:1789431571.941486:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528af5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.941496:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528af5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.941503:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528af5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:1.0:1789431571.942527:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1252, 64 off88384
00000004:00080000:1.0:1789431571.942536:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3029973486559ns, next at 3030973484406ns, rc = 0
00010000:00010000:1.0:1789431571.942597:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528afc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942608:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528afc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942618:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528afc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942625:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528afc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942631:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528afc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942641:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528afc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942679:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1789431571.942699:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528af5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942706:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528af5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942712:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528af5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942786:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431571.942792:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528af5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942800:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528af5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942856:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90ce03149c00)
00010000:00010000:1.0:1789431571.942860:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:1.0:1789431571.942864:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528af5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942871:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528af5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10ab5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942889:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ae7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942899:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ae7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942905:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ae7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942911:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431571.942914:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ae7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942920:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ae7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942927:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431571.942930:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431571.942933:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ae7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.942938:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ae7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431571.942947:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007940308f reply state 00000000549c3b4c transno 4295121247 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528aee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431571.942955:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431571.943020:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14616:x1876351933659904:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 2417us (2514us total) trans 4295121247 rc 0/0
00000100:00100000:1.0:1789431571.943029:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296479
00010000:00010000:2.0:1789431571.943598:0:14707:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431571.943606:0:14707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528afc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.943613:0:14707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431571.943617:0:14707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528afc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.943624:0:14707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528afc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.943633:0:14707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab5:0x0].0x0 (ffff90ce03149c00)
00010000:00010000:2.0:1789431571.943635:0:14707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431571.943638:0:14707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528afc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.943643:0:14707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528afc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431571.943657:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431571.943658:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431571.943660:0:14707:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789431571.950814:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.951031:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933660288
00000100:00100000:0.0:1789431571.951042:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933660288
00010000:00010000:3.0:1789431571.951074:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528aee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.951086:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528aee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.951094:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528aee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.951101:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.951107:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528aee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.951115:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528aee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.951123:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14395
00010000:00010000:3.0:1789431571.951134:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x6e04e070 (ffff90ce03149a00)
00000100:00100000:0.0:1789431571.951136:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:2349:x1876351933660288:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431571.951141:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.951148:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528aee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.951155:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431571.951155:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528aee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0x6e04e070 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.951177:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528ae0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97b3 expref: 221 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.951192:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10097:0x0].0x0 (ffff90ce15f16f00)
00010000:00010000:0.0:1789431571.951197:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431571.951249:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:2349:x1876351933660288:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 116us (444us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.951256:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14395
00000100:00100000:2.0:1789431571.952889:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876351894266368:0@lo:400:kworker.0
00000100:00100000:3.0:1789431571.952889:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876351894266496:0@lo:400:kworker.0
00000100:00100000:0.0:1789431571.952960:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894266624:0@lo:400:kworker.0
00000100:00100000:1.0:1789431571.952970:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:366be534-ad36-4915-90c5-622719f64be8:3314:1876351894266240:0@lo:400:kworker.0
00000100:00100000:3.0:1789431571.953826:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431571.953996:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431571.954020:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431571.954068:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894266496
00000100:00100000:2.0:1789431571.954076:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894266496
00000100:00100000:0.0:1789431571.954090:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894266624
00000100:00100000:0.0:1789431571.954096:0:14505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894266624
00000100:00100000:2.0:1789431571.954127:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894266368
00000100:00100000:2.0:1789431571.954132:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894266368
00000100:00100000:0.0:1789431571.954147:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135
00000100:00100000:0.0:1789431571.954158:0:14505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3313:x1876351894266624:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789431571.954174:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431571.954220:0:14505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3313:x1876351894266624:12345-0@lo:400:kworker.0 Request processed in 64us (200us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431571.954221:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876351894266752:0@lo:400:kworker.0
00000100:00100000:0.0:1789431571.954234:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135
00000100:00100000:1.0:1789431571.954254:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789431571.954274:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969683 gen 2
00000004:00080000:0.0:1789431571.954280:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1ac75880, transno 4294969681
00000004:00080000:0.0:1789431571.954289:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1ac74380, transno 4294969682
00000004:00080000:0.0:1789431571.954293:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce1ac76300, transno 4294969683
00000100:00100000:0.0:1789431571.954299:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876351894266624:0@lo:400:kworker.0
00000100:00100000:3.0:1789431571.959743:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894266752
00000100:00100000:3.0:1789431571.959758:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894266752
00000100:00100000:3.0:1789431571.959796:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894266240
00000100:00100000:3.0:1789431571.959799:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894266240
00000100:00100000:3.0:1789431571.959864:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309
00000100:00100000:3.0:1789431571.959874:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2ad6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:366be534-ad36-4915-90c5-622719f64be8+19:3314:x1876351894266240:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789431571.960019:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:366be534-ad36-4915-90c5-622719f64be8:3314:1876351894266240:0@lo:400:kworker.0
00000100:00100000:0.0:1789431571.960080:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1717
00000100:00100000:0.0:1789431571.960090:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876351894266496:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789431571.960133:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876351894266496:12345-0@lo:400:kworker.0 Request processed in 46us (6310us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.960139:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1717
00000100:00100000:0.0:1789431571.960157:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1718
00000100:00100000:0.0:1789431571.960163:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876351894266368:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789431571.960199:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876351894266368:12345-0@lo:400:kworker.0 Request processed in 37us (6205us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431571.960205:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1718
00000100:00100000:2.0:1789431571.960418:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876351894266368:0@lo:400:kworker.0
00000100:00080000:2.0:1789431571.960436:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1789431571.960442:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000004:00080000:1.0:1789431571.960952:0:6793:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 0 in progress, 0 in flight, 3 done
00000100:00100000:1.0:1789431571.961034:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1719
00000100:00100000:1.0:1789431571.961042:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876351894266752:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789431571.961112:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876351894266752:12345-0@lo:400:kworker.0 Request processed in 71us (6858us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431571.961118:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1719
00000100:00100000:1.0:1789431571.961158:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876351894266752:0@lo:400:kworker.0
00000100:00080000:2.0:1789431571.961484:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:3.0:1789431571.962633:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2ad6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:366be534-ad36-4915-90c5-622719f64be8+19:3314:x1876351894266240:12345-0@lo:400:kworker.0 Request processed in 86us (5786us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.962651:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309
00000100:00100000:2.0:1789431571.962801:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.962985:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933660160
00000100:00100000:0.0:1789431571.962994:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933660160
00000100:00100000:0.0:1789431571.963036:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296480
00000100:00100000:0.0:1789431571.963045:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+219:14617:x1876351933660160:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431571.963085:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00000100:00100000:3.0:1789431571.963107:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:0.0:1789431571.963108:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528b03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c97ba expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.963132:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933660416
00000100:00100000:3.0:1789431571.963138:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933660416
00000100:00100000:3.0:1789431571.963164:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296481
00010000:00010000:0.0:1789431571.963205:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.963212:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14616:x1876351933660416:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431571.963226:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431571.963237:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528b11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c97c1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431571.963405:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876351894266496:0@lo:400:kworker.0
00010000:00010000:3.0:1789431571.963572:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528b18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963588:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528b18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963600:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528b18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963615:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528b1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xb34b640c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963623:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xb34b640c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963630:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xb34b640c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963688:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528b18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963696:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528b18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963701:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528b18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963707:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.963712:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528b18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963720:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528b18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963732:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431571.963734:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.963739:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528b18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963745:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528b18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963756:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xb34b640c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963762:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528b1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xb34b640c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963768:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528b1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xb34b640c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963773:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431571.963776:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528b1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xb34b640c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963782:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528b1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xb34b640c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963789:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xb34b640c (ffff90ce2d731b00)
00010000:00010000:3.0:1789431571.963792:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.963795:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528b1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xb34b640c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963801:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528b1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xb34b640c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963830:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528b11 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97c1 expref: 222 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963840:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431571.963842:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431571.963845:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528b11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97c1 expref: 222 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.963854:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b600, rc 0)
00000100:00100000:3.0:1789431571.963908:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14616:x1876351933660416:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 737us (801us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431571.963915:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296481
00010000:00010000:0.0:1789431571.964791:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528aa8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97a5 expref: 220 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.964801:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b0a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.965192:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97a5 expref: 220 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.965224:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528aa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97a5 expref: 220 pid: 5849 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.965240:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d508000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894266880:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431571.965310:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf37387c00 going to sleep for 11 seconds
00000100:00100000:3.0:1789431571.967560:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431571.967637:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933660544
00000100:00100000:1.0:1789431571.967646:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933660544
00000100:00100000:1.0:1789431571.967717:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296482
00000100:00100000:1.0:1789431571.967727:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14616:x1876351933660544:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431571.967748:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431571.967767:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528b26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c97c8 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.967837:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528b2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.967852:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.967862:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431571.967895:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008d:0x0]: returning size 16384
00000004:00200000:1.0:1789431571.967899:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431571.967917:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.967939:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528b26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97c8 expref: 223 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.967956:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528b2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97c8 expref: 222 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431571.967977:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431571.967980:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431571.967983:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308c00, rc 0)
00000100:00100000:1.0:1789431571.975865:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14616:x1876351933660544:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8126us (8300us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431571.975877:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296482
00000100:00100000:2.0:1789431571.989290:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431571.989328:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431571.989462:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933660672
00000100:00100000:3.0:1789431571.989472:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933660672
00010000:00010000:3.0:1789431571.989510:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528aa8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97a5 expref: 222 pid: 5849 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431571.989550:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16777
00000100:00100000:3.0:1789431571.989560:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb58450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:2347:x1876351933660672:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431571.989573:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431571.989579:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528aa8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97a5 expref: 222 pid: 5849 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.989591:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528aa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97a5 expref: 222 pid: 5849 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.989615:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10097:0x0].0x0 (ffff90ce15f16f00)
00010000:00010000:3.0:1789431571.989621:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.989640:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.989648:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b0a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431571.989738:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431571.989791:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb58450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:2347:x1876351933660672:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 232us (510us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431571.989798:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16777
00010000:00010000:0.0:1789431571.990030:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528aa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97a5 expref: 221 pid: 5849 timeout: 3129 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.990082:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d508000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894266880:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431571.990105:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.990116:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.990123:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431571.990592:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10097:0x0]: returning size 260096
00010000:00010000:0.0:1789431571.990748:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528b03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97ba expref: 222 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.990766:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97ba expref: 221 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.990775:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10097:0x0].0x0 (ffff90ce15f16f00)
00010000:00010000:0.0:1789431571.990777:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431571.990780:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2000, rc 0)
00000100:00100000:0.0:1789431571.991401:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14617:x1876351933660160:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 28353us (28597us total) trans 4295121248 rc 0/0
00000100:00100000:0.0:1789431571.991410:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296480
00000100:00100000:1.0:1789431571.991826:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933660800
00000100:00100000:1.0:1789431571.991835:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933660800
00000100:00100000:1.0:1789431571.992165:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12596
00000100:00100000:1.0:1789431571.992177:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14616:x1876351933660800:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431571.996246:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431571.996473:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933660928
00000100:00100000:0.0:1789431571.996484:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933660928
00000100:00100000:0.0:1789431571.996542:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296483
00000100:00100000:0.0:1789431571.996552:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14617:x1876351933660928:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431571.996575:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431571.996595:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528b3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10097:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c97cf expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.996902:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528b42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.996916:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b0a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97ba expref: 224 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.996924:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528b42 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.996956:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97ba expref: 224 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431571.996968:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b0a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97ba expref: 224 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431571.996980:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d508000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894267008:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431571.997122:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf37387c00 going to sleep for 11 seconds
00000100:00100000:1.0:1789431571.997978:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14616:x1876351933660800:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 5787us (8633us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431571.997989:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12596
00000100:00100000:3.0:1789431572.008963:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.009088:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933661056
00000100:00100000:1.0:1789431572.009098:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933661056
00010000:00010000:1.0:1789431572.009148:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b0a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97ba expref: 223 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.009185:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16778
00000100:00100000:1.0:1789431572.009195:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:2347:x1876351933661056:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431572.009209:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431572.009215:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b0a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97ba expref: 223 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.009228:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b0a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97ba expref: 223 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.009247:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10097:0x0].0x0 (ffff90ce15f16f00)
00010000:00010000:1.0:1789431572.009252:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528b42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.009261:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.009269:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528b42 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.009285:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431572.009329:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:2347:x1876351933661056:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 136us (376us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.009335:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16778
00000100:00080000:2.0:1789431572.009468:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00010000:00010000:0.0:1789431572.009539:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10097:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97ba expref: 222 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.009555:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d508000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894267008:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431572.009573:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.009581:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.009593:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431572.009638:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10097:0x0]: returning size 260096
00000004:00200000:0.0:1789431572.009642:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431572.009735:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.009764:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528b3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10097:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97cf expref: 222 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.009778:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3a00/0xd8e438fb63528b42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10097:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97cf expref: 221 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.009786:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10097:0x0].0x0 (ffff90ce15f16f00)
00010000:00010000:0.0:1789431572.009789:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431572.009791:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd3a00, rc 0)
00000100:00100000:0.0:1789431572.009864:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14617:x1876351933660928:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 13313us (13627us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.009870:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296483
00000100:00100000:3.0:1789431572.016163:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.016308:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933661184
00000100:00100000:1.0:1789431572.016319:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933661184
00000100:00100000:1.0:1789431572.016376:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296484
00000100:00100000:1.0:1789431572.016387:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14616:x1876351933661184:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431572.016407:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431572.016426:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528b49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c97d6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.016487:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528b50 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.016502:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528b50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.016515:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528b50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.016530:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528b57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xcee77dda bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.016536:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528b57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xcee77dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.016543:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528b57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xcee77dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.016595:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528b50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.016603:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528b50 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.016608:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528b50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.016618:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431572.016622:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528b50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.016629:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528b50 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.016641:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431572.016644:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431572.017140:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528b50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.017151:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528b50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.017166:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528b57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xcee77dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.017173:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528b57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xcee77dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.017180:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528b57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xcee77dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.017186:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431572.017189:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528b57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xcee77dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.017196:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528b57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xcee77dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.017281:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xcee77dda (ffff90ce03149200)
00010000:00010000:1.0:1789431572.017285:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431572.017288:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528b57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xcee77dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.017295:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528b57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xcee77dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.017331:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528b49 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97d6 expref: 222 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.017341:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431572.017343:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431572.017346:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528b49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97d6 expref: 222 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.017356:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309c00, rc 0)
00000100:00100000:1.0:1789431572.017469:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14616:x1876351933661184:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1082us (1315us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431572.017477:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296484
00000100:00100000:3.0:1789431572.023827:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.023902:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933661440
00000100:00100000:1.0:1789431572.023914:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933661440
00000100:00100000:1.0:1789431572.023974:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12597
00000100:00100000:1.0:1789431572.023984:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+221:14617:x1876351933661440:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431572.024253:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14617:x1876351933661440:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 269us (571us total) trans 4295121249 rc 0/0
00000100:00100000:1.0:1789431572.024264:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12597
00000100:00100000:1.0:1789431572.034119:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.034215:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933661568
00000100:00100000:0.0:1789431572.034226:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933661568
00000100:00100000:0.0:1789431572.034284:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296485
00000100:00100000:0.0:1789431572.034295:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:14616:x1876351933661568:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.034315:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.034334:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528b5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c97dd expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034410:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b65 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034426:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034436:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034452:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528b6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034458:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528b6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034464:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528b6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034575:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63528b73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034584:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63528b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034592:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63528b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431572.034624:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10096:0x0]: returning size 260096
00000004:00200000:0.0:1789431572.034628:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431572.034647:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63528b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034662:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63528b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034680:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034687:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b65 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034693:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034698:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd2000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.034702:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034710:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b65 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034721:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431572.034724:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.034729:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034735:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2000/0xd8e438fb63528b65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034747:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528b6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034753:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528b6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034760:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528b6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034764:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf37fd3400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.034768:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528b6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034774:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528b6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034781:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xc3d50206 (ffff90ce07190900)
00010000:00010000:0.0:1789431572.034784:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.034786:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528b6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034792:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3400/0xd8e438fb63528b6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034821:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3c00/0xd8e438fb63528b5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97dd expref: 224 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034833:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63528b73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97dd expref: 223 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.034840:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10096:0x0].0x0 (ffff90ce15f16800)
00010000:00010000:0.0:1789431572.034843:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431572.034845:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf37fd2e00, rc 0)
00000100:00100000:0.0:1789431572.034917:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14616:x1876351933661568:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 625us (808us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.034926:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296485
00000100:00100000:3.0:1789431572.036115:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.036279:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933661696
00000100:00100000:0.0:1789431572.036288:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933661696
00000100:00100000:0.0:1789431572.036344:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296486
00000100:00100000:0.0:1789431572.036355:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14617:x1876351933661696:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.036374:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.036391:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528b7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c97e4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.036449:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63528b81 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.036462:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63528b81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.036472:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63528b81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.036592:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb63528b88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.036604:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb63528b88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.036613:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb63528b88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.036785:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528b8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.036798:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528b8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.036806:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528b8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431572.036842:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00000004:00200000:0.0:1789431572.036846:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431572.036862:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528b8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.036874:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528b8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.036880:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63528b81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.036886:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63528b81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.037038:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63528b81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.037045:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b507800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.037117:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63528b81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.037127:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63528b81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.037138:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431572.037142:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.037147:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63528b81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.037153:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b507800/0xd8e438fb63528b81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.037167:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb63528b88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.037174:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb63528b88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.037179:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb63528b88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.037184:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce2b506200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.037187:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb63528b88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.037193:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb63528b88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.037199:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90ce07190e00)
00010000:00010000:0.0:1789431572.037201:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.037277:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb63528b88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.037285:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce2b506200/0xd8e438fb63528b88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.037323:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd3200/0xd8e438fb63528b7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97e4 expref: 225 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.037343:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528b8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97e4 expref: 224 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.037350:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:0.0:1789431572.037352:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431572.037354:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985fe00, rc 0)
00000100:00100000:0.0:1789431572.037455:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14617:x1876351933661696:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1101us (1345us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.037463:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296486
00000100:00100000:2.0:1789431572.043270:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.043322:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933661824
00000100:00100000:0.0:1789431572.043333:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933661824
00000100:00100000:0.0:1789431572.043458:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14396
00000100:00100000:0.0:1789431572.043470:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:2347:x1876351933661824:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431572.043499:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431572.043526:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2e00/0xd8e438fb63528b73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97dd expref: 224 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.043556:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10096:0x0].0x0 (ffff90ce15f16800)
00010000:00010000:0.0:1789431572.043562:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431572.043620:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:2347:x1876351933661824:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 152us (358us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.043627:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14396
00000100:00100000:0.0:1789431572.050615:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.050649:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.050946:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933661952
00000100:00100000:1.0:1789431572.050956:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933661952
00000100:00100000:1.0:1789431572.051027:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14397
00000100:00100000:1.0:1789431572.051037:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:2348:x1876351933661952:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431572.051069:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431572.051095:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528b8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97e4 expref: 223 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.051114:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:1.0:1789431572.051120:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431572.051177:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+222:2348:x1876351933661952:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 142us (572us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.051185:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14397
00000100:00100000:0.0:1789431572.051610:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.051684:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933662208
00000100:00100000:2.0:1789431572.051691:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933662208
00000100:00100000:2.0:1789431572.051729:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933662464
00000100:00100000:2.0:1789431572.051734:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933662464
00000100:00100000:2.0:1789431572.051765:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296487
00000100:00100000:2.0:1789431572.051773:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+223:14617:x1876351933662208:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431572.051790:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431572.051807:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528b96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c97eb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.051827:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296488
00000100:00100000:0.0:1789431572.051839:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14616:x1876351933662464:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.051848:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.051860:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528b9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c97f2 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.051909:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ba4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.051916:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528bab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.051932:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613000/0xd8e438fb63513617 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2fb6 expref: 225 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.051941:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528bab lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.051971:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613000/0xd8e438fb63513617 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2fb6 expref: 225 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.051985:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613000/0xd8e438fb63513617 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2fb6 expref: 225 pid: 12775 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.052006:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d509f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894267136:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431572.052042:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635288f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9719 expref: 225 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.052078:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ba4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.052101:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635288f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9719 expref: 225 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.052112:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635288f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9719 expref: 225 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.052122:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf37387f00 going to sleep for 11 seconds
00000100:00100000:2.0:1789431572.052123:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf37e92680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894267264:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431572.052155:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead780 going to sleep for 11 seconds
00000100:00100000:1.0:1789431572.059731:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf37e92680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894267264:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431572.059764:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ba4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.059783:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.059861:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d509f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894267136:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431572.059877:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528bab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.059908:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933662592
00000100:00100000:1.0:1789431572.059916:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933662592
00010000:00010000:1.0:1789431572.059953:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635288f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9719 expref: 226 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.059996:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16779
00000100:00100000:1.0:1789431572.060006:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+226:2348:x1876351933662592:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431572.060022:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431572.060030:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635288f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9719 expref: 226 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.060041:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635288f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9719 expref: 226 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.060103:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb635288f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9719 expref: 226 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.060119:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:1.0:1789431572.060124:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ba4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.060133:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ba4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.060142:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ba4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.060170:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431572.060200:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ba4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.060210:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ba4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.060216:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:2348:x1876351933662592:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 210us (434us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.060226:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16779
00000004:00200000:2.0:1789431572.060233:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00010000:00010000:2.0:1789431572.060386:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528b96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97eb expref: 226 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.060422:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ba4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97eb expref: 225 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.060430:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:2.0:1789431572.060433:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431572.060436:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523600, rc 0)
00000100:00100000:2.0:1789431572.060463:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14617:x1876351933662208:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8691us (9813us total) trans 4295121250 rc 0/0
00000100:00100000:2.0:1789431572.060471:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296487
00000100:00100000:2.0:1789431572.066683:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.066939:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.067572:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933662720
00000100:00100000:3.0:1789431572.067584:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933662720
00010000:00010000:3.0:1789431572.067625:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613000/0xd8e438fb63513617 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2fb6 expref: 225 pid: 12775 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.067798:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933662848
00000100:00100000:0.0:1789431572.067803:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933662848
00000100:00100000:0.0:1789431572.067856:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296489
00000100:00100000:0.0:1789431572.067867:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+226:14617:x1876351933662848:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.067889:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.067909:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63528bb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c97f9 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.067990:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528bc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.068006:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ba4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97eb expref: 227 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.068016:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528bc0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.068085:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ba4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97eb expref: 227 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.068099:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ba4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97eb expref: 227 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.068113:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d509f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894267392:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431572.068187:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf37387f00 going to sleep for 11 seconds
00000100:00100000:2.0:1789431572.074562:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16780
00000100:00100000:2.0:1789431572.074578:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf37e90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:2348:x1876351933662720:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431572.074596:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431572.074607:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613000/0xd8e438fb63513617 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2fb6 expref: 227 pid: 12775 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.074620:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613000/0xd8e438fb63513617 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2fb6 expref: 227 pid: 12775 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.074639:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0e613000/0xd8e438fb63513617 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c2fb6 expref: 227 pid: 12775 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.074663:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10096:0x0].0x0 (ffff90ce15f16800)
00010000:00010000:2.0:1789431572.074676:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528bab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.074686:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528bab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.074693:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528bab lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.074731:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431572.074780:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+226:2348:x1876351933662720:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 209us (8114us total) trans 0 rc 0/0
00010000:00010000:1.0:1789431572.074781:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528bab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.074787:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16780
00010000:00010000:1.0:1789431572.074789:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528bab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431572.074813:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10096:0x0]: returning size 260096
00010000:00010000:1.0:1789431572.074957:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528b9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97f2 expref: 227 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.074973:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528bab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97f2 expref: 226 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.074980:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10096:0x0].0x0 (ffff90ce15f16800)
00010000:00010000:1.0:1789431572.074983:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431572.074986:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985e000, rc 0)
00000100:00100000:1.0:1789431572.075023:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+226:14616:x1876351933662464:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 23188us (23413us total) trans 4295121251 rc 0/0
00000100:00100000:1.0:1789431572.075030:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296488
00000100:00100000:1.0:1789431572.075108:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.075130:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933662976
00000100:00100000:0.0:1789431572.075138:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933662976
00010000:00010000:0.0:1789431572.075163:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ba4 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97eb expref: 226 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.075197:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16781
00000100:00100000:0.0:1789431572.075205:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+226:2348:x1876351933662976:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431572.075213:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431572.075218:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ba4 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97eb expref: 226 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.075228:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ba4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97eb expref: 226 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.075240:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:0.0:1789431572.075245:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528bc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.075252:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.075258:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528bc0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.075270:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431572.075943:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+226:2348:x1876351933662976:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 104us (199us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.075955:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16781
00010000:00010000:0.0:1789431572.076004:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ba4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97eb expref: 225 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.076018:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d509f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894267392:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431572.076037:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.076045:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.076091:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431572.076128:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00000004:00200000:0.0:1789431572.076133:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431572.076150:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.076177:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63528bb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97f9 expref: 225 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.076193:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97f9 expref: 224 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.076200:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:0.0:1789431572.076204:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431572.076206:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985e800, rc 0)
00000100:00100000:0.0:1789431572.076252:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf37e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14617:x1876351933662848:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8387us (9313us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.076258:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296489
00000100:00100000:2.0:1789431572.089742:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.089780:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.089864:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933663360
00000100:00100000:1.0:1789431572.089874:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933663360
00000100:00100000:1.0:1789431572.089931:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12598
00000100:00100000:1.0:1789431572.089940:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+224:14617:x1876351933663360:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431572.090204:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14617:x1876351933663360:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 263us (420us total) trans 4295121252 rc 0/0
00000100:00100000:1.0:1789431572.090211:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12598
00000100:00100000:3.0:1789431572.090435:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933663104
00000100:00100000:3.0:1789431572.090440:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933663104
00000100:00100000:3.0:1789431572.090478:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296490
00000100:00100000:3.0:1789431572.090486:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14616:x1876351933663104:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431572.090497:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431572.090516:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528bce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10096:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9800 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.090580:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528bd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.090593:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528bab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97f2 expref: 226 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.090601:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528bd5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.090645:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528bab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97f2 expref: 226 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.090658:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528bab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97f2 expref: 226 pid: 12181 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.090683:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894267520:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431572.090736:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065e240 going to sleep for 11 seconds
00000100:00100000:2.0:1789431572.097035:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.097201:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933663616
00000100:00100000:0.0:1789431572.097212:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933663616
00010000:00010000:0.0:1789431572.097261:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528bab lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97f2 expref: 227 pid: 12181 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.097306:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16782
00000100:00100000:0.0:1789431572.097324:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb59c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:2347:x1876351933663616:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431572.097340:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431572.097347:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528bab lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97f2 expref: 227 pid: 12181 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.097360:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528bab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97f2 expref: 227 pid: 12181 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.097380:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10096:0x0].0x0 (ffff90ce15f16800)
00010000:00010000:0.0:1789431572.097385:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528bd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.097395:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.097402:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528bd5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.097421:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431572.097475:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb59c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:2347:x1876351933663616:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 152us (449us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.097482:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16782
00010000:00010000:3.0:1789431572.097973:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528bab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97f2 expref: 226 pid: 12181 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.097992:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894267520:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431572.098013:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.098021:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.098027:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431572.098107:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10096:0x0]: returning size 260096
00000004:00200000:3.0:1789431572.098112:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431572.098135:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.098166:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528bce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10096:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9800 expref: 226 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.098181:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9800 expref: 225 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.098189:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10096:0x0].0x0 (ffff90ce15f16800)
00010000:00010000:3.0:1789431572.098192:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431572.098194:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b600, rc 0)
00000100:00100000:3.0:1789431572.098331:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14616:x1876351933663104:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7844us (8595us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431572.098338:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296490
00000100:00100000:2.0:1789431572.103845:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.108879:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933663488
00000100:00100000:1.0:1789431572.108894:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933663488
00000100:00100000:1.0:1789431572.108974:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296491
00000100:00100000:1.0:1789431572.108985:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+225:14617:x1876351933663488:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431572.109009:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431572.109032:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528bdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9807 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109111:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528be3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109127:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528be3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109139:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528be3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109155:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528bea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109163:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528bea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109170:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528bea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109272:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528bf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109282:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109290:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431572.109399:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00000004:00200000:1.0:1789431572.109404:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431572.109425:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109437:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109445:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528be3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109452:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528be3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109458:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528be3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109469:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431572.109474:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528be3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109482:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528be3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109493:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431572.109496:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431572.109501:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528be3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109508:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528be3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109521:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528bea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109531:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528bea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109537:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528bea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109542:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431572.109545:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528bea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109551:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528bea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109558:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90ce03149200)
00010000:00010000:1.0:1789431572.109560:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431572.109563:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528bea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109569:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528bea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109597:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528bdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9807 expref: 227 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109611:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9807 expref: 226 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.109618:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:1.0:1789431572.109620:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431572.109623:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309a00, rc 0)
00000100:00100000:1.0:1789431572.110648:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+226:14617:x1876351933663488:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1660us (6807us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.110658:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296491
00000100:00100000:0.0:1789431572.111553:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.111802:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933663872
00000100:00100000:1.0:1789431572.111811:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933663872
00000100:00100000:1.0:1789431572.112025:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12599
00000100:00100000:1.0:1789431572.112037:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0776cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+226:14616:x1876351933663872:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431572.112291:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0776cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:14616:x1876351933663872:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 249us (733us total) trans 4295121253 rc 0/0
00000100:00100000:1.0:1789431572.112299:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12599
00000100:00100000:0.0:1789431572.120574:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.120681:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933664000
00000100:00100000:2.0:1789431572.120691:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933664000
00000100:00100000:2.0:1789431572.120746:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296492
00000100:00100000:2.0:1789431572.120757:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+227:14616:x1876351933664000:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431572.120781:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431572.120802:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528bf8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c980e expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.120865:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528bff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.120879:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528bff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.120890:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528bff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.120906:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.120913:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.120922:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121020:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528c0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121028:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528c0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121036:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528c0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431572.121107:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10096:0x0]: returning size 260096
00000004:00200000:2.0:1789431572.121112:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431572.121134:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528c0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121148:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528c0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121156:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528bff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121161:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528bff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121168:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528bff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121174:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431572.121178:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528bff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121186:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528bff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121197:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431572.121200:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431572.121205:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528bff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121211:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528bff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121225:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121231:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121237:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121242:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431572.121245:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121251:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121259:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xc3d50206 (ffff90cf13195a00)
00010000:00010000:2.0:1789431572.121261:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431572.121264:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121270:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121301:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528bf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c980e expref: 229 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121326:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528c0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c980e expref: 228 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.121334:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10096:0x0].0x0 (ffff90ce15f16800)
00010000:00010000:2.0:1789431572.121336:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431572.121339:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522e00, rc 0)
00000100:00100000:2.0:1789431572.121396:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14616:x1876351933664000:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 640us (830us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431572.121403:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296492
00000100:00100000:2.0:1789431572.127243:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.127331:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.127357:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.127405:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933664256
00000100:00100000:1.0:1789431572.127416:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933664256
00000100:00100000:1.0:1789431572.127467:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296493
00000100:00100000:1.0:1789431572.127478:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14617:x1876351933664256:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431572.127498:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431572.127519:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528c14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9815 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.127618:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528c1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.127643:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528bc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97f9 expref: 229 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.127652:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528bf1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9807 expref: 229 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.127675:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528c1b lrc: 5/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.127710:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9807 expref: 229 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.127723:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528bf1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9807 expref: 229 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.127737:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b2c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894267648:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431572.127820:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97f9 expref: 229 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.127829:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528bc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97f9 expref: 229 pid: 12775 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.127837:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b2c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894267776:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431572.127859:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf06c1b840 going to sleep for 11 seconds
00000100:00100000:3.0:1789431572.129457:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933664384
00000100:00100000:3.0:1789431572.129469:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933664384
00000100:00100000:0.0:1789431572.129567:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933664512
00000100:00100000:0.0:1789431572.129573:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933664512
00000100:00100000:0.0:1789431572.129641:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14398
00000100:00100000:0.0:1789431572.129659:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:2348:x1876351933664512:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431572.129689:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431572.129713:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528c0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c980e expref: 231 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.129732:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10096:0x0].0x0 (ffff90ce15f16800)
00010000:00010000:0.0:1789431572.129737:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431572.129793:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:2348:x1876351933664512:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 144us (2434us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.129801:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14398
00010000:00010000:2.0:1789431572.130551:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528bf1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9807 expref: 229 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.130583:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16783
00000100:00100000:2.0:1789431572.130592:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e615f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:2348:x1876351933664384:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431572.130601:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431572.130606:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528bf1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9807 expref: 229 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.130633:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528bf1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9807 expref: 229 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.130657:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:2.0:1789431572.130662:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528c1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.130680:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528c1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.130851:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431572.130896:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e615f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:2348:x1876351933664384:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 305us (3662us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431572.130903:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16783
00000100:00100000:0.0:1789431572.135808:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.135873:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933664768
00000100:00100000:2.0:1789431572.135883:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933664768
00000100:00100000:2.0:1789431572.135946:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296494
00000100:00100000:2.0:1789431572.135956:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14616:x1876351933664768:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431572.135978:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431572.135997:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528c22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c981c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.136126:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c29 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.136142:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528bd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9800 expref: 230 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.136155:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c29 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.136187:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9800 expref: 230 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.136198:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528bd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9800 expref: 230 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.136211:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0e617b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894267904:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431572.136299:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05eada80 going to sleep for 11 seconds
00000100:00100000:0.0:1789431572.136607:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.136628:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933664896
00000100:00100000:0.0:1789431572.136632:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933664896
00010000:00010000:0.0:1789431572.136682:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528bc0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97f9 expref: 231 pid: 12775 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.136707:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16784
00000100:00100000:0.0:1789431572.136715:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:2347:x1876351933664896:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431572.136725:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431572.136731:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528bc0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97f9 expref: 231 pid: 12775 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.136741:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528bc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97f9 expref: 231 pid: 12775 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.136763:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:0.0:1789431572.136769:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528c1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.136778:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528c1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.136786:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528c1b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.136802:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431572.136832:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:2347:x1876351933664896:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 118us (225us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.136839:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16784
00010000:00010000:3.0:1789431572.137123:0:5847:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@00000000e4a8e34e x1876351894267648) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528bf1 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9807 expref: 230 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.137142:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528bf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9807 expref: 230 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.137155:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b2c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894267648:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431572.137169:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528bc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97f9 expref: 229 pid: 12775 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.137177:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b2c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894267776:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431572.137193:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:3.0:1789431572.137199:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528c1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.137208:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528c1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.137214:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528c1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431572.137230:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00010000:00010000:3.0:1789431572.137384:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528c14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9815 expref: 230 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.137399:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528c1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9815 expref: 229 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.137409:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:3.0:1789431572.137411:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:3.0:1789431572.137414:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309600, rc 0)
00000100:00100000:3.0:1789431572.137451:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14617:x1876351933664256:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9977us (10120us total) trans 4295121254 rc 0/0
00000100:00100000:3.0:1789431572.137458:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296493
00000100:00100000:2.0:1789431572.143020:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce0e617b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894267904:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431572.143078:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c29 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.143769:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.143896:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.143965:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933665152
00000100:00100000:3.0:1789431572.143972:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933665152
00010000:00010000:3.0:1789431572.144010:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528bd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9800 expref: 229 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.144087:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16785
00000100:00100000:3.0:1789431572.144096:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:2348:x1876351933665152:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431572.144112:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431572.144118:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528bd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9800 expref: 229 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.144131:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9800 expref: 229 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.144154:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528bd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9800 expref: 229 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.144170:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10096:0x0].0x0 (ffff90ce15f16800)
00010000:00010000:3.0:1789431572.144175:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c29 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.144183:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c29 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.144191:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c29 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.144219:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431572.144266:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:2348:x1876351933665152:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 172us (371us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431572.144274:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16785
00010000:00010000:1.0:1789431572.144575:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c29 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.144584:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c29 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431572.144603:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10096:0x0]: returning size 260096
00010000:00010000:1.0:1789431572.144781:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528c22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c981c expref: 229 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.144799:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c29 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c981c expref: 228 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.144806:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10096:0x0].0x0 (ffff90ce15f16800)
00010000:00010000:1.0:1789431572.144809:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431572.144812:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523e00, rc 0)
00000100:00100000:1.0:1789431572.144851:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14616:x1876351933664768:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 8897us (9053us total) trans 4295121255 rc 0/0
00000100:00100000:1.0:1789431572.144858:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296494
00000100:00100000:1.0:1789431572.144876:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933665024
00000100:00100000:1.0:1789431572.144881:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933665024
00000100:00100000:2.0:1789431572.145814:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296495
00000100:00100000:2.0:1789431572.145829:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14617:x1876351933665024:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431572.145852:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431572.145871:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528c3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9823 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.145942:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528c45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.145955:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528c1b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9815 expref: 229 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.145969:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528c45 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.146001:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528c1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9815 expref: 229 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.146014:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528c1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9815 expref: 229 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.146028:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0e617b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894268032:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431572.146601:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05eada80 going to sleep for 11 seconds
00000100:00100000:0.0:1789431572.151160:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.151374:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933665280
00000100:00100000:1.0:1789431572.151385:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933665280
00010000:00010000:1.0:1789431572.151425:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528c1b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9815 expref: 230 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.151806:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce0e617b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894268032:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431572.151834:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528c45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.152015:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16786
00000100:00100000:0.0:1789431572.152028:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:2347:x1876351933665280:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431572.152045:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431572.152071:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528c1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9815 expref: 230 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.152083:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528c1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9815 expref: 230 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.152109:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528c1b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9815 expref: 230 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.152129:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:0.0:1789431572.152133:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528c45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.152142:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528c45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.152150:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528c45 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.152176:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431572.152450:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528c45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.152458:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528c45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431572.152504:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00000004:00200000:1.0:1789431572.152509:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431572.152531:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528c45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.152567:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528c3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9823 expref: 230 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.152582:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528c45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9823 expref: 229 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.152589:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:1.0:1789431572.152592:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431572.152595:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523c00, rc 0)
00000100:00100000:0.0:1789431572.152831:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:2347:x1876351933665280:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 805us (1677us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.152841:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16786
00000100:00100000:0.0:1789431572.153738:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14617:x1876351933665024:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 7907us (9964us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.153748:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296495
00000100:00100000:0.0:1789431572.157218:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.157774:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933665408
00000100:00100000:1.0:1789431572.157785:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933665408
00000100:00100000:1.0:1789431572.157890:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296496
00000100:00100000:1.0:1789431572.157902:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+228:14616:x1876351933665408:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431572.157929:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431572.157952:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528c4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10096:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c982a expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.158040:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528c53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.158267:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c29 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c981c expref: 229 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.158277:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528c53 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.158445:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c29 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c981c expref: 229 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.158460:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c29 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c981c expref: 229 pid: 5848 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.158473:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b2c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894268160:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431572.158617:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf06c1b480 going to sleep for 11 seconds
00000100:00100000:1.0:1789431572.164803:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b2c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894268160:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431572.164840:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528c53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.166155:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.166250:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.166596:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933665664
00000100:00100000:1.0:1789431572.166605:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933665664
00000100:00100000:1.0:1789431572.166654:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12600
00000100:00100000:1.0:1789431572.166664:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14617:x1876351933665664:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:1.0:1789431572.166921:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14617:x1876351933665664:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 258us (670us total) trans 4295121256 rc 0/0
00000100:00100000:1.0:1789431572.166929:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12600
00000100:00100000:3.0:1789431572.167135:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933665792
00000100:00100000:3.0:1789431572.167141:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933665792
00010000:00010000:3.0:1789431572.167165:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c29 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c981c expref: 231 pid: 5848 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.167204:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16787
00000100:00100000:3.0:1789431572.167212:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:2347:x1876351933665792:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431572.167222:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431572.167229:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c29 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c981c expref: 231 pid: 5848 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.167241:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c29 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c981c expref: 231 pid: 5848 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.167262:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c29 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10096:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c981c expref: 231 pid: 5848 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.167283:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10096:0x0].0x0 (ffff90ce15f16800)
00010000:00010000:3.0:1789431572.167289:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528c53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.167299:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.167306:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528c53 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.167445:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431572.167471:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:2347:x1876351933665792:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 259us (1322us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431572.167477:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16787
00010000:00010000:1.0:1789431572.168220:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.168230:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431572.168267:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10096:0x0]: returning size 260096
00000004:00200000:1.0:1789431572.168271:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431572.168303:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.168511:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528c4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10096:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c982a expref: 230 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.168530:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309400/0xd8e438fb63528c53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10096:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c982a expref: 229 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.168538:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10096:0x0].0x0 (ffff90ce15f16800)
00010000:00010000:1.0:1789431572.168540:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431572.168543:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309400, rc 0)
00000100:00100000:2.0:1789431572.168786:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14616:x1876351933665408:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10884us (11586us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431572.168794:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296496
00000100:00100000:0.0:1789431572.173132:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.173377:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933665920
00000100:00100000:3.0:1789431572.173388:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933665920
00000100:00100000:3.0:1789431572.173451:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296497
00000100:00100000:3.0:1789431572.173462:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+229:14617:x1876351933665920:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431572.173482:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431572.173503:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528c5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9831 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.173566:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528c61 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.173580:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528c61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.173595:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528c61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.173610:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528c68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.173617:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528c68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.173623:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528c68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.173974:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528c6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.173984:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528c6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.173991:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528c6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431572.174024:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00000004:00200000:3.0:1789431572.174029:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431572.174273:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528c6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.174288:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528c6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.174297:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528c61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.174378:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528c61 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.174388:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528c61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.174394:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.174399:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528c61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.174406:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528c61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.174419:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431572.174422:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431572.174426:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528c61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.174432:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528c61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.174445:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528c68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.174451:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528c68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.174457:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528c68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.174462:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.174465:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528c68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.174471:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528c68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.174478:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90ce2d731b00)
00010000:00010000:3.0:1789431572.174481:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431572.174484:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528c68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.174489:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528c68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.174519:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528c5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9831 expref: 231 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.174531:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528c6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9831 expref: 230 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.174538:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:3.0:1789431572.174540:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431572.174542:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a000, rc 0)
00000100:00100000:2.0:1789431572.177632:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14617:x1876351933665920:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 4160us (4499us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431572.177646:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296497
00000100:00100000:1.0:1789431572.181267:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.181339:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933666304
00000100:00100000:3.0:1789431572.181349:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933666304
00000100:00100000:3.0:1789431572.181402:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12601
00000100:00100000:3.0:1789431572.181413:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+230:14616:x1876351933666304:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431572.181624:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14616:x1876351933666304:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 212us (365us total) trans 4295121257 rc 0/0
00000100:00100000:3.0:1789431572.181647:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12601
00000100:00100000:0.0:1789431572.185620:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.185693:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.185777:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933666560
00000100:00100000:2.0:1789431572.185788:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933666560
00000100:00100000:2.0:1789431572.185842:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296498
00000100:00100000:2.0:1789431572.185852:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14617:x1876351933666560:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431572.185876:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431572.185897:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9838 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.185997:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.186011:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528c45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9823 expref: 232 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.186020:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528c6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9831 expref: 232 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.186028:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 5/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.186093:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528c6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9831 expref: 232 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.186106:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528c6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9831 expref: 232 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.186119:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0e617b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894268288:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431572.186216:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528c45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9823 expref: 232 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.186226:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528c45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9823 expref: 232 pid: 12181 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.186239:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0e614e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894268416:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431572.186265:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05eada80 going to sleep for 11 seconds
00000100:00100000:1.0:1789431572.188989:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933666176
00000100:00100000:1.0:1789431572.189004:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933666176
00010000:00010000:1.0:1789431572.189080:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528c6f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9831 expref: 233 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.189117:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16788
00000100:00100000:1.0:1789431572.189127:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:2350:x1876351933666176:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431572.189141:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431572.189147:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528c6f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9831 expref: 233 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.189159:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528c6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9831 expref: 233 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.189181:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:1.0:1789431572.189187:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.189196:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.189203:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431572.189265:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:2350:x1876351933666176:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 139us (3570us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.189272:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16788
00010000:00010000:0.0:1789431572.190648:0:5848:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@00000000dbfd0855 x1876351894268288) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528c6f lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9831 expref: 232 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.190700:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528c6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9831 expref: 232 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.190715:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce0e617b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894268288:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431572.190729:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce0e614e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876351894268416:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431572.190747:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:0.0:1789431572.190751:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.190759:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.190767:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.191782:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.191837:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.192145:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933666816
00000100:00100000:1.0:1789431572.192154:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933666816
00000100:00100000:1.0:1789431572.192212:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296499
00000100:00100000:1.0:1789431572.192222:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14616:x1876351933666816:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431572.192243:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431572.192262:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528c84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c983f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.192529:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528c8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.192544:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528c8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.192555:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528c8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.192570:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528c92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.192576:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528c92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.192582:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528c92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.192827:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933666688
00000100:00100000:0.0:1789431572.192833:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933666688
00010000:00010000:0.0:1789431572.192857:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528c45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9823 expref: 234 pid: 12181 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.192888:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16789
00000100:00100000:0.0:1789431572.192896:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:2347:x1876351933666688:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431572.192906:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431572.192912:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528c45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9823 expref: 234 pid: 12181 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.192924:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528c45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9823 expref: 234 pid: 12181 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.192947:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528c45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9823 expref: 234 pid: 12181 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.192963:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:0.0:1789431572.192968:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.192976:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.192982:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.193008:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431572.193085:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:2347:x1876351933666688:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 189us (1308us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.193092:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16789
00010000:00010000:0.0:1789431572.193118:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.193126:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431572.193140:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00010000:00010000:1.0:1789431572.193577:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528ca0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.193587:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.193596:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431572.193622:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00000004:00200000:1.0:1789431572.193625:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431572.193650:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.194822:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.194835:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528c8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.194841:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528c8b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.194849:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528c8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.194855:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431572.194860:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528c8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.194868:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528c8b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.194881:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431572.194884:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431572.194888:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528c8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.194894:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528c8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.194908:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528c92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.194913:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528c92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.194919:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528c92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.194923:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431572.194926:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528c92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.194932:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528c92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.194938:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce03149200)
00010000:00010000:1.0:1789431572.194941:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431572.194943:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528c92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.194949:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528c92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.194986:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528c84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c983f expref: 235 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.194999:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c983f expref: 234 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.195006:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:1.0:1789431572.195008:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431572.195010:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309600, rc 0)
00000100:00100000:1.0:1789431572.195093:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14616:x1876351933666816:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2871us (3254us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.195101:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296499
00010000:00010000:0.0:1789431572.195170:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528c76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9838 expref: 234 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.195189:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9838 expref: 232 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.195205:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:0.0:1789431572.195207:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431572.195210:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522600, rc 0)
00000100:00100000:0.0:1789431572.195231:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14617:x1876351933666560:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9382us (9619us total) trans 4295121258 rc 0/0
00000100:00100000:0.0:1789431572.195237:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296498
00000100:00100000:3.0:1789431572.203433:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.203624:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933667072
00000100:00100000:0.0:1789431572.203635:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933667072
00000100:00100000:0.0:1789431572.203729:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14399
00000100:00100000:0.0:1789431572.203740:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:2349:x1876351933667072:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431572.203757:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431572.203782:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528ca0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c983f expref: 232 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.203801:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:0.0:1789431572.203806:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431572.203866:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:2349:x1876351933667072:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 128us (441us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.203874:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14399
00000100:00100000:2.0:1789431572.206345:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.206465:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933666944
00000100:00100000:0.0:1789431572.206475:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933666944
00000100:00100000:0.0:1789431572.206527:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296500
00000100:00100000:0.0:1789431572.206537:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+231:14617:x1876351933666944:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.206560:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.206580:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63528ca7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9846 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.206685:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528cae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.206707:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9838 expref: 232 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.206715:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528cae lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.206748:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9838 expref: 232 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.206772:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9838 expref: 232 pid: 5848 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.206786:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894268544:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431572.206861:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf37387c00 going to sleep for 11 seconds
00000100:00100000:3.0:1789431572.209563:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.209644:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933667328
00000100:00100000:0.0:1789431572.209660:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933667328
00000100:00100000:0.0:1789431572.209878:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296501
00000100:00100000:0.0:1789431572.209891:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14616:x1876351933667328:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.209911:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.209932:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528cb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c984d expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.210033:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e200/0xd8e438fb63528cbc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.210778:0:12181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635289f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9766 expref: 234 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.210792:0:12181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e200/0xd8e438fb63528cbc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.210834:0:12181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635289f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9766 expref: 234 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.210847:0:12181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635289f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9766 expref: 234 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.210861:0:12181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d508700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894268672:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431572.210952:0:12181:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf03941300 going to sleep for 11 seconds
00000100:00100000:0.0:1789431572.215918:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894268544:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431572.215949:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528cae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.217030:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.217763:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933667456
00000100:00100000:0.0:1789431572.217774:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933667456
00010000:00010000:0.0:1789431572.217818:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9838 expref: 235 pid: 5848 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.217862:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16790
00000100:00100000:0.0:1789431572.217872:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:2347:x1876351933667456:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431572.217886:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431572.217894:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9838 expref: 235 pid: 5848 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.217907:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9838 expref: 235 pid: 5848 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.217929:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528c7d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9838 expref: 235 pid: 5848 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.217946:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:0.0:1789431572.217950:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528cae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.217959:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528cae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.217967:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528cae lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.217998:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431572.218042:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:2347:x1876351933667456:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 173us (1019us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.218081:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16790
00010000:00010000:2.0:1789431572.218645:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528cae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.218663:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528cae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431572.218722:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00000004:00200000:2.0:1789431572.218727:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431572.218750:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528cae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.218783:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63528ca7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9846 expref: 234 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.218800:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528cae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9846 expref: 233 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.218807:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:2.0:1789431572.218810:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431572.218813:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985fe00, rc 0)
00000100:00100000:2.0:1789431572.218845:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14617:x1876351933666944:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12310us (12508us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431572.218852:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296500
00000100:00100000:3.0:1789431572.219534:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.219649:0:12181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d508700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12181:1876351894268672:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431572.219696:0:12181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e200/0xd8e438fb63528cbc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.221003:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933667584
00000100:00100000:1.0:1789431572.221013:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933667584
00010000:00010000:1.0:1789431572.221155:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635289f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9766 expref: 233 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.221272:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16791
00000100:00100000:1.0:1789431572.221283:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:2348:x1876351933667584:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431572.221299:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431572.221313:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635289f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9766 expref: 233 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.221332:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635289f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9766 expref: 233 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.221353:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb635289f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9766 expref: 233 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.221369:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:1.0:1789431572.221375:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e200/0xd8e438fb63528cbc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.221385:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e200/0xd8e438fb63528cbc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.221393:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e200/0xd8e438fb63528cbc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.221427:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431572.221480:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:2348:x1876351933667584:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 199us (1948us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.221488:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16791
00010000:00010000:2.0:1789431572.221532:0:12181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e200/0xd8e438fb63528cbc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.221542:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e200/0xd8e438fb63528cbc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431572.221560:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00010000:00010000:2.0:1789431572.221736:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528cb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c984d expref: 233 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.221752:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e200/0xd8e438fb63528cbc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c984d expref: 232 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.221759:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:2.0:1789431572.221761:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431572.221764:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985e200, rc 0)
00000100:00100000:2.0:1789431572.221789:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14616:x1876351933667328:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11902us (12236us total) trans 4295121259 rc 0/0
00000100:00100000:2.0:1789431572.221796:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296501
00000100:00100000:2.0:1789431572.225688:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.225986:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933667712
00000100:00100000:1.0:1789431572.225996:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933667712
00000100:00100000:1.0:1789431572.226130:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296502
00000100:00100000:1.0:1789431572.226142:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14616:x1876351933667712:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431572.226165:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431572.226186:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528cca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9854 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.226282:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528cd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.226295:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e200/0xd8e438fb63528cbc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c984d expref: 233 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.226303:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528cd1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.226345:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e200/0xd8e438fb63528cbc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c984d expref: 233 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.226358:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e200/0xd8e438fb63528cbc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c984d expref: 233 pid: 12181 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.226372:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b2c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894268800:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431572.226438:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf06c1b840 going to sleep for 11 seconds
00000100:00100000:3.0:1789431572.228453:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.228927:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933667840
00000100:00100000:2.0:1789431572.228936:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933667840
00000100:00100000:2.0:1789431572.229036:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296503
00000100:00100000:2.0:1789431572.229045:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14617:x1876351933667840:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431572.229089:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431572.229109:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528cd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c985b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.229164:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528cdf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.229178:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528cdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.229188:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528cdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.229391:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ce6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.229400:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.229408:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.229501:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528ced lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.229510:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528ced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.229517:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528ced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431572.229549:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00000004:00200000:2.0:1789431572.229554:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431572.229571:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528ced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.229583:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528ced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.229593:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528cdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.229599:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528cdf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.229606:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528cdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.229612:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431572.229616:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528cdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.229623:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528cdf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.230082:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431572.230085:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431572.230091:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528cdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.230098:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528cdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.230112:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.230119:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ce6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.230124:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ce6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.230130:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431572.230133:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ce6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.230139:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ce6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.230146:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90cf13195a00)
00010000:00010000:2.0:1789431572.230148:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431572.230150:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ce6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.230156:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528ce6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.230189:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528cd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c985b expref: 236 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.230388:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528ced lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c985b expref: 235 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.230398:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:2.0:1789431572.230400:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431572.230403:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522e00, rc 0)
00000100:00100000:2.0:1789431572.230470:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14617:x1876351933667840:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1425us (2024us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431572.230478:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296503
00000100:00100000:1.0:1789431572.231433:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b2c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894268800:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431572.231459:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528cd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.234345:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.234479:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.234480:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933668224
00000100:00100000:2.0:1789431572.234491:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933668224
00000100:00100000:2.0:1789431572.234597:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296504
00000100:00100000:1.0:1789431572.234609:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933667968
00000100:00100000:2.0:1789431572.234609:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14617:x1876351933668224:12345-192.168.203.4@tcp:36:dbench.0
00000100:00100000:1.0:1789431572.234614:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933667968
00010000:00010000:1.0:1789431572.234638:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e200/0xd8e438fb63528cbc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c984d expref: 236 pid: 12181 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.234691:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:2.0:1789431572.234717:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528ced lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c985b expref: 236 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.234739:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528cae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9846 expref: 235 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.234760:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:2.0:1789431572.234765:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1789431572.234806:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528cf4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.234820:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528cf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.234830:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528cf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431572.234979:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a8461de9 reply state 00000000da872403 transno 4295121260 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528cf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.234987:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431572.235103:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16792
00000100:00100000:2.0:1789431572.235104:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14617:x1876351933668224:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 498us (768us total) trans 4295121260 rc 0/0
00000100:00100000:2.0:1789431572.235111:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296504
00000100:00100000:1.0:1789431572.235112:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:2348:x1876351933667968:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431572.235122:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431572.235128:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e200/0xd8e438fb63528cbc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c984d expref: 235 pid: 12181 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.235344:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e200/0xd8e438fb63528cbc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c984d expref: 235 pid: 12181 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.235358:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e200/0xd8e438fb63528cbc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c984d expref: 235 pid: 12181 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.235370:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:1.0:1789431572.235375:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528cd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.235384:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.235390:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528cd1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.235458:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431572.235483:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:2348:x1876351933667968:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 372us (1003us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.235490:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16792
00010000:00010000:3.0:1789431572.235536:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.235544:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431572.235573:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00000004:00200000:3.0:1789431572.235577:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431572.235591:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.235619:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528cca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9854 expref: 234 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.235635:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9854 expref: 233 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.235642:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431572.235645:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431572.235647:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:3.0:1789431572.235883:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14616:x1876351933667712:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 9545us (10019us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431572.235892:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296502
00010000:00010000:2.0:1789431572.238759:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528cf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.238776:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528cf4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.238784:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528cf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.238791:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431572.238796:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528cf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.238804:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528cf4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.238821:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:2.0:1789431572.238824:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431572.238829:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528cf4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.238836:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528cf4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.241892:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.242269:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933668352
00000100:00100000:1.0:1789431572.242328:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933668352
00000100:00100000:1.0:1789431572.242387:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8451
00000100:00100000:1.0:1789431572.242398:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+67:2347:x1876351933668352:12345-192.168.203.4@tcp:2:dbench.0
00000100:00100000:2.0:1789431572.242538:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00002000:00010000:1.0:1789431572.242599:0:14469:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x51e:0x0] updating lvb size from disk: 74834 -> 74834
00002000:00010000:1.0:1789431572.242604:0:14469:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x51e:0x0] updating lvb mtime from disk: 1789431558 -> 1789431546
00002000:00010000:1.0:1789431572.242606:0:14469:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x51e:0x0] updating lvb atime from disk: 1789431550 -> 1789431561
00002000:00010000:1.0:1789431572.242608:0:14469:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x51e:0x0] updating lvb ctime from disk: 1789431571 -> 1789431571
00002000:00010000:1.0:1789431572.242611:0:14469:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x51e:0x0] updating lvb blocks from disk: 259 -> 259
00000100:00100000:1.0:1789431572.242744:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2347:x1876351933668352:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 288us (800us total) trans 4294969688 rc 0/0
00000100:00100000:1.0:1789431572.242753:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8451
00000100:00100000:3.0:1789431572.242812:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933668608
00000100:00100000:3.0:1789431572.242817:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933668608
00000100:00100000:3.0:1789431572.242853:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12602
00000100:00100000:3.0:1789431572.242861:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+232:14616:x1876351933668608:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431572.243084:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14616:x1876351933668608:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 158us (480us total) trans 4295121261 rc 0/0
00000100:00100000:3.0:1789431572.243093:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12602
00000100:00100000:2.0:1789431572.248944:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.249041:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933668864
00000100:00100000:0.0:1789431572.249088:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933668864
00000100:00100000:0.0:1789431572.249164:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296505
00000100:00100000:0.0:1789431572.249175:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14617:x1876351933668864:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.249210:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.249233:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528cfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9869 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249300:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249432:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249448:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249466:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249474:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249481:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249541:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249548:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249555:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249561:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985f800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.249564:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249571:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249582:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431572.249585:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.249590:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249595:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249608:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249614:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249619:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249623:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.249626:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249632:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249644:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xddd0a3dd (ffff90ce07190e00)
00010000:00010000:0.0:1789431572.249647:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.249650:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249674:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249781:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528cfb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9869 expref: 234 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249792:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431572.249794:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.249798:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528cfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9869 expref: 234 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.249808:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985e800, rc 0)
00000100:00100000:0.0:1789431572.249870:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14617:x1876351933668864:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 697us (935us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431572.249878:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296505
00000100:00100000:2.0:1789431572.254116:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.254202:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933668736
00000100:00100000:1.0:1789431572.254221:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933668736
00000100:00100000:1.0:1789431572.254272:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296506
00000100:00100000:1.0:1789431572.254282:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+233:14616:x1876351933668736:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431572.254300:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431572.254329:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9862 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254392:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528d17 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254406:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528d17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254417:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528d17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254430:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528d1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254441:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254449:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254541:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528d25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254549:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254556:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431572.254588:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00000004:00200000:1.0:1789431572.254593:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431572.254611:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254622:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254631:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528d17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254638:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528d17 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254644:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528d17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254824:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431572.254829:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528d17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254838:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528d17 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254850:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431572.254853:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431572.254857:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528d17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254864:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528d17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254879:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254886:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528d1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254892:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528d1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254897:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431572.254900:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528d1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254905:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528d1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254916:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce03149200)
00010000:00010000:1.0:1789431572.254919:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431572.254922:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528d1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254928:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528d1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254958:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9862 expref: 235 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254971:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528d25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9862 expref: 234 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.254979:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:1.0:1789431572.254982:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431572.254985:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308200, rc 0)
00000100:00100000:1.0:1789431572.255041:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14616:x1876351933668736:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 761us (934us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.255086:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296506
00000100:00100000:2.0:1789431572.258218:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.258566:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933669120
00000100:00100000:0.0:1789431572.258576:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933669120
00000100:00100000:0.0:1789431572.258690:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296507
00000100:00100000:0.0:1789431572.258702:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+234:14617:x1876351933669120:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.258722:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.258725:0:12775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431572.258758:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf37fd2200/0xd8e438fb63528a15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9774 expref: 234 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.258778:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431572.258783:0:12775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431572.258797:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528d2c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9870 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.258902:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d33 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.258916:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.258926:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.258939:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.258947:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.258954:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431572.259779:0:12775:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x51f:0x0], index 0: 0
00010000:00010000:0.0:1789431572.259939:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63528d41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10aba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.259952:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63528d41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aba:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.259964:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63528d41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10aba:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.259995:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.260003:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d33 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.260010:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.260016:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.260020:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.260027:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d33 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.260038:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431572.260041:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.260045:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d33 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.260498:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528d33 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431572.260514:0:12775:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003233b611 reply state 00000000e4e47357 transno 4295121262 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.260523:0:12775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431572.260556:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528d2c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9870 expref: 236 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.260570:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63528d41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10aba:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9870 expref: 235 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.260577:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aba:0x0].0x0 (ffff90ce07190900)
00010000:00010000:0.0:1789431572.260580:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431572.260582:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985ea00, rc 0)
00000100:00100000:0.0:1789431572.260647:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14617:x1876351933669120:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1947us (2438us total) trans 4295121262 rc 0/0
00000100:00100000:0.0:1789431572.260656:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296507
00000100:00100000:2.0:1789431572.263242:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.263277:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.263459:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933669504
00000100:00100000:1.0:1789431572.263470:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933669504
00000100:00100000:1.0:1789431572.263532:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14400
00000100:00100000:1.0:1789431572.263542:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:2350:x1876351933669504:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431572.263557:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431572.263580:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528d25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9862 expref: 236 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.263600:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:1.0:1789431572.263606:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431572.263652:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:2350:x1876351933669504:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 112us (374us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.263659:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14400
00000100:00100000:0.0:1789431572.263829:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933669376
00000100:00100000:0.0:1789431572.263834:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933669376
00000100:00100000:0.0:1789431572.263873:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296508
00000100:00100000:0.0:1789431572.263882:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+235:14616:x1876351933669376:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.263897:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.263913:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528d4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9877 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.263953:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.263961:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.263967:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.263972:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985f800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.263976:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.263983:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.263992:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xddd0a3dd (ffff90ce07190e00)
00010000:00010000:3.0:1789431572.263995:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431572.263999:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.264000:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528d56 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.264006:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528d3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.264012:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528cd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9854 expref: 236 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.264021:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528d56 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.264072:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9854 expref: 235 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.264086:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528cd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9854 expref: 235 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.264100:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d508700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894268928:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431572.264155:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf37387c00 going to sleep for 11 seconds
00000100:00100000:2.0:1789431572.266917:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.267103:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933669632
00000100:00100000:0.0:1789431572.267112:0:14491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933669632
00000100:00100000:0.0:1789431572.267172:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8452
00000100:00100000:0.0:1789431572.267182:0:14491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+68:2347:x1876351933669632:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.267200:0:14491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.267219:0:14491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014acd8f5/0xd8e438fb63528d5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x51f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c987e expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789431572.267247:0:14491:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x51f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431572.267266:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51f:0x0].0x0 since=3030s v=(0 0)
00010000:00010000:0.0:1789431572.267270:0:14491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51f:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431572.267279:0:14491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014acd8f5/0xd8e438fb63528d5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c987e expref: 69 pid: 14491 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.267303:0:14491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000014acd8f5/0xd8e438fb63528d5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c987e expref: 69 pid: 14491 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.267322:0:14491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985e200, rc 0)
00000100:00100000:0.0:1789431572.267455:0:14491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2347:x1876351933669632:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 274us (546us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.267462:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8452
00000100:00100000:2.0:1789431572.273344:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.273385:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.273495:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d508700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894268928:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431572.273516:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933670016
00000100:00100000:1.0:1789431572.273525:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933670016
00010000:00010000:0.0:1789431572.273526:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528d56 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.273564:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528cd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9854 expref: 236 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.273606:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16793
00000100:00100000:1.0:1789431572.273615:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eb59050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:2347:x1876351933670016:12345-192.168.203.4@tcp:103:ldlm_bl.0
00000100:00100000:3.0:1789431572.273624:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933669888
00010000:00010000:1.0:1789431572.273631:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:3.0:1789431572.273631:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933669888
00010000:00010000:1.0:1789431572.273640:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528cd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9854 expref: 237 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.273655:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9854 expref: 237 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.273687:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12603
00010000:00010000:1.0:1789431572.273688:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528cd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9854 expref: 237 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.273700:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+237:14617:x1876351933669888:12345-192.168.203.4@tcp:35:dbench.0
00010000:00010000:1.0:1789431572.273707:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:1.0:1789431572.273713:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528d56 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.273727:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528d56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.273735:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528d56 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.273944:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431572.273998:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eb59050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+237:2347:x1876351933670016:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 384us (612us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.274007:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16793
00000100:00100000:3.0:1789431572.274022:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14617:x1876351933669888:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 324us (686us total) trans 4295121263 rc 0/0
00000100:00100000:3.0:1789431572.274076:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12603
00010000:00010000:0.0:1789431572.274227:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528d56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.274236:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528d56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431572.274253:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00010000:00010000:0.0:1789431572.274642:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528d4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9877 expref: 237 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.274661:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528d56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9877 expref: 236 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.274679:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:0.0:1789431572.274682:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:0.0:1789431572.274684:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985f000, rc 0)
00000100:00100000:0.0:1789431572.274723:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14616:x1876351933669376:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 10843us (11488us total) trans 4295121264 rc 0/0
00000100:00100000:0.0:1789431572.274734:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296508
00000100:00100000:2.0:1789431572.286424:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.286486:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933670272
00000100:00100000:0.0:1789431572.286497:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933670272
00000100:00100000:2.0:1789431572.286497:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.286557:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12604
00000100:00100000:0.0:1789431572.286567:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+236:14617:x1876351933670272:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431572.286837:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+237:14617:x1876351933670272:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 270us (421us total) trans 4295121265 rc 0/0
00000100:00100000:0.0:1789431572.286844:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12604
00000100:00100000:1.0:1789431572.287132:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933670400
00000100:00100000:1.0:1789431572.287137:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933670400
00000100:00100000:1.0:1789431572.287177:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296509
00000100:00100000:1.0:1789431572.287185:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+237:14616:x1876351933670400:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431572.287197:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431572.287218:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528d6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9885 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.287285:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.287300:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528d56 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9877 expref: 238 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.287590:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d72 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.287630:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528d56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9877 expref: 238 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.287644:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528d56 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9877 expref: 238 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.287658:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b2c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894269056:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431572.287839:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf115390c0 going to sleep for 11 seconds
00000100:00100000:2.0:1789431572.292919:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.293083:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933670656
00000100:00100000:3.0:1789431572.293092:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933670656
00000100:00100000:3.0:1789431572.293148:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12605
00000100:00100000:3.0:1789431572.293158:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0776e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+239:14617:x1876351933670656:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431572.293422:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0776e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+240:14617:x1876351933670656:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 265us (512us total) trans 4295121266 rc 0/0
00000100:00100000:3.0:1789431572.293430:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12605
00000100:00100000:2.0:1789431572.293686:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.294683:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933670784
00000100:00100000:3.0:1789431572.294692:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933670784
00010000:00010000:3.0:1789431572.294728:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528d56 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9877 expref: 240 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.294765:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16794
00000100:00100000:3.0:1789431572.294774:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+240:2348:x1876351933670784:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431572.294787:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431572.294794:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528d56 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9877 expref: 240 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.294807:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528d56 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9877 expref: 240 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.294829:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431572.294834:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.294843:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.294850:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d72 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.294869:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431572.294917:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+240:2348:x1876351933670784:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 144us (1231us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431572.294924:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16794
00010000:00010000:1.0:1789431572.297934:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528d56 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9877 expref: 239 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.297960:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b2c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894269056:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431572.297983:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.297993:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.298000:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431572.298075:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00000004:00200000:1.0:1789431572.298080:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431572.298102:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.298136:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528d6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9885 expref: 239 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.298152:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9885 expref: 238 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.298162:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:1.0:1789431572.298165:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431572.298168:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309a00, rc 0)
00000100:00100000:1.0:1789431572.298441:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+238:14616:x1876351933670400:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11255us (11944us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.298451:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296509
00000100:00100000:2.0:1789431572.303234:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.303422:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933671040
00000100:00100000:3.0:1789431572.303433:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933671040
00000100:00100000:3.0:1789431572.303495:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296510
00000100:00100000:3.0:1789431572.303507:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+238:14617:x1876351933671040:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431572.303566:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431572.303593:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63528d41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10aba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9870 expref: 238 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.303618:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aba:0x0].0x0 (ffff90ce07190900)
00010000:00010000:3.0:1789431572.303631:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431572.303653:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528d79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.303677:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528d79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.303697:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528d79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.303716:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528d80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.303724:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528d80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.303731:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528d80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.303843:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528d87 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10aba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.303852:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528d87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.303859:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528d87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:2.0:1789431572.304796:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1253, 64 off88384
00000004:00080000:2.0:1789431572.304808:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3030335759014ns, next at 3031335756277ns, rc = 0
00010000:00010000:2.0:1789431572.304869:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528d8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10aba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.304881:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528d8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.304890:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528d8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10aba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.304897:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528d8e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.304903:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528d8e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10aba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.304909:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528d8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.304929:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431572.304948:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528d87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10aba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.304955:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528d87 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10aba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.304966:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528d87 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.304972:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431572.304975:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528d87 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10aba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.304983:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528d87 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10aba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.304992:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aba:0x0].0x0 (ffff90ce2d731400)
00010000:00010000:2.0:1789431572.304995:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:2.0:1789431572.304999:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528d87 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10aba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.305005:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528d87 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10aba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.305021:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528d79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.305028:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528d79 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.305036:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528d79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.305040:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431572.305043:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528d79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.305081:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528d79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.305088:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431572.305090:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431572.305093:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528d79 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.305098:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528d79 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:2.0:1789431572.305107:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ce2c56bd reply state 00000000532df0b0 transno 4295121267 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528d80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.305114:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431572.305399:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1789431572.305416:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528d8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aba:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.305422:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523e00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:3.0:1789431572.305426:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528d8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10aba:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.305433:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528d8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10aba:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.305442:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10aba:0x0].0x0 (ffff90ce2d731400)
00010000:00010000:3.0:1789431572.305444:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:3.0:1789431572.305447:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528d8e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10aba:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.305452:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528d8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10aba:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.305467:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431572.305469:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431572.305470:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789431572.305498:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+239:14617:x1876351933671040:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1691us (1971us total) trans 4295121267 rc 0/0
00000100:00100000:2.0:1789431572.305508:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296510
00010000:00010000:3.0:1789431572.306872:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528d80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.306886:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528d80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.306893:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528d80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.306900:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.306904:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528d80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.306912:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528d80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.306925:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xddd0a3dd (ffff90ce2d731b00)
00010000:00010000:3.0:1789431572.306928:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431572.306932:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528d80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.306938:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528d80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.308679:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.308749:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933671296
00000100:00100000:0.0:1789431572.308759:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933671296
00000100:00100000:0.0:1789431572.308821:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12606
00000100:00100000:0.0:1789431572.308831:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+238:14616:x1876351933671296:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:0.0:1789431572.309083:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+239:14616:x1876351933671296:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 252us (421us total) trans 4295121268 rc 0/0
00000100:00100000:0.0:1789431572.309091:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12606
00000100:00100000:2.0:1789431572.312876:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.312960:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933671424
00000100:00100000:1.0:1789431572.312970:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933671424
00000100:00100000:1.0:1789431572.313029:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296511
00000100:00100000:1.0:1789431572.313039:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+239:14617:x1876351933671424:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431572.313289:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431572.313503:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63528d95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c988c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313570:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528d9c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313585:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528d9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313600:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528d9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313616:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528da3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313623:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313629:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313739:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528daa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313748:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528daa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313756:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528daa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431572.313789:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00000004:00200000:2.0:1789431572.313794:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431572.313813:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528daa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313824:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528daa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313832:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528d9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313842:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528d9c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313848:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528d9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313854:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431572.313857:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528d9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313865:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528d9c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313877:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431572.313879:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431572.313884:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528d9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313891:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528d9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313903:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313909:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528da3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313914:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528da3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313918:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431572.313922:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528da3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313927:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528da3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313934:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90cf13195a00)
00010000:00010000:2.0:1789431572.313936:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431572.313939:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528da3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313945:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528da3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313975:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63528d95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c988c expref: 241 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313989:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528daa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c988c expref: 240 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.313995:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:2.0:1789431572.313998:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431572.314000:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522200, rc 0)
00000100:00100000:2.0:1789431572.314319:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+240:14617:x1876351933671424:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1272us (1443us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431572.314328:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296511
00000100:00100000:1.0:1789431572.322289:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.322450:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933671552
00000100:00100000:0.0:1789431572.322459:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933671552
00000100:00100000:0.0:1789431572.322512:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296512
00000100:00100000:0.0:1789431572.322522:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+240:14616:x1876351933671552:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.322546:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.322565:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528db1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9893 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322626:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528db8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322645:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528db8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322679:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528db8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322696:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528dbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322703:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528dbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322710:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528dbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322806:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528dc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322815:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322823:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431572.322856:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00000004:00200000:0.0:1789431572.322860:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431572.322878:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322889:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322901:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528db8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322908:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528db8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322915:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528db8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322922:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.322926:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528db8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322933:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528db8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322944:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431572.322947:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.322951:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528db8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322957:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528db8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322969:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528dbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322975:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528dbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322981:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528dbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322987:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985fe00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.322990:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528dbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.322996:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528dbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.323002:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce07190300)
00010000:00010000:0.0:1789431572.323005:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.323007:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528dbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.323013:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528dbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.323038:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528db1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9893 expref: 242 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.323443:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9893 expref: 241 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.323454:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:0.0:1789431572.323456:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431572.323459:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985ee00, rc 0)
00000100:00100000:0.0:1789431572.323525:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+241:14616:x1876351933671552:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1003us (1244us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.323532:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296512
00000100:00100000:0.0:1789431572.332365:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.332423:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.332537:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933671680
00000100:00100000:2.0:1789431572.332547:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933671680
00000100:00100000:2.0:1789431572.332613:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14401
00000100:00100000:2.0:1789431572.332623:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+241:2347:x1876351933671680:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431572.332641:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431572.332674:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528dc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9893 expref: 241 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.332693:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:2.0:1789431572.332698:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431572.332748:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+240:2347:x1876351933671680:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 126us (392us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431572.332755:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14401
00000100:00100000:3.0:1789431572.332876:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933671936
00000100:00100000:3.0:1789431572.332881:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933671936
00000100:00100000:3.0:1789431572.332921:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296513
00000100:00100000:3.0:1789431572.332929:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+240:14617:x1876351933671936:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431572.332944:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431572.332960:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528dcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c989a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.333083:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528dd4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.333098:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528daa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c988c expref: 241 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.333107:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528dd4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.333136:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528daa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c988c expref: 241 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.333150:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528daa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c988c expref: 241 pid: 5848 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.333163:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894269184:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431572.333211:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065ecc0 going to sleep for 11 seconds
00000100:00100000:3.0:1789431572.334360:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.334514:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933672192
00000100:00100000:0.0:1789431572.334523:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933672192
00000100:00100000:0.0:1789431572.334573:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296514
00000100:00100000:0.0:1789431572.334583:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+242:14616:x1876351933672192:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.334601:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.334616:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528ddb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c98a1 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.334706:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528de2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.334721:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9885 expref: 243 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.334729:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528de2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.334756:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9885 expref: 243 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.334767:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9885 expref: 243 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.334779:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d50ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894269312:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431572.334834:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3e6d1600 going to sleep for 11 seconds
00000100:00100000:3.0:1789431572.348396:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876351894269184:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431572.348425:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528dd4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.348519:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.348634:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933672448
00000100:00100000:0.0:1789431572.348641:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933672448
00010000:00010000:0.0:1789431572.348708:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d72 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9885 expref: 244 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.348744:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16795
00000100:00100000:0.0:1789431572.348753:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:2348:x1876351933672448:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431572.348767:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431572.348773:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d72 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9885 expref: 244 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.348784:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9885 expref: 244 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.348804:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:0.0:1789431572.348809:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528de2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.348819:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528de2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.348826:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528de2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.348839:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431572.349160:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:2348:x1876351933672448:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 406us (639us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.349168:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16795
00010000:00010000:2.0:1789431572.350141:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528d72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9885 expref: 243 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.350162:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d50ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894269312:192.168.203.4@tcp:104:
00010000:00010000:2.0:1789431572.350182:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528de2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.350191:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528de2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.350197:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528de2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431572.350217:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00010000:00010000:2.0:1789431572.350484:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528ddb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98a1 expref: 244 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.350500:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528de2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98a1 expref: 243 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.350514:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:2.0:1789431572.350517:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431572.350520:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985fe00, rc 0)
00000100:00100000:2.0:1789431572.350566:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+243:14616:x1876351933672192:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 15984us (16210us total) trans 4295121269 rc 0/0
00000100:00100000:2.0:1789431572.350573:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296514
00000100:00100000:1.0:1789431572.360962:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.361005:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.361130:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933672320
00000100:00100000:3.0:1789431572.361140:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933672320
00010000:00010000:3.0:1789431572.361180:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528daa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c988c expref: 243 pid: 5848 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.361293:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933672576
00000100:00100000:2.0:1789431572.361298:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933672576
00000100:00100000:2.0:1789431572.361348:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296515
00000100:00100000:2.0:1789431572.361360:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14616:x1876351933672576:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431572.361378:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431572.361398:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63528df0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c98a8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.361482:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528df7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.361497:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528de2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98a1 expref: 245 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.361507:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528df7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.361538:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528de2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98a1 expref: 245 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.361550:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528de2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98a1 expref: 245 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.361564:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1a56bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894269440:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431572.361641:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05eada80 going to sleep for 11 seconds
00000100:00100000:3.0:1789431572.362021:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16796
00000100:00100000:3.0:1789431572.362032:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:2348:x1876351933672320:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431572.362043:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431572.362097:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528daa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c988c expref: 245 pid: 5848 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.362109:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528daa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c988c expref: 245 pid: 5848 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.362127:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528daa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c988c expref: 245 pid: 5848 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.362145:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:3.0:1789431572.362150:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528dd4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.362161:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.362167:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528dd4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.362196:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431572.362225:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:2348:x1876351933672320:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 197us (1273us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431572.362233:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16796
00010000:00010000:2.0:1789431572.362303:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.362320:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431572.362336:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00010000:00010000:2.0:1789431572.362469:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63528dcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c989a expref: 245 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.362485:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c989a expref: 244 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.362492:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:2.0:1789431572.362494:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431572.362497:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7a200, rc 0)
00000100:00100000:2.0:1789431572.362521:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14617:x1876351933671936:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 29594us (30098us total) trans 4295121270 rc 0/0
00000100:00100000:2.0:1789431572.362528:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296513
00000100:00100000:3.0:1789431572.373024:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.373268:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1a56bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894269440:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431572.373294:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528df7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.373822:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933672704
00000100:00100000:2.0:1789431572.373830:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933672704
00000100:00100000:2.0:1789431572.373890:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296516
00000100:00100000:2.0:1789431572.373901:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14617:x1876351933672704:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431572.373925:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431572.373945:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528e05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c98af expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.374025:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528e0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.374040:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528dd4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c989a expref: 245 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.374071:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528e0c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.374106:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c989a expref: 245 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.374119:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528dd4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c989a expref: 245 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.374133:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1a569880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894269568:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431572.374257:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead900 going to sleep for 11 seconds
00000100:00100000:1.0:1789431572.386354:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.386575:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933672832
00000100:00100000:3.0:1789431572.386587:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933672832
00010000:00010000:3.0:1789431572.386629:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528de2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98a1 expref: 246 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.386681:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16797
00000100:00100000:3.0:1789431572.386698:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+246:2348:x1876351933672832:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1789431572.386711:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431572.386718:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528de2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98a1 expref: 246 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.386732:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528de2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98a1 expref: 246 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.386754:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528de2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98a1 expref: 246 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.386772:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431572.386777:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528df7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.386786:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528df7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.386795:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528df7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.386818:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1789431572.386867:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:2348:x1876351933672832:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 171us (521us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431572.386875:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16797
00010000:00010000:1.0:1789431572.391099:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528df7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.391116:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528df7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431572.391172:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00000004:00200000:1.0:1789431572.391177:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431572.391199:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528df7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.391242:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522800/0xd8e438fb63528df0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98a8 expref: 245 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.391264:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528df7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98a8 expref: 244 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.391272:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:1.0:1789431572.391276:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1789431572.391279:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38523600, rc 0)
00000100:00100000:1.0:1789431572.394755:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14616:x1876351933672576:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 33383us (33735us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.394768:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296515
00000100:00100000:3.0:1789431572.395129:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1a569880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894269568:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431572.395157:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528e0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.409647:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.409785:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933672960
00000100:00100000:0.0:1789431572.409795:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933672960
00010000:00010000:0.0:1789431572.409840:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528dd4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c989a expref: 244 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.409929:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16798
00000100:00100000:3.0:1789431572.410489:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.410571:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933673088
00000100:00100000:2.0:1789431572.410578:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933673088
00000100:00100000:2.0:1789431572.410617:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296517
00000100:00100000:2.0:1789431572.410625:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14616:x1876351933673088:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431572.410641:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431572.410660:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528e13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c98b6 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.410893:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e1a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.410909:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.410922:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.410938:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528e21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.410945:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528e21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.410953:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528e21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411086:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528e28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411096:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528e28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411105:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528e28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431572.411139:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00000004:00200000:2.0:1789431572.411144:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000100:00100000:0.0:1789431572.411150:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+246:2348:x1876351933672960:12345-192.168.203.4@tcp:103:ldlm_bl.0
00000004:00010000:2.0:1789431572.411164:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528e28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.411166:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431572.411178:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528dd4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c989a expref: 246 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411185:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528e28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411196:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411203:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e1a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411209:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411215:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431572.411219:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411226:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e1a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411236:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:2.0:1789431572.411239:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431572.411244:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411251:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.411254:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c989a expref: 246 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411266:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528e21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411275:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528e21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.411277:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528dd4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c989a expref: 246 pid: 5849 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411291:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528e21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411299:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.411300:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:2.0:1789431572.411302:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528e21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.411307:0:6715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528e0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411313:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528e21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.411319:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411325:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90cf13195a00)
00010000:00010000:0.0:1789431572.411327:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528e0c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411330:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431572.411335:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528e21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411342:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528e21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411372:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528e13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98b6 expref: 246 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411386:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528e28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98b6 expref: 245 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.411393:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:2.0:1789431572.411396:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431572.411398:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522200, rc 0)
00000100:00100000:2.0:1789431572.411466:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14616:x1876351933673088:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 842us (978us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431572.411474:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296517
00010000:00010000:0.0:1789431572.411633:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431572.411660:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:2348:x1876351933672960:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1721us (2023us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.411678:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16798
00010000:00010000:3.0:1789431572.411909:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.411919:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431572.411952:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00000004:00200000:3.0:1789431572.411956:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431572.411979:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.412004:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528e05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98af expref: 245 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.412017:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528e0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98af expref: 244 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.412024:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:3.0:1789431572.412027:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431572.412029:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522400, rc 0)
00000100:00100000:3.0:1789431572.412102:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14617:x1876351933672704:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 38202us (39147us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431572.412109:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296516
00000100:00100000:2.0:1789431572.429691:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.429780:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.429959:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933673344
00000100:00100000:3.0:1789431572.429970:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933673344
00000100:00100000:3.0:1789431572.430029:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12607
00000100:00100000:3.0:1789431572.430038:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+243:14617:x1876351933673344:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431572.430545:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14617:x1876351933673344:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 505us (861us total) trans 4295121271 rc 0/0
00000100:00100000:3.0:1789431572.430554:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12607
00000100:00100000:0.0:1789431572.431423:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933673600
00000100:00100000:0.0:1789431572.431431:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933673600
00000100:00100000:1.0:1789431572.434025:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296518
00000100:00100000:1.0:1789431572.434037:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14616:x1876351933673600:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431572.434100:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:1.0:1789431572.434128:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528e28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98b6 expref: 244 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.434149:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528df7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98a8 expref: 243 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.434159:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:1.0:1789431572.434164:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431572.434205:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528e2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.434219:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528e2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.434229:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528e2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:1.0:1789431572.434384:0:5849:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000086e251e8 reply state 000000000504afc7 transno 4295121272 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528e2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.434394:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:1.0:1789431572.434503:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14616:x1876351933673600:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 467us (4721us total) trans 4295121272 rc 0/0
00000100:00100000:1.0:1789431572.434509:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296518
00010000:00010000:3.0:1789431572.436556:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528e2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.436575:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528e2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.436582:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528e2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.436588:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.436593:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528e2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.436600:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528e2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.436625:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431572.436628:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431572.436634:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528e2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.436640:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528e2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.438747:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.438833:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.438938:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933673856
00000100:00100000:3.0:1789431572.438947:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933673856
00000100:00100000:3.0:1789431572.439080:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8453
00000100:00100000:3.0:1789431572.439090:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2348:x1876351933673856:12345-192.168.203.4@tcp:2:dbench.0
00002000:00010000:3.0:1789431572.439290:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x51e:0x0] updating lvb size from disk: 74834 -> 74834
00002000:00010000:3.0:1789431572.439294:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x51e:0x0] updating lvb mtime from disk: 1789431558 -> 1789431546
00002000:00010000:3.0:1789431572.439297:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x51e:0x0] updating lvb atime from disk: 1789431550 -> 1789431561
00002000:00010000:3.0:1789431572.439299:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x51e:0x0] updating lvb ctime from disk: 1789431571 -> 1789431571
00002000:00010000:3.0:1789431572.439302:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x51e:0x0] updating lvb blocks from disk: 259 -> 259
00000100:00100000:3.0:1789431572.439350:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2348:x1876351933673856:12345-192.168.203.4@tcp:2:dbench.0 Request processed in 262us (517us total) trans 4294970091 rc 0/0
00000100:00100000:3.0:1789431572.439357:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8453
00000100:00080000:0.0:1789431572.439853:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1789431572.440255:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933673728
00000100:00100000:2.0:1789431572.440263:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933673728
00000100:00100000:2.0:1789431572.440306:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296519
00000100:00100000:2.0:1789431572.440314:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+243:14617:x1876351933673728:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431572.440334:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431572.440352:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528e36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c98bd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440566:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e3d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440581:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440591:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440604:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528e44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440611:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440617:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440717:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528e4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440727:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528e4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440734:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528e4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431572.440764:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab8:0x0]: returning size 74834
00000004:00200000:2.0:1789431572.440767:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:2.0:1789431572.440784:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528e4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440794:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528e4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440801:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440807:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e3d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440813:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440819:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38522600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431572.440823:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440830:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e3d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440841:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431572.440845:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431572.440850:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440856:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522600/0xd8e438fb63528e3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440869:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440876:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528e44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440882:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528e44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440887:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523e00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431572.440890:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528e44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440896:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528e44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440903:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90cf13195a00)
00010000:00010000:2.0:1789431572.440906:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431572.440909:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528e44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440914:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523e00/0xd8e438fb63528e44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440944:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528e36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98bd expref: 245 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440958:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528e4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98bd expref: 244 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.440966:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:2.0:1789431572.440968:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1789431572.440971:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522e00, rc 0)
00000100:00100000:2.0:1789431572.441018:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14617:x1876351933673728:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 704us (2278us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431572.441025:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296519
00000100:00100000:2.0:1789431572.452603:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.452788:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.452820:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.452902:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933673984
00000100:00100000:0.0:1789431572.452912:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933673984
00000100:00100000:0.0:1789431572.452960:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933674112
00000100:00100000:0.0:1789431572.452963:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933674112
00000100:00100000:0.0:1789431572.452983:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296520
00000100:00100000:0.0:1789431572.452993:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14617:x1876351933673984:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.453013:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.453034:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63528e52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c98c4 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453115:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528e59 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453130:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528e59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453141:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528e59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453156:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528e60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453163:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528e60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453170:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528e60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453243:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528e59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453251:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528e59 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453258:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528e59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453265:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.453269:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528e59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453277:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528e59 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453288:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431572.453291:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.453296:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528e59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453302:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528e59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453313:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528e60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453318:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528e60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453324:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528e60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453329:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.453332:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528e60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453337:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528e60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453344:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xddd0a3dd (ffff90ce07190300)
00010000:00010000:0.0:1789431572.453347:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.453350:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528e60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453356:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528e60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453388:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63528e52 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98c4 expref: 246 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453397:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431572.453400:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.453404:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63528e52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98c4 expref: 246 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453412:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985e600, rc 0)
00000100:00100000:0.0:1789431572.453468:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14617:x1876351933673984:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 476us (873us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431572.453475:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296520
00000100:00100000:0.0:1789431572.453492:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296521
00000100:00100000:0.0:1789431572.453500:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14616:x1876351933674112:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.453508:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.453516:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528e67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c98cb expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453545:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528e6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453555:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528e6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453562:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528e6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453573:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63528e75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453579:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63528e75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453586:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63528e75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453623:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528e6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453629:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528e6e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453635:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528e6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453640:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985fc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.453644:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528e6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453650:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528e6e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453659:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431572.453662:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.453677:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528e6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453692:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528e6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453701:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63528e75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453708:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63528e75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453713:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63528e75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453719:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985ea00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.453722:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63528e75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453728:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63528e75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453735:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xddd0a3dd (ffff90ce07190600)
00010000:00010000:0.0:1789431572.453737:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.453740:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63528e75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453747:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ea00/0xd8e438fb63528e75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453769:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528e67 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98cb expref: 245 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453777:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431572.453779:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.453782:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528e67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98cb expref: 245 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.453791:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985ee00, rc 0)
00000100:00100000:0.0:1789431572.453813:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14616:x1876351933674112:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 314us (1025us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431572.453820:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296521
00000100:00100000:1.0:1789431572.454401:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933674240
00000100:00100000:1.0:1789431572.454409:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933674240
00000100:00100000:1.0:1789431572.454485:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14402
00000100:00100000:1.0:1789431572.454494:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e955050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:2348:x1876351933674240:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431572.454504:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431572.454518:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522e00/0xd8e438fb63528e4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98bd expref: 244 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.454530:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:1.0:1789431572.454533:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431572.454557:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e955050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+243:2348:x1876351933674240:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 65us (1736us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.454567:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14402
00000100:00100000:2.0:1789431572.461416:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.461534:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933674368
00000100:00100000:3.0:1789431572.461545:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933674368
00000100:00100000:3.0:1789431572.461606:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296522
00000100:00100000:3.0:1789431572.461617:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+243:14617:x1876351933674368:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431572.461648:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431572.461678:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528e7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c98d2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.461750:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528e83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.461764:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.461777:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431572.461811:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008c:0x0]: returning size 16384
00000004:00200000:3.0:1789431572.461815:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431572.461833:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.461856:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528e7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98d2 expref: 245 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.461875:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528e83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98d2 expref: 244 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.461884:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431572.461887:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431572.461892:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b600, rc 0)
00000100:00100000:3.0:1789431572.461953:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14617:x1876351933674368:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 339us (548us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431572.461961:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296522
00000100:00100000:0.0:1789431572.469804:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce1a568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894269696:0@lo:13:osp-pre-1-0.0
00000100:00100000:0.0:1789431572.469870:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789431572.470041:0:12256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351894269696
00000100:00100000:2.0:1789431572.470073:0:12256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351894269696
00000100:00100000:2.0:1789431572.470116:0:12256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137
00000100:00100000:2.0:1789431572.470124:0:12256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876351894269696:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:2.0:1789431572.470159:0:12256:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 18743296 granted 523960320 pending 0 free 3807379456 avail 3805282304
00000100:00100000:2.0:1789431572.470622:0:12256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876351894269696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 497us (750us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431572.470630:0:12256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137
00000100:00100000:2.0:1789431572.474959:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.475009:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.475110:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933674624
00000100:00100000:1.0:1789431572.475122:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933674624
00000100:00100000:1.0:1789431572.475172:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12608
00000100:00100000:1.0:1789431572.475183:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+244:14617:x1876351933674624:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:3.0:1789431572.476598:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933674752
00000100:00100000:3.0:1789431572.476608:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933674752
00000100:00100000:3.0:1789431572.476651:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296523
00000100:00100000:3.0:1789431572.476659:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+246:14616:x1876351933674752:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431572.476690:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431572.476693:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431572.476719:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528b2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c97c8 expref: 246 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.476737:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431572.476742:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431572.476755:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528e8a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c98d9 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.476851:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528e91 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.476864:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528e91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.476874:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528e91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.476890:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528e98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.476896:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528e98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.476902:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528e98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:3.0:1789431572.477452:0:6797:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x51f:0x0], index 1: 0
00010000:00010000:3.0:1789431572.477604:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528e9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10abb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.477616:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528e9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10abb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.477625:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528e9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10abb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.477653:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528e91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.477660:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528e91 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.477682:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528e91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.477688:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.477693:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528e91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.477705:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528e91 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.477715:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431572.477718:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431572.477723:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528e91 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.477729:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528e91 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431572.477740:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000036d5c355 reply state 000000000f6a2746 transno 4295121273 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528e98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.477748:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431572.477774:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528e8a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98d9 expref: 248 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.477788:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528e9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10abb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98d9 expref: 247 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.477796:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10abb:0x0].0x0 (ffff90ce2d731400)
00010000:00010000:3.0:1789431572.477798:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431572.477800:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7aa00, rc 0)
00000100:00100000:3.0:1789431572.477855:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+248:14616:x1876351933674752:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1196us (2904us total) trans 4295121273 rc 0/0
00000100:00100000:3.0:1789431572.477863:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296523
00000100:00100000:0.0:1789431572.479446:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294970086 gen 2
00000004:00080000:0.0:1789431572.479457:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce2a7e9180, transno 4294970086
00000100:00100000:0.0:1789431572.479494:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce1a568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876351894269696:0@lo:13:osp-pre-1-0.0
00010000:00010000:3.0:1789431572.483518:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528e98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.483537:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528e98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.483546:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528e98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.483552:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.483557:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528e98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.483564:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528e98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.483581:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xddd0a3dd (ffff90ce2d731b00)
00010000:00010000:3.0:1789431572.483584:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431572.483589:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528e98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.483594:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528e98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.486226:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14617:x1876351933674624:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 11025us (11197us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431572.486243:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12608
00000100:00100000:2.0:1789431572.490781:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.491403:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933674880
00000100:00100000:0.0:1789431572.491413:0:14502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933674880
00000100:00100000:0.0:1789431572.491526:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8454
00000100:00100000:0.0:1789431572.491537:0:14502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2349:x1876351933674880:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.491554:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.491586:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e2f9273/0xd8e438fb63528ead lrc: 2/0,0 mode: --/PR res: [0x280000400:0x51f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c98e0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789431572.491616:0:14502:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x51f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431572.491635:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51f:0x0].0x0 since=3030s v=(0 0)
00010000:00010000:0.0:1789431572.491640:0:14502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51f:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431572.491649:0:14502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e2f9273/0xd8e438fb63528ead lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98e0 expref: 71 pid: 14502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.491689:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000e2f9273/0xd8e438fb63528ead lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x51f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98e0 expref: 71 pid: 14502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.491704:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985ea00, rc 0)
00000100:00100000:0.0:1789431572.491764:0:14502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2349:x1876351933674880:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 229us (991us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.491771:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8454
00000100:00100000:3.0:1789431572.495982:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.496027:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.496080:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933675264
00000100:00100000:3.0:1789431572.496089:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933675264
00000100:00100000:3.0:1789431572.496135:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12609
00000100:00100000:3.0:1789431572.496145:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+245:14616:x1876351933675264:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431572.496494:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+246:14616:x1876351933675264:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 350us (465us total) trans 4295121274 rc 0/0
00000100:00100000:3.0:1789431572.496506:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12609
00000100:00100000:2.0:1789431572.497117:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933675008
00000100:00100000:2.0:1789431572.497124:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933675008
00000100:00100000:2.0:1789431572.497167:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296524
00000100:00100000:2.0:1789431572.497176:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+246:14617:x1876351933675008:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431572.497189:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431572.497227:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528eb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c98e7 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497284:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528ebb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497301:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528ebb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497312:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528ebb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497326:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ec2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497334:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497340:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497387:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528ebb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497396:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528ebb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497403:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528ebb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497408:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431572.497413:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528ebb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497421:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528ebb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497431:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431572.497434:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431572.497439:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528ebb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497446:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523c00/0xd8e438fb63528ebb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497458:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497464:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ec2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497470:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497475:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf38523600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431572.497478:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497485:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497491:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xddd0a3dd (ffff90cf13195a00)
00010000:00010000:2.0:1789431572.497494:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431572.497497:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ec2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497502:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38523600/0xd8e438fb63528ec2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497529:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528eb4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98e7 expref: 247 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497539:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:2.0:1789431572.497541:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431572.497544:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528eb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98e7 expref: 247 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.497554:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522c00, rc 0)
00000100:00100000:2.0:1789431572.497595:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+246:14617:x1876351933675008:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 421us (1621us total) trans 0 rc 301/301
00000100:00100000:2.0:1789431572.497602:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296524
00000100:00100000:2.0:1789431572.502437:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.502540:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933675520
00000100:00100000:3.0:1789431572.502552:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933675520
00000100:00100000:3.0:1789431572.502607:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12610
00000100:00100000:3.0:1789431572.502617:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+246:14616:x1876351933675520:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431572.504294:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+247:14616:x1876351933675520:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 1666us (1852us total) trans 4295121275 rc 0/0
00000100:00100000:3.0:1789431572.504309:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12610
00000100:00100000:2.0:1789431572.510600:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.510771:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933675776
00000100:00100000:1.0:1789431572.510782:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933675776
00000100:00100000:1.0:1789431572.510849:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 526
00000100:00100000:1.0:1789431572.510860:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+247:14617:x1876351933675776:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:1.0:1789431572.510911:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:1.0:1789431572.510939:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522400/0xd8e438fb63528e0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98af expref: 247 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.510959:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:1.0:1789431572.510970:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528e83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98d2 expref: 246 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.510980:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431572.510984:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1789431572.511010:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528ec9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.511023:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528ec9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.511032:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528ec9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.511103:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528ed0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.511113:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528ed0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.511121:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528ed0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.511134:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528ed7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.511140:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.511147:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.511351:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ede lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10ab8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.511361:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ede lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.511368:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ede lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.512366:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.512455:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933676032
00000100:00100000:3.0:1789431572.512465:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933676032
00000100:00100000:3.0:1789431572.512574:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12611
00000100:00100000:3.0:1789431572.512585:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0776f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+246:14616:x1876351933676032:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431572.512793:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0776f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+247:14616:x1876351933676032:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 209us (431us total) trans 4295121276 rc 0/0
00000100:00100000:3.0:1789431572.512800:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12611
00000004:00010000:3.0:1789431572.514933:0:5861:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a0678269 reply state 00000000e7bfb907 transno 4295121277 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ede lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.514951:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431572.514959:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528ec9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.514966:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528ec9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.514973:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528ec9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.514982:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.514986:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528ec9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.514994:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528ec9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.515008:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431572.515010:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431572.515016:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528ec9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.515023:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528ec9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431572.515037:0:5861:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a0678269 reply state 00000000e7bfb907 transno 4295121277 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528ed0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.515044:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 1
00000004:00010000:3.0:1789431572.515067:0:5861:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a0678269 reply state 00000000e7bfb907 transno 4295121277 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.515073:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 2
00000100:00100000:3.0:1789431572.515221:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+248:14617:x1876351933675776:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 4351us (4616us total) trans 4295121277 rc 0/0
00000100:00100000:3.0:1789431572.515229:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 526
00000100:00100000:2.0:1789431572.522472:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.522803:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:3.0:1789431572.522843:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.522857:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528ed7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.522865:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528ed7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.522871:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.522877:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528ed7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.522884:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528ed7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.522903:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90ce03149000)
00010000:00010000:3.0:1789431572.522906:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431572.522911:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528ed7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.522916:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528ed7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.522938:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528ed0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.522944:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528ed0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.522950:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528ed0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.522955:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.522958:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528ed0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.522968:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528ed0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.522976:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xddd0a3dd (ffff90ce03149200)
00010000:00010000:3.0:1789431572.522979:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431572.522981:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528ed0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.522987:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63528ed0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.522998:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ede lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.523005:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ede lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.523011:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ede lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.523015:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.523018:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ede lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.523024:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ede lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.523031:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab8:0x0].0x0 (ffff90ce2d731200)
00010000:00010000:3.0:1789431572.523033:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:3.0:1789431572.523036:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ede lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.523042:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb63528ede lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10ab8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.523953:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933676288
00000100:00100000:0.0:1789431572.523964:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933676288
00000100:00100000:0.0:1789431572.524042:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933676416
00000100:00100000:0.0:1789431572.524045:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933676416
00000100:00100000:3.0:1789431572.524106:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296525
00000100:00100000:3.0:1789431572.524116:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+248:14616:x1876351933676288:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431572.524164:0:12181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1789431572.524183:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63528e9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10abb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98d9 expref: 248 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.524198:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10abb:0x0].0x0 (ffff90ce2d731400)
00010000:00010000:3.0:1789431572.524217:0:12181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431572.524235:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528ee5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.524247:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.524256:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.524268:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528eec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.524275:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.524288:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.524382:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528ef3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10abb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.524390:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528ef3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10abb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.524396:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528ef3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10abb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000040:00080000:3.0:1789431572.525077:0:12181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1253, 64 off88448
00010000:00010000:3.0:1789431572.525137:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528efa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10abb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525148:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528efa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10abb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525156:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528efa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10abb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525164:0:12181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528efa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10abb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525170:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528efa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10abb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525176:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528efa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10abb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525200:0:12181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1789431572.525293:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1789431572.525300:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528efa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10abb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.525307:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc16f78b0)
00010000:00010000:2.0:1789431572.525311:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528efa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10abb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.525319:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528efa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10abb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.525329:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10abb:0x0].0x0 (ffff90ce2d731600)
00010000:00010000:2.0:1789431572.525332:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00010000:2.0:1789431572.525335:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528efa lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10abb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.525341:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63528efa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10abb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.525351:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431572.525353:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1789431572.525354:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1789431572.525695:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528ef3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10abb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525707:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528ef3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10abb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525713:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528ef3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10abb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525718:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.525721:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528ef3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10abb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525727:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528ef3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10abb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525735:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10abb:0x0].0x0 (ffff90ce2d731600)
00010000:00010000:3.0:1789431572.525738:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3
00010000:00010000:3.0:1789431572.525741:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528ef3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10abb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525747:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528ef3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10abb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525765:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525771:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528ee5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525777:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528ee5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525782:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7bc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.525786:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528ee5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525792:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528ee5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525798:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431572.525800:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431572.525803:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528ee5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.525808:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528ee5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431572.525816:0:12181:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bbea6b48 reply state 0000000012312b9e transno 4295121278 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.525823:0:12181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00000100:00100000:3.0:1789431572.525991:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+249:14616:x1876351933676288:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1874us (3525us total) trans 4295121278 rc 0/0
00000100:00100000:3.0:1789431572.525998:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296525
00000100:00100000:3.0:1789431572.526024:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296526
00000100:00100000:3.0:1789431572.526033:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+248:14617:x1876351933676416:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431572.526070:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431572.526081:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528f01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c98ee expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526122:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528f08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526137:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528f08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526145:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528f08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526157:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528f0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526163:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528f0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526170:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528f0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526202:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528f08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526480:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528f08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526488:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528f08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526494:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.526497:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528f08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526504:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528f08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526516:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431572.526519:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431572.526522:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528f08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526528:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528f08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526538:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528f0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526544:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528f0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526549:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528f0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526554:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.526557:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528f0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526563:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528f0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526569:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90ce2d731f00)
00010000:00010000:3.0:1789431572.526571:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431572.526573:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528f0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526578:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528f0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526602:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528f01 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98ee expref: 249 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526610:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:3.0:1789431572.526613:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431572.526616:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528f01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98ee expref: 249 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.526623:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b000, rc 0)
00000100:00100000:3.0:1789431572.526647:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+248:14617:x1876351933676416:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 617us (3846us total) trans 0 rc 301/301
00000100:00100000:3.0:1789431572.526653:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296526
00000100:00100000:2.0:1789431572.534816:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.534916:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933676544
00000100:00100000:0.0:1789431572.534925:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933676544
00000100:00100000:0.0:1789431572.534990:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296527
00000100:00100000:0.0:1789431572.535001:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+248:14616:x1876351933676544:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.535024:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.535072:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63528f16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c98f5 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535140:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535154:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535165:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535180:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535187:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535193:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535318:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528f2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535327:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528f2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535335:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528f2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431572.535369:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00000004:00200000:0.0:1789431572.535373:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431572.535391:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528f2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535406:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528f2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535415:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535422:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535428:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535434:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.535438:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535445:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535457:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431572.535460:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.535464:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535470:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535483:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535490:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535496:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535500:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.535504:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535509:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535516:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce07190800)
00010000:00010000:0.0:1789431572.535519:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.535521:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535527:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535557:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63528f16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98f5 expref: 250 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535569:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528f2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98f5 expref: 249 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.535577:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:0.0:1789431572.535579:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431572.535582:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985f000, rc 0)
00000100:00100000:0.0:1789431572.535637:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+249:14616:x1876351933676544:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 638us (831us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.535645:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296527
00010000:00010000:3.0:1789431572.535965:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.535974:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528eec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.535980:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528eec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.535986:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.535990:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528eec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.535996:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528eec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.536009:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xddd0a3dd (ffff90ce2d731b00)
00010000:00010000:3.0:1789431572.536011:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431572.536014:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528eec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.536020:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528eec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.538649:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.539718:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933676672
00000100:00100000:1.0:1789431572.539731:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933676672
00000100:00100000:1.0:1789431572.539799:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296528
00000100:00100000:1.0:1789431572.539809:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a56aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+248:14617:x1876351933676672:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431572.539830:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431572.539861:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528f32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c98fc expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.539925:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528f39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.539939:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528f39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.539950:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528f39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431572.539988:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008c:0x0]: returning size 16384
00000004:00200000:1.0:1789431572.539992:0:6797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431572.540010:0:6797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528f39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.540035:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63528f32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10073:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98fc expref: 250 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.540080:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528f39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98fc expref: 249 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.540089:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:1.0:1789431572.540092:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431572.540096:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309c00, rc 0)
00000100:00100000:1.0:1789431572.540156:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a56aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+249:14617:x1876351933676672:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 349us (1516us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.540166:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296528
00000100:00100000:2.0:1789431572.551143:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.551249:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933676800
00000100:00100000:0.0:1789431572.551259:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933676800
00000100:00100000:0.0:1789431572.551322:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12612
00000100:00100000:0.0:1789431572.551333:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce1a568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+249:14617:x1876351933676800:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:0.0:1789431572.556805:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce1a568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+249:14617:x1876351933676800:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 5464us (5662us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.556819:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12612
00000100:00100000:1.0:1789431572.564714:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.564759:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.565161:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933677056
00000100:00100000:2.0:1789431572.565171:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933677056
00000100:00100000:2.0:1789431572.565239:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933677312
00000100:00100000:2.0:1789431572.565243:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933677312
00000100:00100000:2.0:1789431572.565273:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296529
00000100:00100000:0.0:1789431572.565372:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296530
00000100:00100000:0.0:1789431572.565384:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+250:14617:x1876351933677312:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.565405:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.565426:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63528f40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c990a expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565503:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565519:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565531:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565546:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565553:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565561:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565611:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565618:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565625:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565631:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.565636:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565644:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565656:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431572.565659:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.565677:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565690:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528f47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565703:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565710:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565716:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565721:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.565724:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565730:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565738:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90ce07190800)
00010000:00010000:0.0:1789431572.565740:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.565743:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565748:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528f4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565780:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63528f40 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c990a expref: 251 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565790:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431572.565793:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:0.0:1789431572.565796:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63528f40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c990a expref: 251 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.565805:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985e600, rc 0)
00000100:00100000:0.0:1789431572.565877:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+250:14617:x1876351933677312:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 496us (1116us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431572.565886:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296530
00000100:00100000:2.0:1789431572.566218:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+249:14616:x1876351933677056:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:2.0:1789431572.566230:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1789431572.566242:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528f55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9903 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.566577:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528f5c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.566592:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528f2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98f5 expref: 250 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.566600:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528f5c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.566637:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528f2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98f5 expref: 250 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.566652:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528f2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98f5 expref: 250 pid: 12775 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.566674:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1e91a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894269824:192.168.203.4@tcp:104:
00000100:00100000:2.0:1789431572.566744:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce05ead600 going to sleep for 11 seconds
00000100:00100000:2.0:1789431572.574622:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.574678:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.574754:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933677696
00000100:00100000:0.0:1789431572.574764:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933677696
00000100:00100000:0.0:1789431572.574826:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296531
00000100:00100000:0.0:1789431572.574837:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+251:14617:x1876351933677696:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.574858:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.574861:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:0.0:1789431572.574885:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb63528f39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98fc expref: 251 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.574904:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431572.574909:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1789431572.574922:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528f63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9911 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.575029:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528f6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.575043:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528f6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.575077:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528f6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.575092:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528f71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.575099:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528f71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.575106:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528f71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:0.0:1789431572.575561:0:6797:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x520:0x0], index 0: 0
00010000:00010000:0.0:1789431572.575719:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528f78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.575730:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528f78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.575738:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528f78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.575769:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528f6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.575776:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528f6a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.575782:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528f6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.575788:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985fc00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.575791:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528f6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.575798:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528f6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.575807:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0x0 (ffff90ce27a57100)
00010000:00010000:0.0:1789431572.575810:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.575814:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528f6a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.575820:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528f6a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:0.0:1789431572.575832:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f4ad21fc reply state 00000000cc558041 transno 4295121279 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528f71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.575840:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:0.0:1789431572.575864:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f800/0xd8e438fb63528f63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9911 expref: 253 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.575875:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528f78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9911 expref: 252 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.575882:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10abc:0x0].0x0 (ffff90ce07190200)
00010000:00010000:0.0:1789431572.575884:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431572.575886:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985fe00, rc 0)
00000100:00100000:0.0:1789431572.575943:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+253:14617:x1876351933677696:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1109us (1265us total) trans 4295121279 rc 0/0
00000100:00100000:0.0:1789431572.575951:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296531
00000100:00100000:1.0:1789431572.576713:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933677440
00000100:00100000:1.0:1789431572.576724:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933677440
00010000:00010000:1.0:1789431572.576760:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528f2b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98f5 expref: 253 pid: 12775 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.576800:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16799
00000100:00100000:1.0:1789431572.576808:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+253:2348:x1876351933677440:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431572.576821:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431572.576827:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528f2b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98f5 expref: 253 pid: 12775 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.576839:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528f2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98f5 expref: 253 pid: 12775 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.576855:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:1.0:1789431572.576860:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528f5c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.576869:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528f5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.576875:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528f5c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.576892:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431572.576925:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+253:2348:x1876351933677440:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 118us (2313us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.576931:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16799
00010000:00010000:3.0:1789431572.581186:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985f000/0xd8e438fb63528f2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c98f5 expref: 252 pid: 12775 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.581222:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf1e91a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894269824:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431572.581246:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528f5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.581659:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528f5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.581685:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528f5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431572.581708:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00010000:00010000:1.0:1789431572.581867:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522c00/0xd8e438fb63528f55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9903 expref: 253 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.581885:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528f5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9903 expref: 252 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.581893:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:1.0:1789431572.581895:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:1.0:1789431572.581898:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf38522200, rc 0)
00000100:00100000:1.0:1789431572.581966:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+252:14616:x1876351933677056:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 16684us (17261us total) trans 4295121280 rc 0/0
00000100:00100000:1.0:1789431572.581974:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296529
00000100:00100000:2.0:1789431572.584005:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.584107:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933677824
00000100:00100000:0.0:1789431572.584117:0:14499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933677824
00000100:00100000:0.0:1789431572.584173:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8455
00000100:00100000:0.0:1789431572.584184:0:14499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+69:2348:x1876351933677824:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.584213:0:14499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.584239:0:14499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4a3acbe/0xd8e438fb63528f8d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x520:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9918 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789431572.584273:0:14499:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x520:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1789431572.584295:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x520:0x0].0x0 since=3030s v=(0 0)
00010000:00010000:0.0:1789431572.584300:0:14499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x520:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431572.584310:0:14499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4a3acbe/0xd8e438fb63528f8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x520:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9918 expref: 70 pid: 14499 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.584327:0:14499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4a3acbe/0xd8e438fb63528f8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x520:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9918 expref: 70 pid: 14499 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.584341:0:14499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985e600, rc 0)
00000100:00100000:0.0:1789431572.584392:0:14499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2348:x1876351933677824:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 210us (394us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.584399:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8455
00010000:00010000:3.0:1789431572.584867:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528f71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.584877:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528f71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.584885:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528f71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.584891:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985ee00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.584896:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528f71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.584904:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528f71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.584919:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008c:0x0].0xe7aaf970 (ffff90ce07190500)
00010000:00010000:3.0:1789431572.584922:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431572.584926:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528f71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.584932:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985ee00/0xd8e438fb63528f71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008c:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.594585:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.594624:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.594712:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933678080
00000100:00100000:3.0:1789431572.594722:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933678080
00000100:00100000:3.0:1789431572.594779:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296532
00000100:00100000:3.0:1789431572.594789:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+251:14616:x1876351933678080:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431572.594818:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431572.594841:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528f94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9926 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.594923:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528f9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.594936:0:12775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528f5c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9903 expref: 252 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.594945:0:12775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528f9b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.594976:0:12775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528f5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9903 expref: 252 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.594994:0:12775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528f5c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9903 expref: 252 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.595007:0:12775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894269952:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431572.595117:0:12775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf11f8b780 going to sleep for 11 seconds
00000100:00100000:0.0:1789431572.595552:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933677952
00000100:00100000:0.0:1789431572.595559:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933677952
00000100:00100000:0.0:1789431572.595593:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8456
00000100:00100000:0.0:1789431572.595602:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:14617:x1876351933677952:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.595610:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.595621:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d72421c/0xd8e438fb63528fa2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x520:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c991f expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.595644:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4a3acbe/0xd8e438fb63528f8d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x520:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9918 expref: 71 pid: 14499 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.595657:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x520:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431572.595661:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x520:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431572.595677:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d72421c/0xd8e438fb63528fa2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x520:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c991f expref: 71 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.595696:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4a3acbe/0xd8e438fb63528f8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x520:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9918 expref: 71 pid: 14499 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.595705:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4a3acbe/0xd8e438fb63528f8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x520:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9918 expref: 71 pid: 14499 timeout: 3130 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.595714:0:8217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d508700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8217:1876351894270080:192.168.203.4@tcp:104:
00000100:00100000:0.0:1789431572.595752:0:8217:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3e6d1780 going to sleep for 11 seconds
00000100:00100000:0.0:1789431572.600803:0:8217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d508700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8217:1876351894270080:192.168.203.4@tcp:104:
00010000:00010000:0.0:1789431572.600840:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d72421c/0xd8e438fb63528fa2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x520:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c991f expref: 71 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.600861:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985f800, rc 0)
00000100:00100000:0.0:1789431572.600920:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:14617:x1876351933677952:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 5319us (6345us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.600929:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8456
00000100:00100000:3.0:1789431572.601773:0:12775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12775:1876351894269952:192.168.203.4@tcp:104:
00010000:00010000:3.0:1789431572.601797:0:12775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528f9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.605481:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.605737:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933678208
00000100:00100000:1.0:1789431572.605748:0:14506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933678208
00010000:00010000:1.0:1789431572.605787:0:14506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528f5c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9903 expref: 253 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.605831:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16800
00000100:00100000:1.0:1789431572.605841:0:14506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+253:2347:x1876351933678208:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1789431572.605857:0:14506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1789431572.605863:0:14506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528f5c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9903 expref: 253 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.605876:0:14506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528f5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9903 expref: 253 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.605898:0:14506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf38522200/0xd8e438fb63528f5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9903 expref: 253 pid: 5847 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.605915:0:14506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:1.0:1789431572.605920:0:14506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528f9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.605930:0:14506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.605937:0:14506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528f9b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.605967:0:14506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1789431572.606016:0:14506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+252:2347:x1876351933678208:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 177us (544us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.606023:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16800
00010000:00010000:3.0:1789431572.606136:0:12775:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.606145:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431572.606187:0:12775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00000004:00200000:3.0:1789431572.606191:0:12775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431572.606218:0:12775:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.606258:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528f94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9926 expref: 252 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.606275:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528f9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9926 expref: 251 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.606283:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431572.606286:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431572.606288:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b000, rc 0)
00000100:00100000:3.0:1789431572.606314:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+251:14616:x1876351933678080:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 11527us (11688us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431572.606321:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296532
00000100:00100000:2.0:1789431572.608462:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.608547:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933678336
00000100:00100000:0.0:1789431572.608556:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933678336
00010000:00010000:0.0:1789431572.608593:0:6715:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4a3acbe/0xd8e438fb63528f8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x520:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9918 expref: 71 pid: 14499 timeout: 3130 lvb_type: 1 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.608637:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16801
00000100:00100000:0.0:1789431572.608648:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2347:x1876351933678336:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431572.608673:0:6715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431572.608703:0:6715:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4a3acbe/0xd8e438fb63528f8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x520:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9918 expref: 71 pid: 14499 timeout: 3130 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.608717:0:6715:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4a3acbe/0xd8e438fb63528f8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x520:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9918 expref: 71 pid: 14499 timeout: 3130 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.608739:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4a3acbe/0xd8e438fb63528f8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x520:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9918 expref: 71 pid: 14499 timeout: 3130 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.608755:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x520:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431572.608760:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x520:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789431572.608768:0:6715:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d72421c/0xd8e438fb63528fa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x520:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c991f expref: 70 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.608778:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d72421c/0xd8e438fb63528fa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x520:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c991f expref: 70 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.608815:0:6715:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008d72421c/0xd8e438fb63528fa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x520:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c991f expref: 70 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.608830:0:6715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce2d508700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6715:1876351894270208:192.168.203.4@tcp:105:
00000100:00100000:0.0:1789431572.608916:0:6715:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf3e6d1780 going to sleep for 11 seconds
00000100:00100000:0.0:1789431572.613336:0:6715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce2d508700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6715:1876351894270208:192.168.203.4@tcp:105:
00010000:00010000:0.0:1789431572.613364:0:6715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431572.613422:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2347:x1876351933678336:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 4776us (4970us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.613432:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16801
00000100:00100000:2.0:1789431572.622165:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.622276:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933678592
00000100:00100000:3.0:1789431572.622286:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933678592
00000100:00100000:3.0:1789431572.622342:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12613
00000100:00100000:3.0:1789431572.622352:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+251:14616:x1876351933678592:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431572.622582:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+252:14616:x1876351933678592:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 231us (425us total) trans 4295121281 rc 0/0
00000100:00100000:3.0:1789431572.622589:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12613
00000100:00100000:2.0:1789431572.626681:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.626866:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933678720
00000100:00100000:3.0:1789431572.626876:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933678720
00000100:00100000:3.0:1789431572.626936:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296533
00000100:00100000:3.0:1789431572.626947:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+252:14616:x1876351933678720:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431572.626971:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431572.626993:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528fa9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c992d expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.627094:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528fb0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.627108:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528fb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.627119:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528fb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.627137:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528fb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.627143:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.627149:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.627910:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63528fbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.627923:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63528fbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.627932:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63528fbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1789431572.627965:0:12181:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10ab9:0x0]: returning size 74834
00000004:00200000:0.0:1789431572.627969:0:12181:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1789431572.627986:0:12181:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63528fbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.627996:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63528fbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.628004:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528fb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.628011:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528fb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.628018:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528fb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.628029:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.628033:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528fb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.628040:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528fb0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.628072:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431572.628076:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.628082:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528fb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.628089:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb63528fb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.628102:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.628108:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528fb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.628113:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.628118:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.628121:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.628127:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528fb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.628138:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce2d731b00)
00010000:00010000:0.0:1789431572.628140:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.628143:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528fb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.628149:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63528fb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.628181:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb63528fa9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c992d expref: 254 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.628264:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63528fbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c992d expref: 253 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.628272:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:0.0:1789431572.628274:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1789431572.628277:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985e600, rc 0)
00000100:00100000:0.0:1789431572.628437:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+253:14616:x1876351933678720:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1491us (1774us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.628445:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296533
00000100:00100000:1.0:1789431572.634837:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.634908:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933678848
00000100:00100000:0.0:1789431572.634918:0:14474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933678848
00000100:00100000:0.0:1789431572.634981:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14403
00000100:00100000:0.0:1789431572.634991:0:14474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+253:2350:x1876351933678848:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431572.635005:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431572.635028:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e600/0xd8e438fb63528fbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c992d expref: 253 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.635084:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:0.0:1789431572.635089:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431572.635134:0:14474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+252:2350:x1876351933678848:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 145us (306us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.635141:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14403
00000100:00100000:2.0:1789431572.637019:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.638002:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933678976
00000100:00100000:0.0:1789431572.638015:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933678976
00000100:00100000:0.0:1789431572.638296:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296534
00000100:00100000:0.0:1789431572.638308:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+252:14616:x1876351933678976:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.638327:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.638348:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528fc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9934 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638410:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528fcc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638424:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528fcc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638435:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528fcc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638449:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528fd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638457:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638468:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638522:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528fcc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638530:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528fcc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638537:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528fcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638544:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.638548:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528fcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638556:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528fcc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638568:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431572.638571:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.638576:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528fcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638582:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63528fcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638595:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638601:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528fd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638608:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638613:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.638616:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638622:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528fd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638629:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xddd0a3dd (ffff90ce07190e00)
00010000:00010000:0.0:1789431572.638631:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.638634:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528fd3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638639:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63528fd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638752:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528fc5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9934 expref: 253 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638762:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431572.638764:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.638768:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb63528fc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9934 expref: 253 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.638778:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985fc00, rc 0)
00000100:00100000:0.0:1789431572.638888:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+252:14616:x1876351933678976:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 584us (1875us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431572.638896:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296534
00000100:00100000:2.0:1789431572.642457:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.642543:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933679232
00000100:00100000:3.0:1789431572.642553:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933679232
00000100:00100000:3.0:1789431572.642611:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12614
00000100:00100000:3.0:1789431572.642620:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+252:14617:x1876351933679232:12345-192.168.203.4@tcp:35:dbench.0
00000100:00100000:3.0:1789431572.643209:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+253:14617:x1876351933679232:12345-192.168.203.4@tcp:35:dbench.0 Request processed in 589us (932us total) trans 4295121282 rc 0/0
00000100:00100000:3.0:1789431572.643218:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12614
00000100:00100000:2.0:1789431572.652878:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.652976:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933679360
00000100:00100000:1.0:1789431572.652986:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933679360
00000100:00100000:1.0:1789431572.653140:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296535
00000100:00100000:1.0:1789431572.653150:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1e91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+253:14616:x1876351933679360:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431572.653176:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431572.653205:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528fda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c993b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.653269:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528fe1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.653425:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.653440:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1789431572.653477:0:5849:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008d:0x0]: returning size 16384
00000004:00200000:1.0:1789431572.653481:0:5849:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:1.0:1789431572.653500:0:5849:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.653526:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528fda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c993b expref: 255 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.653544:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c993b expref: 254 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.653553:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431572.653556:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1789431572.653560:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b308400, rc 0)
00000100:00100000:1.0:1789431572.653617:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1e91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+254:14616:x1876351933679360:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 468us (749us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.653628:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296535
00000100:00100000:0.0:1789431572.654748:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.654864:0:6797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933679616
00000100:00100000:3.0:1789431572.654872:0:6797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933679616
00000100:00100000:3.0:1789431572.654919:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296536
00000100:00100000:3.0:1789431572.654929:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+254:14617:x1876351933679616:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431572.654945:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431572.654961:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528fe8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9942 expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.655071:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528fef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10abc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.655087:0:6797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528f78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9911 expref: 255 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.655095:0:6797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528fef lrc: 4/0,1 mode: --/CW res: [0x200000401:0x10abc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.655130:0:6797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528f78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9911 expref: 255 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.655144:0:6797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528f78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9911 expref: 255 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.655158:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90ce387b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894270336:192.168.203.4@tcp:104:
00000100:00100000:3.0:1789431572.655244:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90ce2065ea80 going to sleep for 11 seconds
00000100:00100000:0.0:1789431572.668873:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.668950:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.669081:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90ce387b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6797:1876351894270336:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431572.669108:0:6797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528fef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10abc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.669295:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933679744
00000100:00100000:3.0:1789431572.669303:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933679744
00000100:00100000:3.0:1789431572.669354:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12615
00000100:00100000:3.0:1789431572.669363:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+256:14616:x1876351933679744:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:2.0:1789431572.670404:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933679872
00000100:00100000:2.0:1789431572.670414:0:14498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933679872
00010000:00010000:2.0:1789431572.670447:0:14498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528f78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9911 expref: 258 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789431572.670487:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16802
00000100:00100000:2.0:1789431572.670495:0:14498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d509880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+258:2348:x1876351933679872:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1789431572.670506:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1789431572.670512:0:14498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528f78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9911 expref: 258 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.670525:0:14498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528f78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9911 expref: 258 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.670543:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fe00/0xd8e438fb63528f78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9911 expref: 258 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.670558:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10abc:0x0].0x0 (ffff90ce07190200)
00010000:00010000:2.0:1789431572.670563:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528fef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x10abc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.670574:0:14498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528fef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10abc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.670581:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528fef lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x10abc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.670605:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1789431572.670653:0:14498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d509880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+257:2348:x1876351933679872:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 158us (1703us total) trans 0 rc 0/0
00000100:00100000:2.0:1789431572.670659:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16802
00010000:00010000:2.0:1789431572.671420:0:6797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528fef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10abc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.671431:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528fef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x10abc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1789431572.671453:0:6797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10abc:0x0]: returning size 77076
00010000:00010000:2.0:1789431572.671606:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7bc00/0xd8e438fb63528fe8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9942 expref: 258 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.671625:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528fef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10abc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9942 expref: 257 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.671632:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10abc:0x0].0x0 (ffff90ce07190200)
00010000:00010000:2.0:1789431572.671635:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5
00010000:00010000:2.0:1789431572.671637:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b400, rc 0)
00000100:00100000:2.0:1789431572.671697:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+257:14617:x1876351933679616:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 16769us (16955us total) trans 4295121283 rc 0/0
00000100:00100000:2.0:1789431572.671705:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296536
00000100:00100000:1.0:1789431572.677813:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+255:14616:x1876351933679744:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 8440us (8940us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.677825:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12615
00000100:00100000:3.0:1789431572.678820:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.682126:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933680000
00000100:00100000:1.0:1789431572.682140:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933680000
00000100:00100000:1.0:1789431572.682213:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296537
00000100:00100000:1.0:1789431572.682224:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce387b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+255:14617:x1876351933680000:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431572.682247:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431572.682267:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528ffd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10abc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9949 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.682350:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63529004 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.682363:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528fef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x10abc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9942 expref: 256 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.682371:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63529004 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.682400:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528fef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10abc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9942 expref: 256 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.682417:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528fef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10abc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9942 expref: 256 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.682430:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3b2c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894270464:192.168.203.4@tcp:104:
00000100:00100000:1.0:1789431572.682505:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cf048f6780 going to sleep for 11 seconds
00000100:00100000:3.0:1789431572.685081:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.685345:0:12775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933680128
00000100:00100000:0.0:1789431572.685354:0:12775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933680128
00000100:00100000:0.0:1789431572.685401:0:12775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296538
00000100:00100000:0.0:1789431572.685410:0:12775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0e614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+257:14616:x1876351933680128:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.685430:0:12775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.685450:0:12775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb6352900b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9950 expref: -99 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685507:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63529012 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685520:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63529012 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685531:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63529012 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685543:0:12775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529019 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685550:0:12775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529019 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685557:0:12775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529019 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685608:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63529012 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685615:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63529012 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685622:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63529012 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685628:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.685632:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63529012 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685638:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63529012 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685648:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431572.685651:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.685656:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63529012 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685673:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb63529012 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685744:0:12775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529019 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685751:0:12775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529019 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685756:0:12775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529019 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685761:0:12775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.685764:0:12775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529019 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685769:0:12775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529019 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685777:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xddd0a3dd (ffff90ce07190e00)
00010000:00010000:0.0:1789431572.685780:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.685783:0:12775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529019 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685789:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529019 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12775 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685821:0:12775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb6352900b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9950 expref: 258 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685831:0:12775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431572.685833:0:12775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.685837:0:12775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb6352900b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9950 expref: 258 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.685846:0:12775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985fc00, rc 0)
00000100:00100000:0.0:1789431572.685900:0:12775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0e614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+257:14616:x1876351933680128:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 490us (855us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431572.685907:0:12775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296538
00000100:00100000:1.0:1789431572.686249:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cf3b2c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876351894270464:192.168.203.4@tcp:104:
00010000:00010000:1.0:1789431572.686272:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63529004 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.690988:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.691091:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933680256
00000100:00100000:0.0:1789431572.691103:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933680256
00010000:00010000:0.0:1789431572.691147:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528fef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10abc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9942 expref: 257 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789431572.691180:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16803
00000100:00100000:0.0:1789431572.691190:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+257:2347:x1876351933680256:12345-192.168.203.4@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1789431572.691213:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1789431572.691220:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528fef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x10abc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9942 expref: 257 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.691233:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528fef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x10abc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9942 expref: 257 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.691255:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b400/0xd8e438fb63528fef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x10abc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9942 expref: 257 pid: 6797 timeout: 3130 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.691272:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10abc:0x0].0x0 (ffff90ce07190200)
00010000:00010000:0.0:1789431572.691277:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63529004 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.691296:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63529004 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.691304:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63529004 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.691334:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1789431572.691382:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+256:2347:x1876351933680256:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 194us (403us total) trans 0 rc 0/0
00000100:00100000:0.0:1789431572.691393:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16803
00010000:00010000:3.0:1789431572.694008:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63529004 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.694023:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63529004 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431572.694097:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x10abc:0x0]: returning size 77076
00000004:00200000:3.0:1789431572.694102:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431572.694123:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63529004 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.694161:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308200/0xd8e438fb63528ffd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10abc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9949 expref: 256 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.694180:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309600/0xd8e438fb63529004 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10abc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9949 expref: 255 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.694189:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10abc:0x0].0x0 (ffff90ce07190200)
00010000:00010000:3.0:1789431572.694202:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431572.694206:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309600, rc 0)
00000100:00100000:3.0:1789431572.694263:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce387b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+255:14617:x1876351933680000:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 12041us (15449us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431572.694271:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296537
00000100:00100000:2.0:1789431572.694440:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.695020:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933680512
00000100:00100000:3.0:1789431572.695029:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933680512
00000100:00100000:3.0:1789431572.695148:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 527
00000100:00100000:3.0:1789431572.695159:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+255:14616:x1876351933680512:12345-192.168.203.4@tcp:36:dbench.0
00010000:00010000:3.0:1789431572.695358:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:3.0:1789431572.695381:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63528f9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10ab9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9926 expref: 255 pid: 12775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.695398:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:3.0:1789431572.695408:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308400/0xd8e438fb63528fe1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c993b expref: 254 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.695419:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431572.695422:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431572.695446:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63529020 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.695459:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63529020 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.695467:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63529020 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.695481:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63529027 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.695488:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63529027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.695494:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63529027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.695507:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352902e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.695514:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352902e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.695520:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352902e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.695646:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63529035 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10ab9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.695655:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63529035 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.695676:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63529035 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431572.696414:0:5862:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000072157ba9 reply state 00000000d0ed6ff4 transno 4295121284 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63529035 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.696425:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431572.696431:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63529020 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.696438:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63529020 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.696446:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63529020 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.696452:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a400 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.696456:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63529020 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.696464:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63529020 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.696474:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431572.696477:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431572.696482:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63529020 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.696487:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63529020 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431572.696498:0:5862:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000072157ba9 reply state 00000000d0ed6ff4 transno 4295121284 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63529027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.696504:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 1
00000004:00010000:3.0:1789431572.696507:0:5862:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000072157ba9 reply state 00000000d0ed6ff4 transno 4295121284 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352902e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.696512:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 2
00000100:00100000:3.0:1789431572.696625:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+255:14616:x1876351933680512:12345-192.168.203.4@tcp:36:dbench.0 Request processed in 1465us (2183us total) trans 4295121284 rc 0/0
00000100:00100000:3.0:1789431572.696633:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 527
00000100:00100000:3.0:1789431572.700754:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.700830:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933680640
00000100:00100000:1.0:1789431572.700840:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933680640
00000100:00100000:1.0:1789431572.700899:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296539
00000100:00100000:1.0:1789431572.700909:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2e82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+255:14616:x1876351933680640:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431572.700934:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431572.700955:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352903c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9957 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.701018:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63529043 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.701033:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63529043 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.701044:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63529043 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.701181:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352904a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.701191:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352902e lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.701202:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352904a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.701218:0:5849:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352902e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.701228:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352904a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.702159:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352902e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.702172:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352902e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.702179:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352902e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.702185:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:2.0:1789431572.702189:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352902e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.702255:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352902e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.702269:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce2d731600)
00010000:00010000:2.0:1789431572.702273:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1789431572.702276:0:3298:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352904a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.702377:0:3298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352904a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789431572.702386:0:3298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352904a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.702522:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352902e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.702531:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a000/0xd8e438fb6352902e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.702544:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63529027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.702549:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63529027 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.702554:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63529027 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.702558:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7aa00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431572.702560:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63529027 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.702570:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63529027 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.702577:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xddd0a3dd (ffff90ce2d731f00)
00010000:00010000:1.0:1789431572.702579:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431572.702582:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63529027 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.702587:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7aa00/0xd8e438fb63529027 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xddd0a3dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.702602:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63529035 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.702608:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63529035 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.702614:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63529035 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.702619:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7b600 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431572.702623:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63529035 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.702628:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63529035 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.702643:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10ab9:0x0].0x0 (ffff90cf13195500)
00010000:00010000:1.0:1789431572.702646:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21
00010000:00010000:1.0:1789431572.702649:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63529035 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.702655:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63529035 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10ab9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.702910:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352904a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.702919:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352904a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.703037:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63529043 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.703045:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63529043 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.703155:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63529043 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.703161:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b309a00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431572.703164:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63529043 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.703171:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63529043 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.703180:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431572.703183:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431572.703186:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63529043 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.703191:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309a00/0xd8e438fb63529043 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.703270:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352904a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.703277:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352904a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.703344:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352904a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.703350:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1b308c00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431572.703354:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352904a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.703361:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352904a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.703369:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce2d731600)
00010000:00010000:1.0:1789431572.703372:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431572.703375:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352904a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.703382:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b308c00/0xd8e438fb6352904a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.703425:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352903c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9957 expref: 255 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.703435:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:1.0:1789431572.703437:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431572.703441:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1b309c00/0xd8e438fb6352903c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9957 expref: 255 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.703450:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1b309c00, rc 0)
00000100:00100000:1.0:1789431572.703553:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2e82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+254:14616:x1876351933680640:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 2644us (2805us total) trans 0 rc 301/301
00000100:00100000:1.0:1789431572.703562:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296539
00000100:00100000:2.0:1789431572.707325:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.707398:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933680768
00000100:00100000:3.0:1789431572.707408:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933680768
00002000:00100000:3.0:1789431572.707459:0:14435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x520:0x0] (0->77075)  req@ffff90ce3a045f80 x1876351933680768/t0(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:43/0 lens 488/0 e 0 to 0 dl 1789431583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431572.707470:0:14435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce3a045f80 with x1876351933680768 ext(0->77075)
00002000:00010000:3.0:1789431572.707475:0:14435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce3a045f80
00000100:00100000:3.0:1789431572.707507:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1587
00000100:00100000:3.0:1789431572.707518:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+70:2348:x1876351933680768:12345-192.168.203.4@tcp:4:dbench.0
00000100:00100000:1.0:1789431572.710770:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.710917:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933680896
00000100:00100000:3.0:1789431572.710928:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933680896
00000100:00100000:3.0:1789431572.710983:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296540
00000100:00100000:3.0:1789431572.710993:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3b2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+254:14616:x1876351933680896:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431572.711011:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431572.711031:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63529051 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c995e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.711122:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63529058 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.711136:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63529058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.711146:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63529058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:3.0:1789431572.711177:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1008d:0x0]: returning size 16384
00000004:00200000:3.0:1789431572.711180:0:5848:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1
00000004:00010000:3.0:1789431572.711199:0:5848:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63529058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.711222:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63529051 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10072:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c995e expref: 256 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.711239:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63529058 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c995e expref: 255 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.711253:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431572.711257:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:3.0:1789431572.711260:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b000, rc 0)
00000100:00100000:3.0:1789431572.711309:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3b2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+255:14616:x1876351933680896:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 318us (547us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431572.711315:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296540
00000100:00100000:3.0:1789431572.719138:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2348:x1876351933680768:12345-192.168.203.4@tcp:4:dbench.0 Request processed in 11611us (11811us total) trans 4294969689 rc 0/0
00000100:00100000:3.0:1789431572.719151:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1587
00002000:00100000:3.0:1789431572.719163:0:14435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x520:0x0] (0->77075)  req@ffff90ce3a045f80 x1876351933680768/t4294969689(0) o4->9e1a758d-39a4-4bab-a2f8-fcda72dee44f@192.168.203.4@tcp:43/0 lens 488/448 e 0 to 0 dl 1789431583 ref 1 fl Complete:/600/0 rc 0/0 job:'dbench.0' uid:0 gid:0 projid:0
00002000:00100000:3.0:1789431572.719172:0:14435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce3a045f80 with x1876351933680768 ext(0->77075)
00002000:00010000:3.0:1789431572.719178:0:14435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce3a045f80
00000100:00100000:3.0:1789431572.722003:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:0.0:1789431572.722091:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933681024
00000100:00100000:0.0:1789431572.722102:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933681024
00000100:00100000:0.0:1789431572.722157:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12616
00000100:00100000:0.0:1789431572.722168:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0776d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+255:14616:x1876351933681024:12345-192.168.203.4@tcp:37:dbench.0
00000100:00100000:1.0:1789431572.726332:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0776d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+255:14616:x1876351933681024:12345-192.168.203.4@tcp:37:dbench.0 Request processed in 4157us (4330us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.726344:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12616
00000100:00100000:2.0:1789431572.732143:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.732184:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.732229:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:3.0:1789431572.732341:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933681280
00000100:00100000:3.0:1789431572.732352:0:14497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933681280
00000100:00100000:3.0:1789431572.732405:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1136
00000100:00100000:3.0:1789431572.732414:0:14497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2347:x1876351933681280:12345-192.168.203.4@tcp:400:kworker.0
00000100:00100000:3.0:1789431572.732476:0:14497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2347:x1876351933681280:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 64us (291us total) trans 0 rc 0/0
00000100:00100000:3.0:1789431572.732483:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1136
00000100:00100000:0.0:1789431572.732553:0:12181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933681536
00000100:00100000:0.0:1789431572.732559:0:12181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933681536
00000100:00100000:0.0:1789431572.732596:0:12181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296541
00000100:00100000:0.0:1789431572.732603:0:12181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+255:14616:x1876351933681536:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:0.0:1789431572.732617:0:12181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1789431572.732638:0:12181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb6352905f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9965 expref: -99 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732726:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529066 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732740:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529066 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732750:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529066 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732763:0:12181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb6352906d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732770:0:12181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb6352906d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732775:0:12181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb6352906d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732828:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529066 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732835:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529066 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732842:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529066 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732847:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e800 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.732851:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529066 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732859:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529066 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732869:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431572.732872:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.732877:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529066 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732883:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e800/0xd8e438fb63529066 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732895:0:12181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb6352906d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732902:0:12181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb6352906d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732907:0:12181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb6352906d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732913:0:12181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce1985e000 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:0.0:1789431572.732916:0:12181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb6352906d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732921:0:12181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb6352906d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732927:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce07190e00)
00010000:00010000:0.0:1789431572.732930:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1789431572.732932:0:12181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb6352906d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732937:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985e000/0xd8e438fb6352906d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12181 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732969:0:12181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb6352905f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9965 expref: 256 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732979:0:12181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:0.0:1789431572.732981:0:12181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:0.0:1789431572.732985:0:12181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce1985fc00/0xd8e438fb6352905f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1008d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9965 expref: 256 pid: 12181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789431572.732994:0:12181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce1985fc00, rc 0)
00000100:00100000:0.0:1789431572.733018:0:12181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+255:14616:x1876351933681536:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 416us (788us total) trans 0 rc 301/301
00000100:00100000:0.0:1789431572.733024:0:12181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296541
00000100:00100000:1.0:1789431572.734799:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933681152
00000100:00100000:1.0:1789431572.734813:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933681152
00000100:00100000:1.0:1789431572.734871:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1310
00000100:00100000:1.0:1789431572.734881:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2ad6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fbca16f1-ddd0-4a1e-a69e-4d5ed8005437+10:2347:x1876351933681152:12345-192.168.203.4@tcp:400:kworker.0
00000100:00100000:1.0:1789431572.734952:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2ad6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fbca16f1-ddd0-4a1e-a69e-4d5ed8005437+10:2347:x1876351933681152:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 73us (2817us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.734959:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1310
00000100:00100000:2.0:1789431572.746754:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:2.0:1789431572.746838:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00000100:00100000:1.0:1789431572.746931:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933681792
00000100:00100000:1.0:1789431572.746940:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933681792
00000100:00100000:1.0:1789431572.746992:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933681920
00000100:00100000:1.0:1789431572.746995:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933681920
00000100:00100000:1.0:1789431572.747022:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296542
00000100:00100000:1.0:1789431572.747031:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+256:14617:x1876351933681792:12345-192.168.203.4@tcp:44:dbench.0
00000100:00100000:3.0:1789431572.747178:0:6797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296543
00000100:00100000:3.0:1789431572.747188:0:6797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce3a044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+256:14616:x1876351933681920:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:3.0:1789431572.747211:0:6797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:3.0:1789431572.747214:0:6797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1
00010000:00010000:3.0:1789431572.747239:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b000/0xd8e438fb63529058 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1008d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c995e expref: 256 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.747257:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431572.747262:0:6797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1789431572.747273:0:6797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63529074 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c996c expref: -99 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.747368:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352907b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.747382:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352907b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.747391:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352907b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.747405:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63529082 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.747411:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63529082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.747417:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63529082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00080000:3.0:1789431572.747861:0:6797:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x520:0x0], index 1: 0
00010000:00010000:3.0:1789431572.748016:0:6797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63529089 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10abd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.748027:0:6797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63529089 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10abd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.748036:0:6797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63529089 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10abd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.748125:0:6797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352907b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.748132:0:6797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352907b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.748139:0:6797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352907b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.748145:0:6797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7a200 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:3.0:1789431572.748149:0:6797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352907b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.748157:0:6797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352907b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.748167:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0x0 (ffff90ce27a57700)
00010000:00010000:3.0:1789431572.748170:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:3.0:1789431572.748174:0:6797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352907b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.748179:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a200/0xd8e438fb6352907b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00010000:3.0:1789431572.748190:0:6797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000013ac77b3 reply state 00000000f7b5028e transno 4295121285 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63529082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789431572.748199:0:6797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0
00010000:00010000:3.0:1789431572.748226:0:6797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7a400/0xd8e438fb63529074 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1008d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c996c expref: 258 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.748239:0:6797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7b600/0xd8e438fb63529089 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10abd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c996c expref: 257 pid: 6797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789431572.748246:0:6797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10abd:0x0].0x0 (ffff90ce2d731100)
00010000:00010000:3.0:1789431572.748249:0:6797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:3.0:1789431572.748251:0:6797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01e7b600, rc 0)
00000100:00100000:3.0:1789431572.748308:0:6797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce3a044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+258:14616:x1876351933681920:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 1121us (1470us total) trans 4295121285 rc 0/0
00000100:00100000:3.0:1789431572.748315:0:6797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296543
00000100:00100000:0.0:1789431572.756149:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp)
00010000:00010000:1.0:1789431572.756222:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63529082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.756234:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63529082 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.756242:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63529082 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.756251:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01e7ba00 already unused, calling callback (ffffffffc211f4f0)
00010000:00010000:1.0:1789431572.756256:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63529082 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.756263:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63529082 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.756278:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1008d:0x0].0xe7aaf970 (ffff90ce2d731400)
00010000:00010000:1.0:1789431572.756281:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1789431572.756285:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63529082 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.756291:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01e7ba00/0xd8e438fb63529082 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1008d:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6797 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789431572.756325:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351933682048
00000100:00100000:1.0:1789431572.756333:0:14501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351933682048
00000100:00100000:1.0:1789431572.756378:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8457
00000100:00100000:1.0:1789431572.756387:0:14501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+71:2348:x1876351933682048:12345-192.168.203.4@tcp:101:dbench.0
00010000:00010000:1.0:1789431572.756401:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1789431572.756417:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6bbf184/0xd8e438fb63529097 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x520:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8859daa2901c9973 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789431572.756439:0:14501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x520:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:1.0:1789431572.756456:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x520:0x0].0x0 since=3030s v=(0 0)
00010000:00010000:1.0:1789431572.756460:0:14501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x520:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789431572.756467:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6bbf184/0xd8e438fb63529097 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x520:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9973 expref: 72 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.756487:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a6bbf184/0xd8e438fb63529097 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x520:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x8859daa2901c9973 expref: 72 pid: 14501 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789431572.756497:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce19858800, rc 0)
00000100:00100000:1.0:1789431572.756545:0:14501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce2d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:9e1a758d-39a4-4bab-a2f8-fcda72dee44f+72:2348:x1876351933682048:12345-192.168.203.4@tcp:101:dbench.0 Request processed in 159us (405us total) trans 0 rc 0/0
00000100:00100000:1.0:1789431572.756551:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8457
Debug log: 60900 lines, 60900 kept, 0 dropped, 0 bad.